Deployment Guide

To run DAVE use one of the following commands:

Build images for Airflow and Spark (makefile)

$ make build

Build images for Airflow and Spark (manually)

$ docker build -t dave/airflow:latest ./airflow/
$ docker build -t dave/spark:latest ./spark/

Fullstack initialization

$ docker compose up -d

Partial initialization (no Airflow and no Spark)

$ docker compose up --build api keycloak mongodb mlflow frontend minio

Partial initialization w/ rebuild

$ docker compose up --build api keycloak mongodb mlflow frontend minio --watch

  • Note: Changes in the Spark and/or Airflow components, or the first run require building these images before running the project.

Now go to localhost:3000 to see the service. Log in using the email and the password you set up while adding a new user in keycloak (step 5 in the setting up the environment guide).

Next Steps