Basic Usage

This document contains a simple tutorial on how to use DAVE, including:

  • Adding datasets

  • Creating workflows

  • Saving and loading workflows

The image below depicts the Home page of the framework.

DAVE Main Menu

Adding Datasets

DAVE currently supports two types of data sources:

  • Relational databases (PostgreSQL, MySQL, etc.)

  • Files

Relational databases are always accessible during workflow execution. Files, however, must be uploaded before they can be used. This is handled via the Datasets functionality.

Datasets act as a repository where uploaded files can be stored and later accessed in workflows.

To access the datasets page:

  1. Click Datasets in the left sidebar

This opens the datasets page, which displays a table of all available datasets.

DAVE Dataset

Adding a New Dataset

To upload a new dataset:

  1. Click Add Dataset (top-right above the table)

  2. You will be redirected to the upload page

  3. Upload a CSV file (currently only CSV is supported)

  4. Confirm upload

DAVE Add Dataset

Using a Dataset in a Workflow

To use an uploaded dataset:

  1. Add a File Connector operator to the workflow

  2. Open operator settings

  3. Select the dataset

DAVE Select Dataset

A full workflow example is available in [creating-new-workflow].

Creating New Workflow

To create a workflow:

  1. Click Create Workflow in the workspace

  2. A prompt appears in the center of the screen

  3. Enter a workflow name

  4. Click Create

DAVE Create Workflow Promp

After creation:

  • A new tab appears in the header

  • The workspace canvas becomes available

  • Operator categories appear in the sidebar

DAVE Workflow Canvas

Adding Operators

To add operators:

  1. Drag and drop an operator into the canvas

  2. Enter a name when prompted

DAVE Add Operators

Operators are color-coded:

  • Blue → Connectors

  • Green → Transformers

  • Red → Analytics

Configuring Operators

To configure an operator:

  1. Click the gear icon on the operator

  2. A side panel opens

  3. Fill in required parameters

  4. Save changes

DAVE Add Operators Parameters

Connecting Operators

To create a workflow pipeline:

  1. Click the green output node (right side of operator)

  2. Drag connection to a red input node of another operator

DAVE Finish Workflow

Once complete:

  • Click the green Play button

  • Workflow is initialized in Airflow

Saving / Loading Workflow

Saving a Workflow

To save a workflow:

  • Click the blue disk icon at any stage of workflow creation

The workflow is stored and can be reused later.

Loading a Workflow

To load a workflow:

  1. Navigate to the Home page

  2. Click Load Workflow

  3. Select a previously saved workflow from the list

DAVE Load Workflow