ETLs Interface

  1. Open a browser.

  2. Append /etl to the OvalEdge environment's base URL. Example: https://ovaledgetest.xxx.xxxx/ovaledge/#nav/etl

  3. The ETLs interface will load.

  4. The ETLs Home Page provides a centralized view of all configured ETL pipelines used to prepare and load data into staging tables for reporting and analytics. ETLs serve as the data pipeline layer between OvalEdge and external reporting tools such as Tableau and Power BI, enabling structured, reliable data consumption.

  5. This page helps users review existing ETL pipelines, monitor schedules, track ownership details, and perform operational actions from a single location.

Fields & Description

Field
Description

ETL Name

Displays the name of the ETL pipeline. Use this field to identify and access a specific ETL configuration.

Description

Displays the business purpose or summary of the ETL pipeline.

Staging Tables

Displays the staging tables associated with the ETL pipeline.

Cron Entry

Displays the configured cron expression used for scheduled execution.

Next Execution On

Displays the next scheduled run date and time for the ETL pipeline.

Added By

Displays the user who created the ETL configuration.

Added On

Displays the date and time when the ETL configuration was created.

Last Updated By

Displays the user who last modified the ETL configuration.

Last Updated On

Displays the date and time of the most recent update.

More Actions

Click the 9-Dots Menu to perform the following actions.

Action
Description

Create ETL

Opens the Create ETL pop-up to configure a new ETL pipeline.

Run ETLs

Executes the selected ETL pipeline immediately.

Clone ETL

Creates a copy of an existing ETL configuration for reuse.

Delete ETLs

Removes the selected ETL configuration.

Clear Data from Staging Tables

Removes existing records from staging tables while retaining table structures.

ETL Pipeline Creation

Click Create ETL. The Create ETL pop-up is displayed.

The Create ETL pop-up allows users to configure a new ETL pipeline to create staging tables and load data for reporting and analytics. It provides a guided setup to define connection details, SQL scripts, execution preferences, and scheduling information for automated or on-demand processing.

Users can define the ETL Name and Description, select a Connector, and configure scripts required to create, load, clear, and delete staging data structures.

The pop-up includes built-in validations to ensure mandatory fields are completed and values are correctly formatted before the ETL configuration is saved.

Field
Description

ETL Name

Enter a unique name for the ETL pipeline. This name helps users identify the ETL configuration.

Description

Enter the business purpose or summary of the ETL pipeline.

Connector

Select the connector used to run the ETL process and access the target database.

Staging Tables Creation SQL Scripts

Enter SQL scripts used to create staging tables, schemas, or required database objects.

Data Insertion SQL Scripts

Enter SQL scripts used to extract, transform, and load data into staging tables.

Clear Existing Data SQL Scripts

Enter SQL scripts used to remove existing records from staging tables while retaining structures.

Staging Tables Deletion SQL Scripts

Enter SQL scripts used to drop staging tables or related database objects when no longer required.

Clear Data Before Running

Enable this option to clear existing staging data before the ETL load process starts.

Schedule

Enter a cron expression to configure automated ETL execution.

Time Zone

Displays the local time zone used for schedule execution.

Click the Save/Submit button to validate the entered details and create the ETL configuration.

Click the Cancel button to close the pop-up without saving changes.

Running the ETL Pipeline

circle-info

Always verify database connectivity and system settings before running ETL scripts. Clear scripts can be used before reprocessing data to prevent duplication.

First Run:

  1. After saving, select the newly created ETL job.

  2. Click on the 9-Dot menu and select Run ETL(s)

  3. The Creation Scripts run first to create staging tables.

  4. Data loads using the ETL Script.

Subsequent Runs:

  1. Creation Scripts are disabled (tables already exist).

  2. Only the ETL Script runs to refresh data.


Copyright © 2026, OvalEdge LLC, Peachtree Corners, GA, USA.

Last updated

Was this helpful?