Connector Features

Once the connection is established, the connector performs three key tasks:

• Crawling: Fetches metadata from the data source.

• Profiling: Analyzes the data to generate statistics and quality metrics.

• Lineage Building: Maps the data flow and transformations across systems.

Below is an example of crawling and profiling.

Crawling, Profiling, and Lineage building vary depending on the connector type.

Connection, Crawling, Profiling & Lineage Workflow

1. Set Up Connection

   1. Users connect to the source system using supported protocols such as JDBC or REST APIs. The system establishes a connection to the data source.

2. Metadata Crawl

   1. The system fetches metadata from the connected source. It collects information such as tables, columns, reports, and file structures.

   2. Fetched metadata appears in the data catalog.

3. Data Profiling (If Applicable)

   1. The system builds statistics for data objects.

   2. Profiled data appears in the data catalog to support analysis.

4. Build Lineage (If Applicable)

   1. The system builds lineage to show the flow of data across systems.

   2. Lineage helps users trace the origin of data, understand transformations, and analyze downstream impact.

---

Copyright © 2025, OvalEdge LLC, Peachtree Corners GA USA