Crawl & Profile

When the connection is successfully validated and saved, click the "Crawl/Profile" button at the top right of the connector page to initiate the Crawl/Profile. The Crawl/Profile options vary from one connector type to another.

Only the Integration Admin can perform this operation.

RDBMS Connector

Schema List

The system displays all available schemas from the connected database. Select the desired schema to initiate the crawl or profile process.

When multiple schemas exist, click the See More button at the bottom right to view the complete list.

Action

The "Action" section contains various action items that can be executed on the selected schema.

Crawl

Crawling is the process of gathering metadata from data sources. The connectors can be scheduled to crawl databases regularly to keep metadata up-to-date.

Profile

Profiling collects statistics and data summaries from crawled sources.

Note: Profiling is only available for databases and files that have already been crawled or cataloged.

Crawl & Profile

The "Crawl & Profile" option allows users to execute both crawl and profile operations in a single click.

Profile Unprofiled

The "Profile Unprofiled" option profiles unprofiled data within the connector. This option saves time by profiling only data that hasn't been profiled earlier.

Schedule

The "Schedule" option allows to automate the crawl and profile processes. There is an option to choose a timeframe ranging from a minute to a year.

Report Connector

Report Group List

The system displays a list of all available report groups associated with the connected server. Select the desired report group to initiate the crawl process.

When multiple report groups are available, click the See More button at the bottom right to view the complete list.

Action

The "Action" section contains various action items that can be executed on the chosen report group.

Crawl

Crawling collects metadata from the source system. Connectors can be scheduled to run crawls regularly to keep the metadata up to date.

Schedule

The "Schedule" option allows to automate the crawl process. There is an option to choose a timeframe ranging from a minute to a year.

File connector

Click the Crawl/Profile button to submit a job. This catalogs the first-level files and folders.

API connector

  • Click on the Crawl/Profile button.

  • Choose the API Groups to crawl from the available options.

  • From the selected group, choose one or more APIs from the list.

  • Click on Crawl to start fetching metadata from the selected APIs.

Schedule

The "Schedule" option allows to automate the crawl process. There is an option to choose a timeframe ranging from a minute to a year.

ETL connector

  • Click on the Crawl/Profile button.

  • Select the Schemas to crawl and profile.

  • Choose the desired Schema from the list.

  • Click on Crawl to begin fetching metadata from the selected schema.

Schedule

The "Schedule" option allows to automate the crawl process. There is an option to choose a timeframe ranging from a minute to a year.


Copyright © 2025, OvalEdge LLC, Peachtree Corners GA USA

Last updated

Was this helpful?