Connectors
New & Improved
Connectors Improvements
Connector Description
An optional description field is now available on the connector creation page to provide context for connector names. This update improves clarity in the Data Catalog and simplifies connector identification and management.
License Count Logic
The license count logic has been updated for all connectors to improve accuracy. Instead of relying only on IP addresses, the system now uses a unique identifier specific to each connector. This change ensures more reliable license tracking across all connector types.
Connector Health Check and Crawling Job
The system now stops all scheduled crawling jobs immediately when a connector health check fails. If a job is already in progress at the time of failure, a warning message appears to notify the user. This update enables conditional job control based on real-time connection status, prevents unnecessary job execution, and reduces system load during connection failures.
Proxy Configuration for REST API Connectors
Centralized proxy management is now available for all REST API-based connectors with the following updates:
Adds “Use Proxy” option in the connector create and edit screens
Routes traffic through global proxy settings when set to Yes
Applies proxy to all HTTP calls if enabled
Skips proxy usage when set to No
API Connector Info Display Enabled
The connector page now displays complete connector information for API connections. The details appear correctly on the connector page and are also visible in the data lineage view, ensuring accurate visibility of API connector metadata across the platform.
Column-Level Profiling for RDBMS Connectors
Column-level profiling is now enabled for all RDBMS connectors. When a table is selected with specific columns excluded, the profiling job includes only the allowed columns as per the configuration.
Error Message Handling for RDBMS Connectors
Scheduled crawl and profile jobs now display accurate error messages when the connector health status is red. Replaced the incorrect message "User account is temporarily locked" with "The connector health status is in red. Unable to crawl/profile the metadata." This update ensures clear job logs and avoids confusion during error analysis.
Dynamic JAR load for CSP, Lineage, and Advanced Job
Implemented support to load CSP, Lineage, and Advanced Job JAR files without full application redeploy. Removed the need for restarts during minor code or configuration changes, reducing downtime and speeding up the deployment of updates and fixes.
Looker Report Access via 9-dot Menu
An option is now available to open Looker reports directly from the 9-dot menu. Replaced the preview with a clickable link, similar to Power BI reports, to allow quick access from the report listing interface.
Custom Server Support in the DBT Cloud Connector
A new field has been added to the DBT Cloud connector to define a custom server address. This allows the use of organization-specific servers instead of the default, enabling compatibility with dedicated DBT Cloud environments.
Dataset Crawling Enabled in DBT Connector
The DBT connector now supports crawling datasets. This update enables the connector to extract and catalog dataset metadata, expanding its integration capabilities.
Catalog and Profile Task Schedule for File Connectors
Catalog and profile tasks for file connectors, including NFS file sources, can now be scheduled from both the Job Workflow and crawler levels. Schedules can be set with top-level folders and buckets, enabling automation of file and file column metadata processing. This update aligns file connector capabilities with RDBMS connectors and enables complete task automation.
Role-Based Authentication for AWS Connectors
Role-Based Authentication is now the default method for all AWS connector configurations. New AWS connectors automatically use this method during setup to ensure consistent access control across environments. This update sets Role-Based Authentication as the default authentication method for all newly created AWS connectors.
Governance Role for Credential Manager Connectors
Governance role assignment is now supported for Credential Manager connectors. Roles such as Owner, Steward, Custodian, and custom-defined roles can be assigned to connectors, including Azure Key Vault, AWS Secrets Manager, HashiCorp Vault, Azure DevOps, and others. When a connector's health status changes to Red, the system automatically notifies the assigned Steward.
Path-Based File Access in SharePoint Connector
The SharePoint connector now supports reading files from a user-defined path instead of the default root directory. This update provides more control over file access and selection.
Crawling for SharePoint On-Prem Authentication
Crawling is now supported for SharePoint connectors configured with On-Prem Basic and On-Prem Kerberos authentication methods. The system allows metadata crawling for connections using either of these authentication types.
SharePoint Connector Supports Crawling SharePoint Lists
The SharePoint connector can now crawl SharePoint Lists. This enhancement allows metadata extraction from list-based content, expanding coverage beyond document libraries.
SharePoint Connector - 9 Dot Menu
New options are now available under the 9 Dots menu in the SharePoint connector. These options provide easier access to cataloging and file management actions directly from the connector screen. The following actions are now supported:
File Manager:
Catalog all files/folders
Upload file/folder
Data Catalog:
Catalog all the subfolders
Catalog all the files
Profile folder
Salesforce Commerce Cloud (BETA) - Connector Page
The Salesforce Commerce Cloud (BETA) connector is now available on the connector page for configuration. This update ensures the connector appears as expected and can be used to establish and manage connections with SFCC environments.
Advanced Job Added for Delta Lake Unity Catalog
A new advanced job, 'Advance Job for updating Deltalake customFields', is now available in the Delta Lake Unity Catalog connector. This job fetches business and technical descriptions and updates them in the Data Catalog.
Service Principal Authentication Delta Lake Connector
The Delta Lake connector now supports Service Principal authentication. This enables secure and scalable access by using credentials managed through Azure Active Directory.
Azure Active Directory – Azure Synapse
The Azure Synapse connector now supports Azure Active Directory - Password authentication. This method allows a secure connection using Azure AD credentials for authentication.
Additional Crawl Option Removed - Oracle Connector
The Additional Crawl option has been removed from the Oracle connector settings. The regular crawl process now manages the entire crawling functionality, eliminating the need for a separate crawl configuration.
Account ID Field Removed - S3 Connection Setup
The Account ID field is no longer required during the setup or update of S3 connections. The system now retrieves this value automatically based on the authentication method:
For IAM User Authentication, the Account ID is fetched using the Access Key and Secret Key.
For Role-based Authentication, the Account ID is derived from the Cross-Account Role ARN.
Bridge Improvements
Bridge Client System Statistics
Bridge client now records CPU usage, memory consumption, and other system-level statistics. Users can monitor performance, detect resource issues, and check the current status of the Bridge client.
Bridge Health and Connector Synchronization
The bridge now supports the following enhancements for managing connector health:
Displays the last crawled date for each connector
Maintains bridge health status history
Aligns the dependent connector status with the bridge status
Verifies bridge availability before initiating crawling
Stops crawling and logs details if the bridge is unavailable
Synchronizes downstream actions during bridge downtime
Customization via System Settings
issaas.client
Configure to specify if the client is SAAS or not.
Parameters:
The default value is False.
If set to True, the Credential Manager drop-down displays "OE Credential Manager" on the connection creation page.
If set to False, the Credential Manager drop-down displays "Database" on the connection creation page.
Advanced Jobs
Copy Metadata Between Connectors/Schemas
This job enables Admin users to copy metadata of tables and table columns from a source connector to a specified target connector. Users can select specific metadata types and filter by connection and schema to ensure only relevant metadata is copied.
Attributes:
Attribute 1: Source Connector Name (Required) - Enter the source connector name to initiate the job. Note that only one connection can be selected per job.
Attribute 2: Source Schema Name - Enter the Source Schema of the respective given source connector.
Attribute 3: Object Type and Attributes (Required) - Enter the object type and meta attributes (Object type - e.g., oetable, oecolumn).
{"objectType": "oetable","tag":true,"term":true,"title":true,"businessDescription":true,"technicalDescription":true,"certification":true,"governanceRoles":true,"customFields":true,"objectAccess":true,"objectSecurity":true}
Attribute 4: Target Connector Name (Required) - Enter the name of the target connector. Please note that only one connection can be selected per job.
Attribute 5: Target Schema Name - Enter the source schema associated with the selected target connector.
Sync Descriptions to Snow Flake
This job updates the business, technical description, and source descriptions to Snowflake.
CRAWL_PARTITION_TABLES
This job helps crawl the partition tables from the source system.
PROFILE_PARTITION_TABLES
This job helps in profiling the partition tables of the given connector and schemas.
Azure SQL Database Masking Sync
Run this job to fetch details of all the corresponding masked Azure SQL Database columns from the source into OvalEdge.
Attributes: 1. Connection Id
Note: Only Security and Governance admins of the corresponding connection (Defined while creating a connection) and OvalEdge’s super admin (ovaledge.role.admin) can run this job.
IPC Parameter file processing
This job copies the parameter file from a remote machine to a local machine and processes the file for configuration details.
License Issue
This advanced job, related to migration, aims to add additional attributes to certain existing connectors, fetch unique values for the connectors, and update the license accordingly.
Advance Job for updating Deltalake customFields
This advanced job will update technical and business descriptions for tables in Delta Lake.
Reporting Connector Analysis Report
This job generates a comprehensive analysis of the report connector build lineage.
Attributes:
Connection ID: This is the identifier for the connection you are analyzing.
Report ID: This is the identifier for the specific report you want to analyze.
File Path: This is the location where the report file is stored.
Tableau columns curated info moving from report to Datasource
This job transfers curated information from the report column to the data source column.
Report Crawl Analysis
This job facilitates the analysis of activated and inactivated objects during the second crawl of the Power BI server. Upon running the job, a report is generated that provides details about the updated, activated, and inactivated objects of the Power BI server in OvalEdge, enabling users to track and manage object status effectively.
Copyright © 2025, OvalEdge LLC, Peachtree Corners, GA, USA.
Last updated
Was this helpful?