For the complete documentation index, see llms.txt. This page is also available as Markdown.

Azure Synapse Analytics

This article outlines the integration with the Azure Synapse Analytics connector, enabling streamlined metadata management through features such as crawling, profiling, data preview, data quality, data access, and lineage building (Auto and Manual). It also ensures secure authentication via Credential Manager.

The connector establishes connectivity to Azure Synapse Analytics through JDBC. It supports SQL Server Authentication, Windows Authentication, and Azure Active Directory – Password, with the selected authentication method providing access to the target database and required metadata objects.

Overview

Connector Details

Connector Category

Data Warehouse

OvalEdge Release Supported

Release6.3.4 and later

Connectivity

[How the connection is established with Azure Synapse Analytics]

JDBC

Verified Azure Synapse Analytics Version

Above Azure SQL Server 2010

Driver details

Driver
Supported Version

JDBC Driver

13.2.1.jre11.

Connector Features

Feature
Availability

Crawling

✅

Profiling

✅

Query Sheet

✅

Data Preview

✅

Auto Lineage

✅

Manual Lineage

✅

Secure Authentication via Credential Manager

✅

Data Quality

✅

DAM (Data Access Management)

✅

Bridge

✅

Metadata Mapping

The following objects are crawled from Azure Synapse Analytics and mapped to the corresponding UI assets.

Azure Synapse Analytics Object
Azure Synapse Analytics Attribute
OvalEdge Attribute
OvalEdge Category
OvalEdge Type

Schema

Schema Name

Schema

Databases

Schema

Schema

Schema Comments

Source Description

Databases

Schema

Table

Table Name

Table

Tables

Table

Table

Table Type

Table

Tables

Table

Table

Table Comments

Source Description

Descriptions

Source Description

Columns

Column Name

Column

Table Columns

Columns

Columns

Data Type

Column Type

Table Columns

Columns

Columns

Description

Source Description

Table Columns

Columns

Columns

Ordinal Position

Column Position

Table Columns

Columns

Columns

Length

Data Type Size

Table Columns

Columns

Views

View Name

View

Tables

View

Views

Text

View Query

Views

View

Procedures

Routine_Name

Name

Procedures

Procedures

Procedures

Description

Source Description

Descriptions

Procedures

Procedures

Routine_Definition

Procedure

Procedures

Procedures

Functions

Routine_Name

Name

Functions

Functions

Functions

Routine_Definition

Function

Functions

Functions

Functions

Description

Source Description

Descriptions

Functions

Triggers

Trigger Name

Name

Triggers

Triggers

Triggers

Trigger Definition

Trigger Data

Triggers

Triggers

Triggers

Trigger Type

Type

Triggers

Triggers

Set up a Connection

Prerequisites

The following are the prerequisites to establish a connection:

External Supporting Files

File Name
Description

jtds - 1.3.1

Use this file when connecting to Azure Synapse Analytics databases using the jtds-1.3.1 JDBC driver. Place the file in the Third Party Jars folder.

Ntlmauth.dll

Use this file when OvalEdge is installed in a Linux / Unix Environment. Place the file inside the bin folder.

Sqljdbc_auth.dll

Use this File when OvalEdge is installed in a Windows Environment. Place the file inside the bin folder.

The required external JAR files are included as part of the OvalEdge installation artifacts. For driver installation and configuration details, refer to the Connector Drivers Setup Guide. Please contact the OvalEdge Team for assistance related to the driver files and configuration setup.

Whitelisting Ports

Ensure that the inbound port “1433” is whitelisted to enable successful connectivity with the Azure Synapse Analytics database.

Authentication Type

The prerequisites vary depending on the authentication method selected for the SQL Server connection. To ensure a smooth and successful configuration, the required setup steps and supporting components are listed separately for each authentication type.

  1. SQL Server Authentication

    1. A SQL Server login must exist and be active.

    2. The account must have access to the target database and required metadata objects.

    3. Ensure the SQL Server instance is configured to allow SQL Server Authentication.

  2. Windows Authentication

    1. Windows Authentication requires additional native libraries depending on the OvalEdge release and JVM architecture.

    2. For detailed file versions and download links, click here.

  3. Azure Active Directory – Password

    1. Azure AD user credentials must be active and permitted for SQL access.

    2. Azure AD authentication must be enabled at the SQL endpoint.

    3. The account must have appropriate permissions in the target database.

Service Account User Permissions

👨‍💻 Who can provide these permissions? These permissions are typically granted by the Azure Synapse Analytics administrator, as users may not have the required access to assign them independently.

Objects
Sys Tables
Access Permissions

Schema

sys.schemas

Select

Tables

INFORMATION_SCHEMA.TABLES

Select

Tables

extended_properties

Select

Table Columns

sys.all_columns

Select

Table Columns

sys.types

Select

Table Columns

sys.views

Select

Table Columns

INFORMATION_SCHEMA.COLUMNS

Select

Table Columns

INFORMATION_SCHEMA.KEY_COLUMN_USAGE

Select

Table Columns

INFORMATION_SCHEMA.TABLE_CONSTRAINTS

Select

Views

information_schema.VIEWS

View Definition

Views

sys.objects

View Definition

Functions,Stored Procedures Source code

information_schema.ROUTINES

View Definition

Functions,Stored Procedures Source code

sys.sql_modules

View Definition

Functions,Stored Procedures Source code

sys.extended_properties

View Definition

Triggers

sys.objects

Select

Triggers

sql_modules

Select

Synonyms

sys.synonyms

Select

Relationships

sys.foreign_keys

Select

Connection Configuration Steps

  1. Log in to OvalEdge, go to Administration > Connectors, click + (New Connector), search for Azure Synapse Analytics, and complete the required parameters.

    Fields marked with an asterisk (*) are mandatory for establishing a connection.

Field Name
Description

Connector Type

By default, "Azure Synapse Analytics" is displayed as the selected connector type.

Authentication

OvalEdge supports the following three types of authentication for Azure Synapse Analytics:

  • SQL Server Authentication

  • Windows Authentication

  • Azure Active Directory - Password

Field Name
Description

Credential Manager*

Select the desired credentials manager from the drop-down list. Relevant parameters will be displayed based on your selection.

Supported Credential Managers:

  • Database

  • HashiCorp

  • AWS Secrets Manager

  • Azure Key Vault

For more details, click here.

License Add Ons

  • Select the checkbox for Auto Lineage Add-On to build data lineage automatically.

  • Select the checkbox for Data Quality Add-On to identify data quality issues using data quality rules and anomaly detection.

  • Select the checkbox for Data Access Add-On to enable the data access functionality.

For more details, click here.

Connector Name*

Enter a unique name for the Azure Synapse Analytics connection

(Example: "Azure Synapse Analytics_Prod").

Connector Environment

Select the environment (Example: PROD, STG) configured for the connector. For more details, click here.

Connector Description

Enter a brief description of the connector.

Server*

Enter the Azure Synapse Analytics database server name or IP address (Example: http://testsynapse.sql.azuresynapse.net).

Port*

By default, the port number for the Azure Synapse Analytics, "1433" is auto-populated. If required, the port number can be modified according to the custom port number configured for your Azure Synapse Analytics.

Database*

Enter the database name to which the service account user has access within the Azure Synapse Analytics.

Driver*

By default, the SQL Server driver details are auto-populated.

Username*

Enter the service account username set up to access the Azure Synapse Analytics database (Example: "oesauser").

Password*

Enter the password associated with the service account user.

Connection String

Configure the connection string for the Azure Synapse Analytics database:

  • Automatic Mode: The system generates a connection string based on the provided credentials.

  • Manual Mode: Enter a valid connection string manually.

Replace placeholders with actual database details.

{sid} refers to Database Name.

Plugin Server

Enter the server’s name when running as a plugin server.

Plugin Port

Enter the port number on which the plugin is running.

Field Name
Description

OvalEdge Installed Environment

Select the environment in which OvalEdge has been installed.

  • Windows

  • Linux/Unix

Credential Manager*

Select the desired credentials manager from the drop-down list. Relevant parameters will be displayed based on your selection.

Supported Credential Managers:

  • Database

  • HashiCorp

  • AWS Secrets Manager

  • Azure Key Vault

For more details, click here.

License Add Ons

  • Select the checkbox for Auto Lineage Add-On to build data lineage automatically.

  • Select the checkbox for Data Quality Add-On to identify data quality issues using data quality rules and anomaly detection.

  • Select the checkbox for Data Access Add-On to enable the data access functionality.

For more details, click here.

Connector Name*

Enter a unique name for the Azure Synapse Analytics connection

(Example: "Azure Synapse Analytics_Prod").

Connector Environment

Select the environment (Example: PROD, STG) configured for the connector. For more details, click here.

Connector Description

Enter a brief description of the connector.

Server*

Enter the Azure Synapse Analytics database server name or IP address (Example: http://testsynapse.sql.azuresynapse.net).

Port*

By default, the port number for the Azure Synapse Analytics, "1433" is auto-populated. If required, the port number can be modified according to the custom port number configured for your Azure Synapse Analytics.

Database*

Enter the database name to which the service account user has access within the Azure Synapse Analytics.

Domain

Enter the qualified Azure Synapse Analytics domain name. Note: This field appears when the authentication type is set to Windows authentication and the OvalEdge installed Environment is selected as Linux/Unix.

Driver*

By default, the SQL Server driver details are auto-populated.

Username*

Enter the service account username set up to access the Azure Synapse Analytics database (Example: "oesauser").

Note: This field appears when Windows Authentication is selected as the authentication type and the installation environment is set to Linux/Unix.

Password*

Enter the password associated with the service account user.

Note: This field appears when Windows Authentication is selected as the authentication type and the installation environment is set to Linux/Unix.

Connection String

Configure the connection string for the Azure Synapse Analytics database:

  • Automatic Mode: The system generates a connection string based on the provided credentials.

  • Manual Mode: Enter a valid connection string manually.

Replace placeholders with actual database details.

{sid} refers to Database Name.

Plugin Server

Enter the server’s name when running as a plugin server.

Plugin Port

Enter the port number on which the plugin is running.

Field Name
Description

Credential Manager*

Select the desired credentials manager from the drop-down list. Relevant parameters will be displayed based on your selection.

Supported Credential Managers:

  • Database

  • HashiCorp

  • AWS Secrets Manager

  • Azure Key Vault

For more details, click here.

License Add Ons

  • Select the checkbox for Auto Lineage Add-On to build data lineage automatically.

  • Select the checkbox for Data Quality Add-On to identify data quality issues using data quality rules and anomaly detection.

  • Select the checkbox for Data Access Add-On to enable the data access functionality.

For more details, click here.

Connector Name*

Enter a unique name for the Azure Synapse Analytics connection

(Example: "Azure Synapse Analytics_Prod").

Connector Environment

Select the environment (Example: PROD, STG) configured for the connector. For more details, click here.

Connector Description

Enter a brief description of the connector.

Server*

Enter the Azure Synapse Analytics database server name or IP address (Example: http://testsynapse.sql.azuresynapse.net).

Port*

By default, the port number for the Azure Synapse Analytics, "1433" is auto-populated. If required, the port number can be modified according to the custom port number configured for your Azure Synapse Analytics.

Database*

Enter the database name to which the service account user has access within the Azure Synapse Analytics.

Driver*

By default, the SQL Server driver details are auto-populated.

Username*

Enter the service account username set up to access the Azure Synapse Analytics database (Example: "oesauser").

Password*

Enter the password associated with the service account user.

Connection String

Configure the connection string for the Azure Synapse Analytics database:

  • Automatic Mode: The system generates a connection string based on the provided credentials.

  • Manual Mode: Enter a valid connection string manually.

Replace placeholders with actual database details.

{sid} refers to Database Name.

Plugin Server

Enter the server’s name when running as a plugin server.

Plugin Port

Enter the port number on which the plugin is running.

Default Governance Roles

Default Governance Roles*

Select the appropriate users or teams for each governance role from the drop-down list. All users and teams configured in OvalEdge Security are displayed for selection.

Admin Roles

Admin Roles*

Select one or more users from the dropdown list for Integration Admin and Security & Governance Admin. All users configured in OvalEdge Security are available for selection.

No of Archive Objects

No of Archive Objects*

This shows the number of recent metadata changes to a dataset at the source. By default, it is off. To enable it, toggle the Archive button and specify the number of objects to archive.

Example: Setting it to 4 retrieves the last four changes, displayed in the 'Version' column of the 'Metadata Changes' module.

Bridge

Select Bridge*

If applicable, select the bridge from the drop-down list.

The drop-down list displays all active bridges configured in OvalEdge. These bridges enable communication between data sources and OvalEdge without altering firewall rules.

  1. After entering all connection details, the following actions can be performed:

    1. Click Validate to verify the connection.

    2. Click Save to store the connection for future use.

    3. Click Save & Configure to apply additional settings before saving.

  2. The saved connection will appear on the Connectors home page.

Manage Connector Operations

Crawl/Profile

The Crawl/Profile button allows users to select one or more schemas for crawling and profiling.

  1. Navigate to the Connectors page and click Crawl/Profile.

  2. Select the schemas to crawl.

  3. The Crawl option is selected by default. Click the Crawl & Profile radio button if you want both operations.

  4. Click Run to collect metadata from the connected source and load it into the Data Catalog.

  5. After a successful crawl, the information appears in the Data Catalog > Databases tab.

The Schedule checkbox allows automated crawling and profiling at defined intervals, from a minute to a year.

  1. Click the Schedule checkbox to enable the Select Period drop-down.

  2. Select a time period for the operation from the drop-down menu.

  3. Click Schedule to initiate metadata collection from the connected source.

  4. The system will automatically execute the selected operation (Crawl or Crawl & Profile) at the scheduled time.

Other Operations

The Connectors page provides a centralized view of all configured connectors, along with their health status.

Managing connectors includes:

  • Connector Health: Displays the current status of each connector, with a green icon for active connections and a red icon for inactive connections, helping monitor connectivity to data sources.

  • Viewing: Click the Eye icon next to the connector name to view connector details.

Nine Dots Menu Options:

To view, edit, validate, build lineage, configure, or delete connectors, click on the Nine Dots menu.

  • Edit Connector: Update and revalidate the data source.

  • Validate Connector: Check the connection's integrity.

  • Settings: Modify connector settings.

    • Crawler: Configure data extraction.

    • Profiler: Customize data profiling rules and methods.

    • Query Policies: Define query execution rules based on roles.

    • Access Instructions: Add notes on how data can be accessed.

    • Business Glossary Settings: Manage term associations at the connector level.

    • Anomaly Detection Settings: Configure anomaly detection preferences at the connector level.

    • Connection Pooling: Configure database connection pool parameters to optimize database connectivity and resource utilization. For more details, click here.

    • Lineage: Configure Server Dialects for source code parsing and Connector Priority for table lineage connection. For more details, click here.

    • Others: Configure notification recipients for metadata changes.

  • Build Lineage: Automatically build data lineage using source code parsing.

  • Delete Connector: Remove a connector with confirmation.

For more details on connector settings, click here.

Troubleshooting

If incorrect parameters are entered, error messages may appear. Ensure all inputs are accurate to resolve these issues. If issues persist, contact the assigned support team.

S. No
Error Message
Error Description & Resolution

1

Error while validating connection: client connection ID error

This error typically indicates the username or password entered for the connection is incorrect.

Resolution:

  • Confirm the username and password entered match the credentials for the target instance.

  • Confirm the correct authentication type, SQL server authentication, Windows authentication, or Azure active directory, has been selected for these credentials.

  • Retry validation once the credentials are corrected.

2

Error while validating connection: port not reachable or connection refused

The port configured for the connection has not been whitelisted, preventing the application from reaching the target instance.

Resolution:

  • Confirm the default port, or any custom port in use, has been whitelisted for communication.

  • Confirm the correct port number has been entered in the connection details.

  • Retry validation once the required port has been opened.

3

Error while validating connection: no suitable driver found

The required driver file has not been placed in the correct location for the authentication type and operating system in use.

Resolution:

  • Confirm the required JAR file has been placed in the third-party JARs folder when connecting from a Linux environment.

  • Confirm the required DLL files have been placed in the bin folder when using Windows authentication from a Windows environment.

  • Retry validation once the correct driver files are placed in the expected location.

4

Error while validating connection: SSL connection required

The target instance requires a secure connection, and the necessary certificate has not been imported for validation to succeed.

Resolution:

  • Confirm whether the target instance requires SSL connection.

  • Import the required certificate into the Java environment being used.

  • Retry validation once the certificate has been imported successfully.

5

Error while validating connection: insufficient permissions on schema

This generic error appears when the credentials provided do not have adequate access to the required system and user schemas.

Resolution:

  • Confirm that SELECT permission has been granted on the required system schemas and tables used for crawling, profiling, and validation.

  • Confirm the credentials have access to the specific schemas intended to be catalogued.

  • Retry validation once the required permissions have been granted.

6

Exception occured while getting the remote databases in SQL Server Connection : ...

An exception occurred when the connector attempted to retrieve the list of remote databases from the SQL Server endpoint. This error can occur when the connection has connectivity, authentication, or metadata access issues. Resolution:

  • Confirm the SQL Server endpoint is reachable from the connector environment.

  • Confirm the credentials have the required permissions to retrieve database metadata.

  • Confirm the connection details are correct and retry the operation once the required access is available.

S. No
Error Message
Error Description & Resolution

1

Crawl or profile job completes with partial success

A specific table or query involved in the job is encountering an issue, commonly linked to very large record volumes or a query that is taking longer than expected.

Resolution:

  • Identify the specific table or schema where the partial failure occurred from the job details.

  • Review whether that table holds a very large volume of records or lacks proper indexing, which can cause longer processing times.

  • Increase the query timeout setting if the delay is due to genuinely long-running queries rather than a structural issue.

2

Query is timing out during crawling, profiling, or query sheet use

The configured query timeout, which defaults to 180 seconds, is being exceeded, often due to large data volumes or missing indexes on the queried tables.

Resolution:

  • Increase the query timeout setting in the connection policy settings if queries are expected to take longer than the default.

  • Review whether the table involved has proper indexing in place, since missing indexes can significantly increase query time.

  • Keep the timeout within a reasonable range, since crawling and profiling are generally expected to complete within five to six minutes under normal conditions.

3

Downloaded query results do not reflect the expected data

Downloaded results are generated from the previously executed query result set rather than being fetched directly from the database at the time of download.

Resolution:

  • Confirm the query was executed successfully and its result set is current before downloading.

  • Re-run the query if the underlying data has changed since the last execution.

  • Download the result again once the query has been refreshed.

FAQs

S. No
Question
Answer

1

Does this connector support delta crawling?

No. Delta crawling is not currently supported for the Azure Synapse connector.

Each crawl processes the full set of selected objects instead of identifying only the objects that have changed since the previous crawl.

2

Are all column data types supported by this connector?

No. Binary and geography data types are not currently supported.

Tables containing these data types may not be fully represented for the affected columns.

3

Is data access management and data masking supported for this connector?

Yes. The Azure Synapse connector supports:

  • Data access management

  • Data masking

  • Bridge-based connectivity

  • Credential manager integration

  • Standard data quality features

4

What is Azure Synapse, and how is it different from a standard SQL server connector?

Azure Synapse is a cloud based data warehouse platform used for enterprise data warehousing, data integration, and large scale analytics.

The main difference is the underlying architecture:

  • Azure Synapse uses a massively parallel processing design. Queries are distributed across multiple nodes and processed in parallel.

  • A standard SQL server uses a single processing engine.

This parallel processing allows Azure Synapse to process very large volumes of data faster than a traditional SQL server.

5

Why is Azure Synapse treated as an RDBMS type connector even though it is a data warehouse?

Although Azure Synapse is a data warehouse, its data is stored in a relational structure with schemas, tables, columns, and relationships.

Therefore, it is catalogued and represented as an RDBMS type connector.

6

How many processing nodes can Azure Synapse use for a single query?

Azure Synapse can distribute a query across up to 60 nodes.

The number of nodes used depends on the environment configuration and workload.

S. No
Question
Answer

1

What authentication types are supported for connecting to Azure Synapse?

The following authentication types are supported:

  • SQL server authentication: The required driver is already bundled with the application. No external file placement is required.

  • Windows authentication: Additional files are required depending on the operating system:

  • Windows: DLL files are required.

  • Linux: A driver jar file must be placed in the third party jars folder.

  • Azure active directory authentication: Uses the standard SQL server driver on the back end and the same username and password fields for authentication.

2

Are credential vault or secret manager integrations supported for this connector?

Yes. Standard vault parameter options are supported, including integrations such as a general secret manager and other supported vault providers.

3

What details are needed besides the authentication credentials?

The following connection details are required:

  • Server IP address

  • Port

  • Database name

  • Selected authentication credentials

A default port is used unless a different port is configured in the target environment. If a different port is used, that port must be allow-listed for the connection.

S. No
Question
Answer

1

What kind of metadata does this connector crawl?

The connector crawls the following metadata:

  • Schemas

  • Tables

  • Table columns

  • Views

  • Relationships

  • Indexes

  • Synonyms

  • Functions

  • Triggers

  • Source code

  • Stored procedures

Functions, triggers, source code, and stored procedures also support automatic lineage building and are available in their respective tabs in the data catalog.

2

What profiling details are available once a table has been profiled?

Profiling provides column-level statistics, including:

  • Data type

  • Column size

  • Minimum and maximum values

  • Null count

  • Null percentage

  • Distinct count

  • Top values

  • Sample data, where accessible

3

Which crawler options can be adjusted for this connector?

The crawler settings allow the following object types to be included or excluded:

  • Tables

  • Views

  • Columns

  • Procedures

  • Functions

  • Source code

  • Indexes

  • Synonyms

For example, if only tables are required, the other options can be unchecked before running the crawl.

4

What does the query timeout setting control, and what is its default value?

The query timeout setting controls how long a query can run during crawling, profiling, or query sheet use before it is stopped.

  • Default value: 180 seconds

  • The timeout can be increased for environments where queries take longer to complete.

Under typical conditions, crawling and profiling are expected to complete within five to six minutes, although some cases may take closer to ten minutes, depending on data volume and indexing.

S. No
Question
Answer

1

How is lineage built for Azure Synapse objects?

Lineage is built from the source code associated with database objects such as:

  • Views

  • Functions

  • Stored procedures

The source code is reviewed in the build screen. After the lineage job is run against the selected code, both tabular and graphical lineage views are available, including column level details showing how data flows between objects.

2

Is manual lineage creation supported in addition to automatic lineage?

Yes. Manual lineage creation is supported alongside automatic lineage building.

It allows lineage relationships to be manually established when automatic lineage detection does not cover a specific scenario.


Copyright © 2026, OvalEdge LLC, Peachtree Corners, GA, USA.

Last updated

Was this helpful?