> For the complete documentation index, see [llms.txt](https://docs.ovaledge.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.ovaledge.com/release8.2/connectors/connector-repositories/file-connectors/microsoft-fabric-onelake.md).

# Microsoft Fabric OneLake

This article outlines the integration with the Microsoft Fabric OneLake connector, enabling streamlined metadata management through features such as crawling, sample profiling, data preview, manual lineage, and Data Quality.

This connector establishes connectivity to Microsoft Fabric OneLake using the OneLake SDK to retrieve metadata from workspaces, Lakehouses, folders, and supported file formats. It authenticates using a Microsoft Entra ID Service Principal (Tenant ID, Client ID, and Client Secret) and connects through the configured OneLake Blob endpoint to access supported Microsoft Fabric resources.

<div align="left"><img src="/files/M7QDkeQe9qKQAG5mQ5z6" alt="" height="293" width="624"></div>

## Overview

### Connector Details

| Connector Category                                                                           | File Connectors      |
| -------------------------------------------------------------------------------------------- | -------------------- |
| OvalEdge Releases Supported                                                                  | Release8.2 and later |
| <p>Connectivity</p><p>\[How the connection is established with Microsoft Fabric OneLake]</p> | OneLake SDK          |

### Connector Features

<table data-search="false"><thead><tr><th>Feature</th><th align="center">Availability</th></tr></thead><tbody><tr><td>Crawling</td><td align="center">✅</td></tr><tr><td>Delta Crawling</td><td align="center">❌</td></tr><tr><td>Profiling*</td><td align="center">❌</td></tr><tr><td>Sample Profiling</td><td align="center">✅</td></tr><tr><td>Query Sheet</td><td align="center">❌</td></tr><tr><td>Data Preview</td><td align="center">✅</td></tr><tr><td>Auto Lineage</td><td align="center">❌</td></tr><tr><td>Manual Lineage</td><td align="center">✅</td></tr><tr><td>Secure Authentication via Credential Manager</td><td align="center">✅</td></tr><tr><td>Data Quality</td><td align="center">✅</td></tr><tr><td>DAM (Data Access Management)</td><td align="center">❌</td></tr><tr><td>Bridge</td><td align="center">✅</td></tr></tbody></table>

{% hint style="info" %}
\*Full profiling is supported through DuckDB. To enable this capability, configure the system setting (**enable.duckdb**) to **True**. When enabled, the File Data tab displays only the first 100 rows from the source file.
{% endhint %}

### Metadata Mapping

The following objects are crawled from Microsoft Fabric OneLake and mapped to the corresponding UI assets.

<table><thead><tr><th width="151">OneLake Object</th><th width="169">OneLake Attribute</th><th width="170">OvalEdge Attribute</th><th width="173">OvalEdge Category</th><th width="148">OvalEdge Type</th></tr></thead><tbody><tr><td>File/ Folder</td><td>Worlspace/Lakehouse/Folder</td><td>Folder</td><td>Folder</td><td>Folder</td></tr><tr><td>File/ Folder</td><td>Worlspace/Lakehouse/Folder/File</td><td>File</td><td>File</td><td>File</td></tr><tr><td>File</td><td>XLSX(sheets)</td><td>File(subfile)</td><td>File(subfile)</td><td>File(subfile)</td></tr><tr><td>File</td><td>XLS(sheets)</td><td>File(subfile)</td><td>File(subfile)</td><td>File(subfile)</td></tr><tr><td>File</td><td>CSV</td><td>File</td><td>File</td><td>File</td></tr><tr><td>File</td><td>TXT</td><td>File</td><td>File</td><td>File</td></tr><tr><td>File</td><td>PARQUET</td><td>File</td><td>File</td><td>File</td></tr><tr><td>File</td><td>ORC</td><td>File</td><td>File</td><td>File</td></tr><tr><td>File</td><td>JSON</td><td>File</td><td>File</td><td>File</td></tr><tr><td>File</td><td>YAML</td><td>File</td><td>File</td><td>File</td></tr><tr><td>File</td><td>PIP</td><td>File</td><td>File</td><td>File</td></tr><tr><td>File</td><td>YML</td><td>File</td><td>File</td><td>File</td></tr><tr><td>File</td><td>AVRO</td><td>File</td><td>File</td><td>File</td></tr><tr><td>File</td><td>SQL</td><td>File</td><td>File</td><td>File</td></tr><tr><td>File</td><td>XML</td><td>File</td><td>File</td><td>File</td></tr></tbody></table>

## Set up a Connection

### Prerequisites

The following are the prerequisites to establish a connection:

Ensure that the CSV files follow the required formatting standards for proper data processing and visibility. Refer to [CSV Format Requirements](https://docs.ovaledge.com/connectors/additional-requirements/csv-format-requirements-for-file-connectors)**.**

#### **Service Account User Permissions**

{% hint style="warning" %}
It is recommended to use a dedicated service account to establish the connection to the data source, configured with the following minimum set of permissions.
{% endhint %}

{% hint style="info" %}
**👨‍💻 Who can provide these permissions?** These permissions are typically granted by the Microsoft Fabric OneLake administrator, as users may not have the required access to assign them independently.
{% endhint %}

<table><thead><tr><th width="194">Operation</th><th width="180">Objects</th><th width="514">Access Permission</th></tr></thead><tbody><tr><td>Connector Validation</td><td>Fabric Workspace</td><td>Member or Contributor workspace role</td></tr><tr><td>Crawling</td><td>Folders</td><td>Read permission with Member or Contributor workspace role</td></tr><tr><td>Crawling</td><td>Files</td><td>Read permission with Member or Contributor workspace role</td></tr><tr><td>View Data</td><td>Files and Folders</td><td>Read permission with Member or Contributor workspace role</td></tr></tbody></table>

{% hint style="warning" %}
Enable **Service principals can use Fabric APIs** in the Microsoft Fabric tenant before configuring the connector.
{% endhint %}

{% hint style="info" %}

* Add the Microsoft Entra ID application to each target Microsoft Fabric workspace with the Member or Contributor role.
* When using Service Principal authentication, assign the required Azure Storage permissions to the Microsoft Entra ID application.
  {% endhint %}

### Connection Configuration Steps

{% hint style="info" %}
Users are required to have the Connector Creator role in order to configure a new connection.
{% endhint %}

1. Log into OvalEdge, go to **Administration > Connectors**, click **+ (New Connector),** search for **Microsoft Fabric OneLake**, and complete the required parameters.

{% hint style="info" %}
Fields marked with an asterisk (\*) are mandatory for establishing a connection.
{% endhint %}

<table><thead><tr><th width="220">Field Name</th><th>Description</th></tr></thead><tbody><tr><td>Connector Type</td><td>By default, "Microsoft Fabric OneLake" is displayed as the selected connector type.</td></tr><tr><td>Credential Manager*</td><td><p>Select the desired credentials manager from the drop-down list. Relevant parameters will be displayed based on your selection.</p><p>Supported Credential Managers:</p><ul><li>OE Credential Manager</li><li>AWS Secrets Manager</li><li>HashiCorp Vault</li><li>Azure Key Vault</li></ul><p>For more details, click <a href="https://docs.ovaledge.com/release8.2/connectors/additional-requirements/credential-manager-configuration">here</a>.</p></td></tr><tr><td>License Add-ons</td><td>Select the checkbox for Data Quality Add-On to identify data quality issues using data anomaly detection.<br>For more details, click <a href="https://docs.ovaledge.com/release8.2/connectors/introduction-to-connectors/setup-and-connectivity/license-types-and-add-ons">here</a>.</td></tr><tr><td>Connector Environment</td><td>Select the environment (Example: PROD, STG) configured for the connector.<br>For more details, click <a href="https://docs.ovaledge.com/release8.2/connectors/introduction-to-connectors/setup-and-connectivity/prerequisites#connector-environment">here</a>.</td></tr><tr><td>Connector Name*</td><td><p>Enter a unique name for the Microsoft Fabric OneLake connection              </p><p>(Example: "Fabric_Onelake").</p></td></tr><tr><td>Connector description</td><td>Enter a brief description of the connector.</td></tr><tr><td>Tenant Id*</td><td>Enter the Microsoft Entra ID Tenant ID (Directory ID) associated with the registered application. This identifier is used to authenticate the connector with Microsoft Entra ID.</td></tr><tr><td>Client Id*</td><td>Enter the Microsoft Entra ID Client ID (Application ID) of the registered application. This identifier uniquely identifies the application used for authentication.</td></tr><tr><td>Client Secret*</td><td>Enter the Client Secret associated with the registered application. This secret is used to authenticate the application and obtain access tokens from Microsoft Entra ID.</td></tr><tr><td>OneLake Blob endpoint*</td><td>Enter the OneLake Blob endpoint URL of the Microsoft Fabric workspace or Lakehouse. This endpoint is used to establish connectivity and access supported files and folders stored in OneLake.</td></tr></tbody></table>

<table data-header-hidden data-search="false"><thead><tr><th width="220.3636474609375"></th><th></th></tr></thead><tbody><tr><td><strong>Default Governance Roles</strong></td><td></td></tr><tr><td>Default Governance Roles*</td><td>Select the appropriate users or teams for each governance role from the drop-down list. All users and teams configured in OvalEdge Security are displayed for selection.</td></tr><tr><td><strong>Admin Roles</strong></td><td></td></tr><tr><td>Admin Roles*</td><td>Select one or more users from the dropdown list for Integration Admin and Security &#x26; Governance Admin. All users configured in OvalEdge Security are available for selection.</td></tr><tr><td><strong>No of Archive Objects</strong></td><td></td></tr><tr><td>No Of Archive Objects*</td><td><p>This shows the number of recent metadata changes to a dataset at the source. By default, it is off. To enable it, toggle the Archive button and specify the number of objects to archive.</p><p>Example: Setting it to 4 retrieves the last four changes, displayed in the 'Version' column of the 'Metadata Changes' module.</p></td></tr><tr><td><strong>Bridge</strong></td><td></td></tr><tr><td>Select Bridge*</td><td><p>If applicable, select the bridge from the drop-down list.</p><p>The drop-down list displays all active bridges configured in OvalEdge. These bridges enable communication between data sources and OvalEdge without altering firewall rules.</p></td></tr></tbody></table>

2. After entering all connection details, the following actions can be performed:
   1. Click **Validate** to verify the connection.
   2. Click **Save** to store the connection for future use.
   3. Click **Save & Configure** to apply additional settings before saving.
3. The saved connection will appear on the Connectors home page.

## Manage Connector Operations

### Crawl/Profile

{% hint style="info" %}
To perform crawl operations, users must be assigned the Integration Admin role.
{% endhint %}

1. Navigate to the **Connectors** page and click **Crawl/Profile.**
2. This action initiates the metadata collection process from the data source and loads the retrieved metadata into the **File Manager > File Explorer.**
3. After a successful crawl, only the first-level folders and files are displayed in the File Manager tab under the specified connection name. To access inner-level folders or files, navigate through the folder hierarchy and perform the required operations.
4. In the File Manager, click the connector name, select the specific **folder(s) or file(s)**, then click **Catalog / Catalog and Profile** from the **Nine Dots** menu. For more details, click [here](https://docs.ovaledge.com/file-manager/file-explorer).
5. The selected files or folders will be added to the **Data Catalog > Files/File Columns** tab.

{% hint style="info" %}
Profiling is supported only at the individual file level. To perform profiling, select the required file in the File Manager and use the Nine Dots menu to run the profiling operation. File columns become available only after the profiling process has been successfully completed.
{% endhint %}

#### Other Operations

The **Connectors** page in OvalEdge provides a centralized view of all configured connectors, including their health status.

**Managing connectors includes:**

* **Connectors Health:** Displays the current status of each connector using a **green** icon for active connections and a **red** icon for inactive connections, helping to monitor the connectivity with data sources.
* **Viewing:** Click the **Eye** icon next to the connector name to view connector details.

**Nine Dots Menu Options:**

To view, edit, validate, configure, or delete connectors, click on the **Nine Dots** menu.

* **Edit Connector:** Update and revalidate the data source.
* **Validate Connector:** Check the connection's integrity.
* **Settings:** Modify connector settings.
  * **Crawler:** Configure data extraction.
  * **Access Instructions:** Add notes on how data can be accessed.
  * **Business Glossary Settings:** Manage term associations at the connector level.
  * **Anomaly Detection Settings**: Configure anomaly detection preferences at the connector level.
* **Delete Connector:** Remove a connector with confirmation.

For more details on connector settings, click [here](https://docs.ovaledge.com/release8.2/connectors/introduction-to-connectors/setup-and-connectivity/connector-settings).

## Connectivity Troubleshooting

If incorrect parameters are entered, error messages may appear. Ensure all inputs are accurate to resolve these issues. If issues persist, contact the assigned support team.

<table><thead><tr><th width="88">S. No.</th><th width="224">Error Message</th><th>Error Description &#x26; Resolution</th></tr></thead><tbody><tr><td>1</td><td>Connection Validation Failed</td><td><p><strong>Error Description</strong>: Connection validation fails due to incorrect credentials, invalid authentication details, inaccessible storage resources, or network connectivity issues.</p><p><strong>Resolution</strong>:</p><ul><li>Verify the connection string or Service Principal credentials.</li><li>Confirm the Storage Account and Fabric workspace are accessible.</li><li>Ensure outbound connectivity to Azure services.</li></ul></td></tr><tr><td>2</td><td>Authentication Failed / Invalid Client Secret</td><td><p><strong>Error Description</strong>: Authentication fails when the Client ID, Client Secret, or Tenant ID is incorrect, expired, or the Service Principal is unavailable.</p><p><strong>Resolution</strong>:</p><ul><li>Verify the Client ID, Client Secret, and Tenant ID.</li><li>Check whether the Client Secret has expired.</li><li>Ensure the Service Principal exists and is enabled.</li></ul></td></tr><tr><td>3</td><td>Authorization Failure (Access Denied)</td><td><p><strong>Error Description</strong>: The configured account does not have sufficient permissions to access Microsoft Fabric or Azure Storage resources.</p><p><strong>Resolution:</strong></p><ul><li>Assign the required Azure Storage roles.</li><li>Verify the Service Principal has access to the target Fabric workspace.</li><li>Confirm resource-level permissions are correctly configured.</li></ul></td></tr><tr><td>4</td><td>Resource Not Found</td><td><p><strong>Error Description</strong>: The specified storage account, container, folder, or file does not exist, or the configured path is incorrect.</p><p><strong>Resolution</strong>:</p><ul><li>Verify the resource exists in Azure Portal.</li><li>Validate the container and folder path.</li><li>Remove any incorrect or extra path separators.</li></ul></td></tr><tr><td>5</td><td>No Containers or Files Found</td><td><p><strong>Error Description</strong>: The storage account contains no accessible containers or the configured location is empty.</p><p><strong>Resolution</strong>:</p><ul><li>Verify that the storage account contains data.</li><li>Confirm permissions to list containers and files.</li><li>Validate the configured container and folder path.</li></ul></td></tr><tr><td>6</td><td>Operation Timed Out</td><td><p><strong>Error Description</strong>: Operations exceed the configured timeout because of large datasets, network latency, or temporary Azure service delays.</p><p><strong>Resolution:</strong></p><ul><li>Retry the operation after some time.</li><li>Limit operations to a specific folder when possible.</li><li>Verify network stability and timeout configuration.</li></ul></td></tr><tr><td>7</td><td>File Download Failed</td><td><p><strong>Error Description</strong>: File download fails because the file is unavailable, access is restricted, or the network connection is interrupted.</p><p><strong>Resolution</strong>:</p><ul><li>Verify the file exists.</li><li>Confirm read permissions for the file.</li><li>Check network connectivity before retrying.</li></ul></td></tr><tr><td>8</td><td>Unsupported or Invalid File Format</td><td><p><strong>Error Description</strong>: Metadata extraction fails because the file format, structure, or encoding is unsupported or invalid.</p><p><strong>Resolution:</strong></p><ul><li>Verify the file format is supported.</li><li>Ensure CSV files contain a header row and valid encoding.</li><li>Open the file to confirm it is not corrupted.</li></ul></td></tr><tr><td>9</td><td>Data Detection Failed</td><td><p><strong>Error Description</strong>: Column names or data types cannot be detected because of inconsistent data or insufficient sample records.</p><p><strong>Resolution</strong>:</p><ul><li>Ensure files contain sufficient sample data.</li><li>Maintain consistent values within each column.</li><li>Use supported date and data formats.</li></ul></td></tr><tr><td>10</td><td>Network or Proxy Error</td><td><p><strong>Error Description</strong>: Connector communication fails because Azure endpoints are unreachable or proxy configuration is incorrect.</p><p><strong>Resolution</strong>:</p><ul><li>Verify proxy configuration, if applicable.</li><li>Allow outbound HTTPS access to Azure endpoints.</li><li>Confirm DNS resolution and firewall settings.</li></ul></td></tr><tr><td>11</td><td>AADSTS Authentication Error</td><td><p><strong>Error Description</strong>: Microsoft Entra ID returns authentication errors because of invalid application configuration, tenant information, credentials, or permissions.</p><p><strong>Resolution</strong>:</p><ul><li>Verify the Client ID, Client Secret, Tenant ID, and endpoint configuration.</li><li>Confirm the Service Principal has the required API permissions and Azure roles.</li><li>Review the AADSTS error code returned by Microsoft Entra ID to identify the specific cause.</li></ul></td></tr></tbody></table>

#### FAQs

<details>

<summary>Why does connection validation fail?</summary>

Connection validation fails when authentication details are invalid, the Storage Account is inaccessible, required permissions are missing, or Azure resources cannot be reached. Verify the configured credentials, Storage Account, and network connectivity.

</details>

<details>

<summary>Why are folders or files not displayed?</summary>

Folders or files may not appear if the configured path is incorrect, the location is empty, or the account does not have permission to access the resources. Verify the path, resource availability, and assigned permissions.

</details>

<details>

<summary>Why are file operations slow?</summary>

Operations may take longer when processing large numbers of files, accessing large datasets, or experiencing network latency. Limiting operations to a specific folder and ensuring a stable network connection can improve performance.

</details>

<details>

<summary>Which Azure roles are required?</summary>

Assign Storage Blob Data Reader for read operations. Assign Storage Blob Data Contributor when write operations are required. Grant the appropriate Microsoft Fabric workspace role (Member or Contributor) to the Microsoft Entra ID application.

</details>

<details>

<summary>Why does Service Principal authentication fail?</summary>

Service Principal authentication fails when the Client ID, Client Secret, or Tenant ID is incorrect, expired, or the Service Principal lacks the required Azure permissions. Verify the authentication details and assigned roles.

</details>

<details>

<summary>How can AADSTS authentication errors be resolved?</summary>

AADSTS errors indicate issues with Microsoft Entra ID authentication, such as invalid credentials, tenant configuration, or missing permissions. Review the returned AADSTS error code and verify the Microsoft Entra ID application configuration.

</details>

***

Copyright © 2026, OvalEdge LLC, Peachtree Corners, GA, USA.


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://docs.ovaledge.com/release8.2/connectors/connector-repositories/file-connectors/microsoft-fabric-onelake.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
