FME

FME, which stands for "Feature Manipulation Engine" is widely used for data integration, transformation, and conversion. It enables users to move data seamlessly between different systems, formats, and applications.

OvalEdge parses the files generated by FME within a designated file path. These files contain metadata related to each data flow. Leveraging this metadata, the lineage is constructed.

Connector Capabilities

The following is the list of objects supported by the FME connector.

Functionality	Supported Objects
Crawling	Workflows Datasets Transformers Feature types

Prerequisite

Need a path where all the fmw files are exported for establishing a connection between the connector and the OvalEdge application.

Establish a Connection

To establish a connection, complete the following steps:

1. Log into the OvalEdge application.

2. Navigate to Administration > Connectors module.

3. Click on the "+” (New Connector) button enabled at the top right of the page.

4. Add Connector pop-up window is displayed where you can search for the FME connector.

5. The Add Connector with connector type-specific details pop-up window is displayed. Enter the relevant information to configure the FME connection.

Note: The asterisk (*) denotes mandatory fields required for establishing a connection.

Field Name	Description
Connector Type	By default, the selected connection type is displayed as the Feature Manipulation Engine. Additionally, you can select the connector type from the drop-down list. Based on the selection, the relevant details are displayed.
Credential Manager*	The purpose of a credential manager is to enhance the security that stores the API keys, passwords, certificates, and other sensitive data securely and helps to manage access, rotates, and audit secrets. OE Credential Manager: The connection is configured with the basic Username and Password of the service account in real time when OvalEdge establishes a connection to the FME database. Users need to add the credentials manually if the OE Credential Manager option is selected. HashiCorp: The credentials are stored in the HashiCorp database server and fetched from HashiCorp to OvalEdge. AWS Secrets Manager: The credentials are stored in the AWS Secrets Manager database server and fetched from the AWS Secrets Manager to OvalEdge. For more information on Azure Key Vault, refer to Azure Key Vault For more information on Credential Manager, refer to Credential Manager
License Add-Ons	All the connectors will have a Base Connector License by default that allows you to crawl and profile to obtain the metadata and statistical information from a data source. OvalEdge supports various License Add-Ons based on the connector’s functionality. Select the Auto Lineage Add-On license that enables the automatic construction of the Lineage of data objects for a connector with the Lineage feature.
Connector Name*	Select a connection name for the FME connector. You can specify a connection name to identify the FME connection in OvalEdge. Example: FME_test
Connector Environment	The environment drop-down list allows you to select the environment configured for the connector from the drop-down list. For example, PROD, or STG (based on the configured items in the OvalEdge configuration for the connector.environment). The purpose of the environment field is to help you identify which connector is connecting what type of system environment (Production, STG, or QA).
FME Source*	It is a server type. Select FME On Premise option from the FME Source drop-down list.
FME files Path*	It needs to give a path where the fme files got exported.
Default Governance Roles
Default Governance Roles*	Users can select a specific user or a team from the governance roles (Steward, Custodian, Owner) that get assigned for managing the data asset. Note: The drop-down list displays all the configurable roles (single user or a team) as per the configurations made in the OvalEdge application: Administration > Security > Governance Roles section.
Admin Roles
Admin Roles*	Select the required admin roles for this connector. To add Integration Admin Roles, search for or select one or more roles from the Integration Admin options, then click the Apply button. The responsibility of the Integration Admin includes configuring crawling and profiling settings for the connector, as well as deleting connectors, schemas, or data objects. To add Security and Governance Admin roles, search for or select one or more roles from the list, then click the Apply button. The security and Governance Admin is responsible for: Configure role permissions for the connector and its associated data objects. Add admins to set permissions for roles on the connector and its associated data objects. Update governance roles. Create custom fields. Develop Service Request templates for the connector. Create Approval workflows for the templates.
No of Archive Objects*	The number of archive objects indicates the number of recent metadata modifications made to a dataset at a remote/source location. By default, the archive objects feature is deactivated. However, users may enable it by clicking the Archive toggle button and specifying the number of objects they wish to archive.
Select Bridge	With the OvalEdge Bridge component, any cloud-hosted server can connect with any on-premise or public cloud data sources without modifying firewall rules. A bridge provides real-time control that makes it easy to manage data movement between any source and destination. When a bridge has been set up, it will be displayed here in a drop-down list. Users can select the required Bridge ID. The user can select "No Bridge" when it is not configured. For more information, refer to Bridge Overview

1. After entering all the connection details, select the appropriate button based on your preferences.

2. Validate: Click on the Validate button to verify the connection details. This ensures that the provided information is accurate and enables successful connection establishment.

3. Save: Click on the Save button to store the connection details. Once saved, the connection will be added to the Connectors home page for easy access.

4. Save & Configure: For certain Connectors that require additional configuration settings, click on the Save & Configure button. This will open the Connection Settings pop-up window, allowing you to configure the necessary settings before saving the connection.

5. Once the connection is validated and saved, it will be displayed on the Connectors home page.

Connection Validation Errors

Error Messages	Description
Invalid file path	Does not have any fme files in the given path.

Note: If you have any issues creating a connection, please contact your assigned OvalEdge Customer Success Management (CSM) team.

Connector Settings

Lineage

For the FME connector, only the Lineage setting option is available, and it is enabled when the Auto Lineage License option is selected.

The purpose of the lineage setting is to serve the option of changing the server/source connection to build the lineage. You can configure multiple servers simultaneously in the Selecting Source Server Type for lineage and also set the connection priority lists to pick the tables in the Connections Priority to pick the source table for lineage building.

Note: For more information, refer to the Connector Settings

Crawling of Schema(s)

You can use the Crawl/Profile option, which allows you to select the specific schemas for the following operations: crawl, profile, crawl & profile, or profile unprofiled. For any scheduled crawlers and profilers, the defined run date and time are displayed to set.

1. Navigate to the connectors page, and click on the Crawl/Profile option.

2. Select the required schema(s).

3. Click on the Run button that gathers all metadata from the connected source into the OvalEdge Data Catalog.

Note: For more information on Scheduling, refer to Scheduling Connector.