# Spline

Spline is an automation tool for tracking data lineage, particularly in connectors where lineage needs to be captured for Spark SQL code. To overcome this challenge, OvalEdge utilizes the Spline connector to build and fetch lineage through APIs.

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXeDOpgEia1TeswBuQPSzLpgNk_Q47zN5yM5Zq9D418MiYo_iq3_x0WK9qP1EIJdDWaSswAQvIm7UVK_hen_BQIM6iS91jSuNuR1bwaYfMaUb-yOqlRnrNGLaviWXMrtVdzR-H0bbZInChSCe_Ekm2cAtvhV?key=aY1XdZSygwwwosVXSuxHEA" alt=""><figcaption></figcaption></figure>

The screenshot above describes data lineage tracking using Spline to pull data from ArangoDB into OvalEdge. Amazon Glue has the number of jobs configured for ArangoDB which will run or be scheduled by giving Spline IP address. Once the job is executed it will push all the jobs into Spline.

| Important: This document focuses on specific information relevant to this particular connector. Details about Establishing Connections, Connector Parameters, and Connector Settings will be found in the "[Generic Features of Connectors](https://docs.google.com/document/d/1p-qODOxHwnfLO-M1lag4TLpO2S6cZvq7oz3f-v7DyZU/edit#heading=h.a068g7zhum9t)" document. |
| ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |

### Connector Characteristics

| Connector Category                                                                                                                                     | ETL              |
| ------------------------------------------------------------------------------------------------------------------------------------------------------ | ---------------- |
| Connectivity                                                                                                                                           | REST API         |
| <p>Connector Version<br>\[OvalEdge Connector Version Information]</p>                                                                                  | 7.0              |
| <p>Spline Versions Supported </p><p>\[Data Source Version from which OvalEdge started providing support]</p>                                           | 0.7.8 onwards    |
| <p>OvalEdge Releases Supported  (Available from)</p><p>\[OvalEdge Release Version in which the connector was included in the OvalEdge Application]</p> | 6.1.0.5  onwards |

### Supported Features

| <p>Crawling of Metadata Objects </p><p><br></p>                                                                                                                                                                                                                                                                                               | Jobs          |   |
| --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------- | - |
| Metadata Source                                                                                                                                                                                                                                                                                                                               | API           |   |
| Data Quality Module                                                                                                                                                                                                                                                                                                                           | Not Supported |   |
| RDAM (Remote Data Access Management) Support                                                                                                                                                                                                                                                                                                  | Not Supported |   |
| <p>Bridge Support</p><p>\[The Bridge component is used as a Tunnel to Transfer Data from the Client-Hosted Cloud or Client-on-Premises Data Center. The handshake between the Bridge Server and Client is established with a Security Tool Kit (these differ from client to client and are generated based on the IP address/DNS, etc.).]</p> | Supported     |   |
| <p>Query Sheet Support </p><p>(Run simple queries)</p>                                                                                                                                                                                                                                                                                        | Not Supported |   |
| Crawl of Usage Statistics (Source System)                                                                                                                                                                                                                                                                                                     | Not Supported |   |
| Certifications at Source (Source System)                                                                                                                                                                                                                                                                                                      | Not Supported |   |

### Prerequisites (Prepare Spline Environment)

1. The following are the prerequisites for connecting the connector and the OvalEdge application.&#x20;

* Any ETL tool that runs on bigdata echo system.
* Spline Server (Consumer URL).

2. Configure Environment Variables (Optional)\
   This section describes the settings or instructions you should know before establishing a connection. If your environments have been configured, skip this step.

For more information, refer to the "[Generic Features of Connectors](https://docs.google.com/document/d/1p-qODOxHwnfLO-M1lag4TLpO2S6cZvq7oz3f-v7DyZU/edit#heading=h.a068g7zhum9t)" document.

### Establish Connection

In the OvalEdge application, the Spline connector allows you to crawl the jobs and build the lineage.

The "[Generic Features of Connectors](https://docs.google.com/document/d/1p-qODOxHwnfLO-M1lag4TLpO2S6cZvq7oz3f-v7DyZU/edit#heading=h.a068g7zhum9t)" document covers general settings and parameters common to most OvalEdge connectors. Here, we'll focus on the specific details required to configure the Spline connector.

#### Spline Specific Parameters

| Field Name             | Description                                                                                                                                                                                                                                                                                         |
| ---------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| License Type\*         | <p>License Type: Choose the appropriate license type from the drop-down list.</p><ul><li>Base</li><li>Auto Lineage</li></ul><p>By default, the License Type is displayed as Auto Lineage.</p>                                                                                                       |
| Connection Name\*      | Enter a connection name for Spline. Users can specify a connection name to identify the Spline connection in OvalEdge. Example: Spline\_connector                                                                                                                                                   |
| Host Name\*            | <p>This is Spline's hostname or IP address.</p><p>http\://\<Host IP >:8080</p><p>Example: <http://18.117.128.179:8080></p>                                                                                                                                                                          |
| Job Name Trim Type\*   | It trims the job name based on the value selected by the user from the drop-down menu.                                                                                                                                                                                                              |
| Api Page Limit         | Setting a limit on the number of records the user can fetch in a single API call.                                                                                                                                                                                                                   |
| Consider All Job Types | <p>Select Yes or No from the drop-down list.</p><p>Yes: If Yes is selected</p><ol><li>Consider the jobs come with an application </li><li>Consider the jobs that store in local system (test purpose)</li></ol><p>No: If No is selected</p><p>       Consider the jobs come with an application</p> |

Important: \* (asterisk) indicates the mandatory field to create a connection.&#x20;

After entering the required parameters, you can save the connection details first or validate the connection and then save it.

### Errors & Resolution

You may encounter the following errors if the correct parameters are not provided while establishing the connection. Below are the most common error messages and their resolutions for your reference.&#x20;

If you continue to experience issues with establishing the connection, please contact your assigned OvalEdge Customer Success Management (CSM) team.

| S.No. | Error Message(s)   | Error Description / Resolution                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       |
| ----- | ------------------ | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| 1     | Connection Timeout | <p>Error Description</p><p>This error occurs when the connector is unable to establish a connection within a specified time frame.</p><p>Resolution</p><p>Ensure network stability, verify server status, review, and correct configuration settings, adjust timeout parameters if possible, and ensure firewalls are not blocking the connection.</p>                                                                                                                                                                                                                                               |
| 2     | 403 Forbidden      | <p>Error Description</p><p>This error typically means that the client does not have permission to access the requested resource.</p><p>Resolution</p><p>To resolve the Spline connector "403 Forbidden" error, ensure proper user permissions, verify authentication credentials, check and allow client IP in server access controls, confirm the correct URL, and review server configuration settings. </p>                                                                                                                                                                                       |
| 3     | Broken Pipeline    | <p>Description</p><p>The "Broken Pipeline" error in the context of the Spline connector typically occurs when the connection between the Spark job and the Spline server is unexpectedly terminated. This could be due to network issues, server crashes, or interruptions in the data flow process, causing the pipeline to break and preventing the successful tracking of data lineage.</p><p>Resolution</p><p>Ensure network stability, verify the Spline server status, increase timeout settings, review configuration settings, allocate sufficient resources, and implement retry logic.</p> |
| 4     | 404 Not Found      | <p>Description</p><p>The "404 Not Found" error indicates that the requested resource could not be found on the Spline server. </p><p>Resolution</p><p>Verify the URL, check resource availability, review server configuration, update any outdated links, and check server logs.</p>                                                                                                                                                                                                                                                                                                                |

### Connector Settings

When the Auto Lineage License type is selected, the Lineage setting option is enabled for the Spline Connector.

The purpose of the lineage setting is to allow you to change the server/source connection to build the lineage. You can configure multiple servers simultaneously in the Select server dialects to use for parsing source codes, which is mandatory. You can also set the Connector priority to specify the connection for table Lineage to pick the source table for lineage building.

### FAQs (Connector-Specific)

Q2: Can I access the Spline connector from a Linux system?

A: Yes! You can use the Spline connector with API from Linux, Unix, and other non-Windows platforms.
