# PostgreSQL

This article outlines the integration with the PostgreSQL connector, enabling efficient data management through features such as crawling, profiling, query sheet, data preview, and lineage building (both automatic and manual). It also ensures secure authentication via Credential Manager.

<div align="left"><figure><img src="https://1813356899-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FhTnkoJQml0pok9awFDhx%2Fuploads%2FJ1q6WrdIMbEFeVVmgYbb%2Fimage.png?alt=media&#x26;token=95265758-4180-475c-aba9-3777f2b198b3" alt=""><figcaption></figcaption></figure></div>

## **Overview**

### **Connector Details**

<table data-header-hidden><thead><tr><th width="421.5"></th><th></th></tr></thead><tbody><tr><td>Connector Category</td><td>RDBMS</td></tr><tr><td>Connector Version</td><td>Release6.3.4</td></tr><tr><td>Releases Supported (Available from)</td><td>Legacy Connector</td></tr><tr><td><p>Connectivity</p><p><em>[How the connection is established with PostgreSQL]</em></p></td><td>JDBC</td></tr><tr><td>Verified PostgreSQL Version</td><td>Above 6.0</td></tr></tbody></table>

{% hint style="info" %}
The PostgreSQL connector has been validated with the mentioned "Verified PostgreSQL Versions" and is expected to be compatible with other supported PostgreSQL Versions. If there are any validation or metadata crawling issues, please submit a support ticket for investigation and feedback.
{% endhint %}

### **Connector Features**

| Feature                                      | Availability |
| -------------------------------------------- | :----------: |
| Crawling                                     |       ✅      |
| Delta Crawling                               |       ❌      |
| Profiling                                    |       ✅      |
| Query Sheet                                  |       ✅      |
| Data Preview                                 |       ✅      |
| Auto Lineage                                 |       ✅      |
| Manual Lineage                               |       ✅      |
| Secure Authentication via Credential Manager |       ✅      |
| Data Quality                                 |       ✅      |
| DAM (Data Access Management)                 |       ❌      |
| Bridge                                       |       ✅      |

### Metadata Mapping

The following objects are crawled from PostgreSQL and mapped to the corresponding UI assets.

<table><thead><tr><th width="177.33331298828125">PostgreSQL Object</th><th width="245.1666259765625">PostgreSQL Attribute</th><th width="197.1666259765625">OvalEdge Attribute</th><th width="191.333251953125">OvalEdge Category</th><th width="176.3333740234375">OvalEdge Type</th></tr></thead><tbody><tr><td>Table</td><td>Table Name</td><td>Table</td><td>Tables</td><td>table</td></tr><tr><td>Table</td><td>Table Type</td><td>Table</td><td>Tables</td><td>table</td></tr><tr><td>Table</td><td>Table Comments</td><td>Source Description</td><td>Descriptions</td><td>Source Description</td></tr><tr><td>Columns</td><td>Column Name</td><td>Column</td><td>Table Columns</td><td>-</td></tr><tr><td>Columns</td><td>Data Type</td><td>Column Type</td><td>Table Columns</td><td>-</td></tr><tr><td>Columns</td><td>Description</td><td>Source Description</td><td>Table Columns</td><td>-</td></tr><tr><td>Columns</td><td>Ordinal Position</td><td>Column Position</td><td>Table Columns</td><td>-</td></tr><tr><td>Columns</td><td>Length</td><td>Data Type Size</td><td>Table Columns</td><td>-</td></tr><tr><td>Views</td><td>View Name</td><td>View</td><td>Tables</td><td>view</td></tr><tr><td>Views</td><td>View_Definition/Definition</td><td>View Query</td><td>Views</td><td>View</td></tr><tr><td>Procedures</td><td>nspname</td><td>Name</td><td>Procedures</td><td>-</td></tr><tr><td>Procedures</td><td>nspname</td><td>Source Description</td><td>Descriptions</td><td>-</td></tr><tr><td>Procedures</td><td>Prosrc</td><td>Procedure</td><td>Procedures</td><td>-</td></tr><tr><td>Functions</td><td>nspname</td><td>Name</td><td>Functions</td><td>-</td></tr><tr><td>Functions</td><td>Function_Definition</td><td>Function</td><td>Functions</td><td>-</td></tr><tr><td>Functions</td><td>Description</td><td>Source Description</td><td>Descriptions</td><td>-</td></tr><tr><td>Triggers</td><td>Trigger Name</td><td>Name</td><td>Triggers</td><td>-</td></tr><tr><td>Triggers</td><td>action_statement</td><td>Trigger Data</td><td>Triggers</td><td>-</td></tr></tbody></table>

## Set up a **Connection**

### **Prerequisites**

The following are the prerequisites to establish a connection:

#### **Whitelisting Ports**

Make sure that the inbound port “5432” is whitelisted to enable successful connectivity with the PostgreSQL database.

{% hint style="warning" %}
*The default port number for PostgreSQL is 5432. If a different port is used, ensure that the updated port number is specified during connection setup, the port is whitelisted, and communication between the system and PostgreSQL is properly established.*
{% endhint %}

### **Service Account User Permissions**

{% hint style="warning" %}
*It is recommended to use a separate service account to establish the connection to the data source, configured with the following minimum set of permissions.*
{% endhint %}

{% hint style="info" %}
👨‍💻Who can provide these permissions? These permissions are typically granted by the PostgreSQL administrator, as users may not have the required access to assign them independently.
{% endhint %}

<table><thead><tr><th width="185.5833740234375">Operations</th><th width="150.33331298828125">Objects </th><th width="365.91650390625">System Tables</th><th width="183.6666259765625">Access Permission</th></tr></thead><tbody><tr><td>Crawling &#x26; Profiling</td><td>Schemas</td><td>information_schema.schemata</td><td>USAGE</td></tr><tr><td>Crawling &#x26; Profiling</td><td>Tables</td><td>information_schema.tables</td><td>SELECT</td></tr><tr><td>Crawling &#x26; Profiling</td><td>Tables</td><td>pg_matviews</td><td>SELECT</td></tr><tr><td>Crawling &#x26; Profiling</td><td>Table Columns</td><td>pg_attribute, pg_class, pg_namespace</td><td>SELECT</td></tr><tr><td>Crawling &#x26; Profiling</td><td>Table Columns</td><td>information_schema.columns</td><td>SELECT</td></tr><tr><td>Crawling, Profiling , &#x26; Lineage Building<br></td><td>Views</td><td>information_schema.views</td><td>SELECT</td></tr><tr><td>Crawling, Profiling , &#x26; Lineage Building<br></td><td>Views</td><td>pg_matviews</td><td>SELECT</td></tr><tr><td>Crawling, &#x26; Lineage Building</td><td>Functions</td><td>pg_proc</td><td>EXECUTE</td></tr><tr><td>Crawling, &#x26; Lineage Building</td><td>Functions</td><td>pg_namespace</td><td>EXECUTE</td></tr><tr><td>Crawling, &#x26; Lineage Building</td><td>Functions</td><td>pg_language</td><td>EXECUTE</td></tr><tr><td>Crawling, &#x26; Lineage Building</td><td>Functions</td><td>pg_type</td><td>EXECUTE</td></tr><tr><td>Crawling, &#x26; Lineage Building</td><td>Stored Procedures</td><td>pg_proc</td><td>EXECUTE</td></tr><tr><td>Crawling, &#x26; Lineage Building</td><td>Stored Procedures</td><td>pg_namespace</td><td>EXECUTE</td></tr><tr><td>Crawling, &#x26; Lineage Building</td><td>Stored Procedures</td><td>pg_language</td><td>EXECUTE</td></tr><tr><td>Crawling, &#x26; Lineage Building</td><td>Stored Procedures</td><td>pg_type</td><td>EXECUTE</td></tr><tr><td>Crawling</td><td>Triggers</td><td>information_schema.triggers</td><td>EXECUTE</td></tr><tr><td>Crawling</td><td>Relationships</td><td>information_schema.referential_constraints</td><td>REFERENCES</td></tr><tr><td>Crawling</td><td>Relationships</td><td>information_schema.key_column_usage</td><td>REFERENCES</td></tr></tbody></table>

### Connection Configuration Steps

{% hint style="warning" %}
***Important**: You must have the Connector Creator role to set up a connection in OvalEdge.*
{% endhint %}

1. Log into OvalEdge, go to **Administration > Connectors**, click **+ (New Connector)**, search for **PostgreSQL**, and complete the required parameters.

{% hint style="success" %}
*Fields marked with an asterisk (**\***) are mandatory for establishing a connection.*
{% endhint %}

<table><thead><tr><th width="222.75">Field Name</th><th>Description</th></tr></thead><tbody><tr><td>Connector Type</td><td>By default, "PostgreSQL" is displayed as the selected connector type.</td></tr><tr><td>Credential Manager*</td><td><p>Select the desired credentials manager from the drop-down list. Relevant parameters will be displayed based on your selection.</p><p>Supported Credential Managers:</p><ul><li>OE Credential Manager</li><li>AWS Secrets Manager</li><li>HashiCorp Vault</li><li>Azure Key Vault</li></ul></td></tr><tr><td>License Add Ons</td><td><p></p><ul><li>Select the checkbox for Auto Lineage Add-On to build data lineage automatically.</li><li>Select the checkbox for Data Quality Add-On to identify data quality issues using data quality rules and anomaly detection.</li></ul></td></tr><tr><td>Connector Name*</td><td>Enter a unique name for the PostgreSQL connection.</td></tr><tr><td>Connector Environment</td><td>Select the environment (Example: PROD, STG) configured for the connector.</td></tr><tr><td>Connector Description</td><td>Enter a brief description of the connector.</td></tr><tr><td>Server*</td><td>Enter the PostgreSQL database server name or IP address. (Example: xxxx-xxxxxxx.xxxx4ijtzasl.xx-south-1.rds.amazonaws.com or 1xx.xxx.1.xx).</td></tr><tr><td>Port*</td><td>By default, the port number for PostgreSQL, 5432, is auto-populated. If required, you can change it to a custom port number configured for your PostgreSQL.</td></tr><tr><td>Database*</td><td>Enter the database name to which the service account user has access within the PostgreSQL.</td></tr><tr><td>Driver*</td><td>By default, the PostgreSQL driver details are auto-populated.</td></tr><tr><td>Username*</td><td>Enter the service account username configured to access the PostgreSQL database (example: "oesauser").</td></tr><tr><td>Password*</td><td>Enter the password associated with the service account user.</td></tr><tr><td>Connection String</td><td><p>Configure the connection string for the PostgreSQL database:</p><ul><li>Automatic mode: The system generates a connection string based on the provided credentials.</li><li>Manual mode: Enter a valid connection string manually.</li></ul><p>Replace placeholders with actual database details.</p><p>{sid} refers to the database name.</p></td></tr><tr><td>Plugin Server</td><td>Enter the server name when running as a plugin server.</td></tr><tr><td>Plugin Port</td><td>Enter the port number on which the plugin is running.</td></tr></tbody></table>

2. After entering all connection details, the following actions can be performed:
   1. Click **Validate** to verify the connection.
   2. Click **Save** to store the connection for future use.
   3. Click **Save & Configure** to apply additional settings before saving.
3. The saved connection will appear on the Connectors home page.

## Manage Connector Operations

### Crawl/Profile

{% hint style="warning" %}
To perform crawl and profile operations, users must be assigned the Integration Admin role.
{% endhint %}

The **Crawl/Profile** button allows users to select one or more schemas for crawling and profiling.&#x20;

1. Navigate to the Connectors page and click **Crawl/Profile.**
2. Select the schemas to be crawled.
3. The Crawl option is selected by default. To perform both operations, select the **Crawl & Profile** radio button.
4. Click **Run** to collect metadata from the connected source and load it into the **Data Catalog.**
5. After a successful crawl, the information appears in the **Data Catalog > Databases** tab.

The **Schedule** checkbox allows automated crawling and profiling at defined intervals, from a minute to a year.

1. Click the **Schedule** checkbox to enable the **Select Period** drop-down.
2. Select a time interval for the operation from the drop-down menu.
3. Click **Schedule** to initiate metadata collection from the connected source.
4. The system will automatically execute the selected operation (**Crawl** or **Crawl & Profile**) at the scheduled time.

#### Other Operations

The Connectors page provides a centralized view of all configured connectors, along with their health status.

**Managing connectors includes:**

* **Connector Health**: Displays the current status of each connector using a green icon for active connections and a red icon for inactive connections, helping to monitor the connectivity with data sources.
* **Viewing**: Click the **Eye** icon next to the connector name to view connector details, including databases, tables, columns, and codes.

**Nine Dots Menu Options:**

You can view, edit, validate, build lineage, modify connector settings, and delete connectors using the **Nine Dots menu.**

* **Edit Connector**: Update and revalidate the data source.
* **Validate Connector**: Check the connection's integrity.
* **Settings**: Modify connector settings.
  * **Crawler**: Configure data extraction.
  * **Profiler**: Customize data profiling rules and methods.
  * **Query Policies:** Define query execution rules based on roles.
  * **Access Instructions**: Add notes on how data can be accessed.
  * **Business Glossary Settings**: Manage term associations at the connector level.
  * **Anomaly Detection Settings**: Configure anomaly detection preferences at the connector level.
  * **Others**: Configure notification recipients for metadata changes.
* **Build Lineage**: Automatically build data lineage using source code parsing.
* **Delete Connector**: Remove a connector with confirmation.

## **Connectivity Troubleshooting**

If incorrect parameters are provided, you may encounter error messages. To resolve these issues, ensure all input is correct. If problems persist, contact your assigned **OvalEdge** support team.

<table data-header-hidden><thead><tr><th width="79"></th><th width="264"></th><th></th></tr></thead><tbody><tr><td><strong>S. No.</strong></td><td><strong>Error Description</strong></td><td><strong>Resolution</strong></td></tr><tr><td>1</td><td>Error while validating connection: Exception occured while validating the PostgreSql Connection : Failed to obtain JDBC Connection; nested exception is xxx.postgresql.xxx.PSQLExxxxxx: FATAL: password authentication failed for user "xxxxx"</td><td><p><strong>Error Description:</strong></p><p>Either username and password might be wrong.</p><p><br></p><p><strong>Resolution</strong>:</p><ul><li>You provided an incorrect username or password in the setup form's User or Password fields or formatted the User field value incorrectly.</li><li>The authorizing user has the permission required to connect the database to OvalEdge.</li><li>The authorizing user is not locked out of their account or required to reset the password.</li></ul></td></tr><tr><td>2</td><td>Error while validating connection: Exception occured while validating the PostgreSql Connection : Failed to obtain JDBC Connection; nested exception is xxx.postgresql.xxx.PSQLException: FATAL: database "xxxxx" does not exist</td><td><p><strong>Error Description:</strong></p><p>The database name provided is invalid.</p><p><strong>Resolution</strong>:</p><ul><li>You provided an incorrect database name in the setup form's Database Name field.</li><li>Ensure that the database name is correctly spelled and exists in the target system.</li></ul></td></tr></tbody></table>

***

&#x20;Copyright © 2025, OvalEdge LLC, Peachtree Corners GA USA