Data Catalog
New & Improved
Summary and Detailed Lineage Views
A new toggle option is now available in the Lineage tab to switch between Summary Lineage View and Detailed Lineage View. The toggle appears at the top left of the screen and updates the view instantly without requiring a page reload.
View options include:
Summary Lineage View shows a simplified flow across core systems, excluding technical components such as transformation logic, datasets, and semantic tables. This view is suited for business users.
Detailed Lineage View displays the full data flow from source to destination, including transformation logic, datasets, semantic tables, and system-level components.
Summary Page – Added “Request Missing Content”
Report missing or incomplete metadata directly from the Summary Page for any data object, including tables, files, reports, or APIs.
Column-Level Transformation Code - Lineage
Column lineage now displays only the transformation code relevant to the specific column data flow instead of the entire code block. This update helps business users focus on the exact transformations applied to a column, improving clarity and usability in analyzing data flow.
Visual Clarity in Lineage Graph
The Lineage graph now displays full object names and enhanced tooltip content to improve readability and accuracy. Full names provide better visibility across nodes, while structured tooltips offer clear, detailed information to support accurate data analysis.
Critical Data Element Recommendation
A Critical Data Element (CDE) is an important data asset, like a table or column, that impacts business decisions, reporting, or compliance. Only SGAs (Security & Governance Admins) and Governance Roles (such as Owners or Stewards) can use the Yes/No toggle beside "Mark as Critical Data Element" to easily update their status.
Other Enhancements
Tree View for Report Column Summary: Allows drilling down through the report structure, report Pages → Visuals → Columns.
Attribute Panel for Full-Screen Mode: Filters, search inputs, and sorting set in the Attributes section remain active when switching to Full-Screen mode.
Qlik Sense Sheet Identification Improved: The sheet identification in Qlik Sense reports with Streams enabled. The Data Catalog now distinguishes sheets with the same name, making it easier to find the correct sheet and report.
Configuration View – Added Missing Fields: Server Name and Database Type are now visible in both My View and Public View.
Added Authoritative & Originating Source Attribute: The Catalog Details section now shows two new attributes:
Originating Source indicates how the data object was created (Manual, Crawl, or Virtual).
An authoritative source confirms whether the object comes from a trusted, official system.
Added File Type Attribute: The File Type attribute in the Catalog Details section shows each file's format or extension.
Common file types include:
CSV (.csv): Comma-separated values
TXT (.txt): Plain text file
XLSX / XLS (.xlsx / .xls): Excel spreadsheet
JSON (.json): JavaScript Object Notation file
AVRO (.avro): Apache Avro serialized data
YAML (.yaml): YAML Ain’t Markup Language file
PDF (.pdf): Portable Document Format
DOC / DOCX (.doc / .docx): Microsoft Word documents
JPEG / JPG / GIF (.jpeg / .jpg / .gif): Image files
Codes Summary Page SQL queries appear in a multi-line, indented format. This makes queries easy to read, understand, and debug, especially for longer or more complex code blocks.
Add Object Widget: Added a Report Type column and filter to the Add Object widget.
Dynamic Filter Behavior: Introduced dependent filtering to refine results based on selected filter values. Filter options dynamically update according to other selections, enabling more contextual and precise searches.
Advanced Filtering Support in List View: In Data Catalog > All Objects List View:
Single-Value Columns (e.g., Type, Connection Name, Schema): Support "Equals to" and "Not equals to" options.
Multi-Value Columns (e.g., Tags, Terms, Classification): Support:
Equals to Any of
Equals to All of
Not Equals to Any of
Not Equals to All of
Filter Behavior Enhancements for Multi-Value Fields
Equals to Any of: Displays objects matching any selected value.
Equals to All of: Displays only objects matching all selected values.
Not Equals to Any of: Excludes objects matching any selected value.
Not Equals to All of: Excludes objects matching all selected values.
Role-Based Access for Report Preview: Admins can now control access to the Report Preview tab in Report Summary. Configuration available under Administration > Security > Applications by enabling role-based authentication.
Top Values: The Top Values section in the Table and File Column summary includes both count and percentage for each value.
Elastic Search for Faster Filtering: List View filtering uses Elastic Search instead of SQL, enabling faster object lookup and result display.
Customizable Code View Sections: Left and right sections of Codes (in Data Catalog > Codes) are configurable using custom fields. Configuration path: Administration > Custom Fields > Object Type (Code) > Manage Sections.
Call-to-Action Button Configuration: The Call-to-Action button in Object Summary can now be shown or hidden as needed. Customization available under Administration > Custom Fields > Object Type > Global > Call To Action.
‘Last Crawled Date’ in List View: Added a new column to display 'Last Crawled Date' for all object types in the All Objects List View.
Search and Sort on Data Quality Score: Enabled search and sort functionality for the Data Quality Score column across all relevant objects in List View.
Improved Object Title Placement: In List View, the Object Title column now appears immediately next to the Object column.
New Checkbox Filters for Domain Hierarchy Columns: Added checkbox filters for “No Domain,” “No Category,” and “No Sub-Category” when configuring views for Domain-related columns.
Default Display of Access Instructions: Access Instructions now display by default in the Table Summary for business users.
Configurable Description Types: Business, Technical, and Source Description fields in Object Summary are now configurable for visibility. Configuration path: Administration > Custom Fields > System Fields.
Hover View of Data Governance Team: Hovering over Governance Team columns in Objects List View now displays assigned Custodian, Steward, Owner, and additional Governance Roles (4, 5, 6).
Customization via System Settings
lineage.summary.view
Configure the lineage.summary.view key in System Settings to control access to the Summary Lineage View across the instance.
Parameters:
The default value is False
If set to True to enable the Summary Lineage toggle in the Lineage screen
If set to False to hide the toggle
Notes:
Only System Administrators can modify this key
A complete lineage rebuild is required after enabling or migrating this setting to ensure data accuracy
es.datacatalog.filter.size
Configure to set the filter size of the catalog objects on a page.
Parameters:
The default value is 100.
The minimum allowed value is one, and the maximum is 100.
catalog.es.oetp.additional.ops.allowed
Configure to enable/disable the Advanced Filter option in the Data Catalog.
Parameters:
The default value is True.
If set to True, the Advanced Filter option will be enabled.
If set to False, the Advanced Filter option will be disabled.
Note: This is supported only when the Elastic Search option is enabled for the Data Catalog.
Advanced Jobs
Profile By Importance Score
This job allows admins to perform targeted profiling of tables based on their Importance Score. Users can specify a threshold range (e.g., 80-100) to profile only the most critical tables within that range. The job supports filtering by a specific connection and its associated schemas. Attributes:
Attribute 1: Connection ID (Required) Enter the ID of the connection. Only one connection can be selected per job.
Attribute 2: Schema IDs (Optional) Provide one or more schema IDs. All schemas must belong to the selected connection.
Attribute 3: Low Range (Required) Enter the lower limit of the Importance Score range (e.g., 80). The value should be between 0 and 100.
Attribute 4: High Range (Required) Enter the upper limit of the Importance Score range (e.g., 100). The value must be greater than the Low Range and less than or equal to 100.
Catalog Parent Folders
This job catalogs all parent folders of a catalog file or folder.
Remove Access For Inactive Tables
This job removes access for inactive objects.
Generate GUID
This job generates GUIDs for existing unassigned catalog objects, tags, and terms. A GUID is a unique identifier for objects within the application. This job will generate and assign the unassigned objects with GUIDs.
Image Upload Security Enhancement
This job updates the identifiers of previously uploaded images in the Business Description, Technical Description, and other Froala Editor fields. Earlier, images were stored with sequential IDs, posing a security risk as users could access other uploaded images by modifying the URL. Running this job after migration replaces all existing image IDs with unique, non-sequential keys, ensuring enhanced security and preventing unauthorized access.
Inconsistent Objects Diagnostic & Cleanup
This job identifies and removes inactive objects from OvalEdge to maintain metadata accuracy. When executed, it provides a diagnostic report on the number of inactive parent objects in the job logs. If the cleanup attribute is set to true in Attribute1, the job will proceed to delete these inactive objects while ensuring hierarchical integrity, removing dependent child objects. By default, the cleanup attribute is set to false, allowing admins to review the impact before performing deletions.
Copyright © 2025, OvalEdge LLC, Peachtree Corners, GA, USA.
Last updated
Was this helpful?