Virtual Objects

Virtual Objects are temporary data objects created to manage requests for new data assets needed in data sources. This feature allows the creation of Tables, Table Columns, Reports, Report Columns, Files, File Columns, APIs, and API Attributes without actual data. The skeletal structure with ample metadata is created, but is inaccessible in the data source. Descriptions, tags, terms, and lineage can be added or modified without source data to adjust the metadata.

Virtual objects simplify exploring, integrating, and visualizing data, especially when the object structure is finalized. They enable data engineers, analysts, and scientists to create relevant data objects without requiring the assistance of a Database Administrator. They also help organize and utilize data objects and their metadata even before their existence in the source.

Origin of Objects

The origins of objects indicate the source from which these data objects originate. Specifically, it is divided into four types:

Crawl

The connectors crawl objects that already exist within the Data Sources and subsequently bring them into the application. These objects are clearly defined and contain relevant physical data and attributes.

For example, a crawled table contains columns and rows with significant data entries. Connectors parse the metadata and display crawling and profiling statistics within the application.

Virtual

The 'Virtual' origin categorizes Virtual Objects created within the application. These Virtual Objects exist solely within the application and are not accessible in the Data Source of the linked Connector. Once incorporated into the data source, they can be transformed into Crawl Objects with physical data and re-crawled.

Manual

A Manual Connector refers to a connector that is not inherently linked to any specific data source and can be established to support custom integration needs. Tables and table columns can be added to this connector without physical data using the Data Catalog or bulk functions like Load Metadata from File and OvalEdge APIs. These objects are designated as Manual in terms of their origin.

Manual objects are linked to a Manual Connector and cannot be crawled or added to a real Data Source like an RDBMS. In contrast, Virtual Objects are temporary and can be added to a Data Source to become Crawled Objects with physical data.

Temp

Lineage construction requires related objects to show data movement. When the original objects are unavailable, temporary associations called Temp Objects are used to build lineage. These Temp Objects, classified under the Temp Origin, don't hold actual data but help visualize lineage. After crawling the original objects, Temp objects merge with them later.

Access Virtual Objects

Virtual Objects are accessible in the Data Catalog for creation, viewing, editing, and deletion. To manage virtual objects, use the Manage Tables, Reports, Files, or Manage APIs. A dedicated out-of-the-box view in the Data Catalog showcases Virtual Objects upon selecting the System View Virtual Objects in the drop-down list.

Navigate Objects in Data Catalog

The Data Catalog List Page contains all objects from various origins. Different out-of-the-box views are available to provide a modular display of these objects.

System View

In the System View, all objects from Crawl and Manual origins are accessible. Using the filter in the Origin Column of the ListView, objects can be sorted and displayed based on their Crawl or Manual origin.

Virtual View

The Virtual View only shows Virtual Objects and doesn't include Crawled objects. This is clear in the Origin Column of the List View, where all objects are labeled as Virtual.

Temp View

The Temp View only displays Temp Objects, as seen in the Origin Column of the List View, where all objects are labeled as Temp.

Virtual Objects are easily identifiable on Summary Pages by their dedicated Virtual Object icon, separate from icons representing objects of other origins.

Views in the Object Summary Page

The Object Summary page includes different views (System View, System View - Virtual Objects, and System View - Temp Lineage Objects) under the Columns section to explore various object types.

Security around Virtual Objects

Permissions for Virtual Objects like Tables, Table Columns, Reports, Report Columns, Files, File Columns, APIs, and API Attributes are determined by the License Type and Role Type.

• Authors with Meta Write access can create, modify, and delete virtual objects.

• Viewers with Meta Read access and Authors with Meta Read can view virtual objects without the ability to make changes.

---

Copyright © 2025, OvalEdge LLC, Peachtree Corners, GA USA