Manage Virtual Objects

Authors with Meta-Write permission can perform four significant actions related to Virtual Table, Virtual Table Column, Virtual File, Virtual File Columns, Virtual Report, Virtual Report Column, Virtual API or Virtual API Columns:

  1. Create

  2. Edit

  3. Delete

  4. Convert

Create Virtual Objects

Virtual objects can be created for Tables, Table Columns, Files, Reports, Report Columns, APIs, and API attributes.

Create Tables/Views, Table Columns

Tables/Views and Table Columns can be created using the ‘Manage Table’ icon on the Data Catalog's tables List View Page and Database Summary Page.

  • Table/View List Page Authors can create a Virtual Table/View by clicking the 'Manage Table' icon next to the Reset icon on the Table List Page.

This action opens a pop-up window where specific fields must be filled to create the Table/View and its corresponding Table columns.

To create a table/view, the following fields must be filled in,

  • In the pop-up, create multiple Virtual Table Columns for that Table/View. Fill in the relevant details for the Table Columns. Use the 'Add' button to create as many columns as needed for the Table/View.

  • Duplicate Tables/Views in the same Schema cannot be created.

  • The pop-up automatically fills in the existing details of a Crawl or Virtual Table/View with Columns. Using the 'Add' button, additional columns can be created for the table/view.

To create a Tables/Views, the following fields must be filled in:

Fields
Use

Connector*

To create a Table, select an existing crawled connector from the application.

Schema*

Choose a Schema within that Connector where the table will be created.

Table Name*

Input a name for the table.

Note: Select an existing table to create a Virtual Table Column for it.

Source Description

Provide a Description for the Table, which can be useful for the Source Description later.

Origin

The Origin of the table is automatically determined based on the table name or selection.

If a new table is created, it will have a Virtual origin. Choosing an existing table for Table Columns can result in a Crawl or Manual origin as well.

Type*

Create a virtual table as a ‘View’ or a ‘Table.’

To create a table columns, the following fields must be filled in:

Fields
Use

Column Name*

The Table Column Name must be entered for the desired Table creation.

Origin

The Origin of the Table Column is auto-populated accordingly.

Position

The Position indicates the position of the Table column in the Table. Adjustments to Virtual Columns' positions can be made through the drag-and-drop feature.

Type*

The type denotes the data type or values stored in the column, such as Integer, Date, String, and Float.

Length*

The Length of the column indicates the size of the column (in bytes).

Constraints*

Constraints indicate the nullability of the column, with options for 'NULL' or 'NOT NULL' values.

Source Description

A description can be added for the table column, which may be useful for later source description purposes.

  • Create Manual Tables by selecting the Manual Connector in the application.

  • In Manual Tables, new Manual Columns can be created alongside the existing ones.

  • Duplicate Table Columns are prohibited in a Table.

Database Summary Page

Virtual Tables/Views and their corresponding Table Columns can be created directly from any Database Summary Page. 'Manage Table' icon is available on the right side Call to Action section. Clicking it opens the same pop-up window for creating a Virtual Table/View. In this case, the Connector and Database fields cannot be modified, but will show the Database the user selects. The rest of the steps follow the same procedure as outlined earlier.

For Topics, the user needs to select the Connector, Schema, Topic Name, and Source Description. The Origin field is auto-populated.

Create Files & File Columns

Files and their File Columns can be created using the ‘Manage Files’ icon found on the Files List Page of the Data Catalog.

Authors with Meta-Write permission can create a Virtual File by selecting the 'Manage File' icon next to the Reset icon on the Files List Page.

Clicking on it opens a pop-up window where specific fields must be completed to create a File and its corresponding File columns.

  • The pop-up auto-populates details for an existing Crawl or Virtual Files with columns. Additional columns can be created by clicking the 'Add' button.

  • The pop-up window allows adding multiple virtual file columns corresponding to the file. Clicking the 'Add' button enables the addition of multiple columns as needed. Added columns can be rearranged using drag-and-drop functionality.

  • Duplicating Files within the same File Location is not permitted.

To create a Virtual File, the following fields must be filled in:

Fields
Use

File System*

To create a file, choose an existing crawled file connector from the available options in the application.

File Location*

Select a File location within that file system where you want to create the file.

File Name*

Input a file name for the new file.

Note: Select an existing file if you want to create a Virtual file Column.

Source Description

Provide a Description for the File, which can be useful for Source Description later.

Origin

The Origin of the File is automatically determined based on the file's name or the file selected. If you create a new file, it will have a Virtual origin. If you choose an existing file to create file columns within it, they will have a Crawl origin.

For creating the Virtual File Column, the following fields must be filled in:

Fields
Use

Column Name*

To create a file column, input the column name.

Origin

The Origin of the file column is auto-populated accordingly.

Position

The position indicates the file column's location, which is adjusted using Drag and Drop.

Type*

The Type indicates the data type or values the column holds. Some common data types supported are Integer, Date, String, and Float.

Source Description

A description can be added for the file column, which may be useful later for source description purposes.

Create Reports & Report Columns

Reports and their corresponding Report Columns can be created using the Manage Reports icon located on the Report List Page of the Data Catalog.

Authors with Meta-Write permission can create a Virtual Report by selecting the ‘Manage Report’ icon next to the Reset icon on the Report List Page. Clicking this icon opens a pop-up window where specific fields must be filled to create the report and its corresponding report columns.

  • The pop-up auto-populates details for an existing Crawl or Virtual Report with columns. By clicking the 'Add' button, additional columns can be created.

  • Opening the pop-up window enables adding multiple virtual file columns corresponding to the report. Clicking the 'Add' button allows adding as many columns as needed. Use drag-and-drop to rearrange the added columns.

  • Duplicating Reports and Report Columns within a Report Group is not permitted.

For creating the Virtual Report, the following fields must be filled in:

Fields
Use

Connector*

To create a report, choose an existing crawled report connector from the available options in the application.

Report Group*

Select a Report Group within that Connector where you want to create the report.

Report Name*

Input a report name for the new report.

Note: Select an existing report to create a Virtual Report Column.

Report Type

The Report Type indicates the different reports available for different Reporting Tools.

For example, it could be a Dashboard for the Tableau Connector.

Source Description

Provide a description of the report, which can be useful for a source description later during the conversion of the report.

Origin

The Origin of the Report is automatically determined based on the name of the report or the report chosen. If you create a new report, it will be of Virtual origin. If you choose an existing report to create Report Columns within it, they will be of Crawl Origin.

For creating the Virtual Report Column, the following fields must be filled in:

Fields
Use

Column Name*

To create a report column, input the column name.

Origin

The Origin of the Report column is auto-populated accordingly.

Position

The position indicates the report column's location, which was adjusted using Drag and Drop.

Type*

The Type indicates the data type or values the column holds. Some common data types supported are Integer, Date, String, and Float.

Formula

The formula for the report is displayed.

Source Description

A description can be added for the report column, which may be useful later for source description purposes.

Create API & API Attributes

APIs and their API Attributes can be created using the ‘Manage APIs’ icon found on the APIs List Page of the Data Catalog. Authors with Meta-Write permission can create a Virtual API by selecting the 'Manage API’ icon next to the Reset icon on the API List Page.

Clicking on it opens a pop-up window where specific fields must be completed to create an API and its corresponding API Attributes.

  • The pop-up auto-populates details for an existing Crawl or Virtual Files with columns. By clicking the 'Add' button, additional columns can be created.

  • Opening the pop-up window enables adding multiple virtual API attributes corresponding to the API. Clicking the 'Add' button allows adding as many attributes as needed. Use drag-and-drop to rearrange the added attributes.

  • Duplicating APIs and API Attributes within the same API Group is not permitted.

For creating the Virtual API, the following fields must be filled in:

Fields
Use

Fields

Use

Connector*

To create an API, choose an existing crawled Data Source from the available options in the application.

API Group*

Select the API Group within that Data Source where you want to create an API.

API Name*

Input an API name for creating the new API.

Note: Select an existing API to create a Virtual API Column.

Source Description

Provide a description of the API, which can be useful for a source description later during the conversion of the API.

Origin

The Origin of the API is automatically determined based on the name of the API or the API chosen. If you create a new API, it will be of Virtual origin. If you choose an existing API to create API Attributes within it, they will be of Crawl Origin.

For creating the Virtual API Attributes, the following fields must be filled in:

Fields
Use

Attribute Name*

To create an API Attribute, input the Attribute name.

Origin

The Origin of the API Attribute is auto-populated.

Position

The position indicates the API Attributes location in the API, and is adjusted using Drag and Drop.

Data Type

The data type indicates the data type or values the Attribute holds. Some common data types supported are Integer, Date, String, and Float.

Type*

Select the type as Response Parameter or Request Parameter.

Source Description

A description can be added for the API Attribute, which may be useful later for source description purposes.

Edit Virtual Objects

Authors with Meta Write permission can edit Virtual Objects using the same Manage pop-up used to create them.

Edit Tables, Table Columns

The 'Manage Tables' icon allows editing of Virtual Tables across multiple pages in the Data Catalog.

Table List Page: Clicking the 'Manage Table' icon reveals a drop-down with an 'Edit' option. Selecting a Table enables editing its corresponding column details.

  • Modifying the selected Connector and Schema for a virtual table is not permitted. However, modifications can be made to the Table Name, Source Description, and Column Name, Type, Length, Constraint, and Source Description of the Virtual Table Columns. Add new column attributes.

  • Editing any Table Column details retrieved from the remote data source is restricted to a crawl Table. Edit Columns related to the Virtual Columns.

  • Editing the attributes of Manual Tables and their corresponding Columns is possible.

  • However, selecting multiple Tables for simultaneous editing is not allowed.

Summary Pages: Authors can edit the Virtual Tables and their corresponding virtual columns through 3 other Pages, where the ‘Manage Table’ icon is available:

  • Database Summary Page

  • Table Summary Page Summary Page

  • Table Column Summary Page Summary Page

Edit Files & File Columns

The Virtual File and File Columns can be edited through the 'Manage File' icon, available on multiple pages across the Data Catalog.

File List Page: Clicking the 'Manage File' icon reveals a drop-down menu with the 'Edit' option. Selecting a File enables editing of both the File and its associated columns.

  • Modifying the selected Connector and Schema for a virtual table is not permitted. However, modifications can be made to the Table Name, Source Description, and Column Name, Type, Length, Constraint, and Source Description of the Virtual Table Columns. Users can also add new column attributes.

  • Editing any details directly from the remote Data Source is prohibited for a Crawl File. Only the attributes of the Virtual Columns can be edited.

  • Multiple Files cannot be selected for editing at once.

Summary Pages: Authors can also edit Virtual Files and their corresponding virtual columns on two other pages with the 'Manage Files' icon.

  • File Summary Page

  • File Column Summary Page

Edit Reports & Report Columns

The Virtual Report and Report Columns can be edited through the 'Manage Report' icon, available on multiple pages across the Data Catalog.

Report List Page: Clicking the 'Manage Report' icon reveals a drop-down menu with the 'Edit' option. Selecting a Report enables editing of both the report and its associated columns.

  • Editing the chosen Connector and Report Group for a Report Table is prohibited. However, modifications can be made to the Report Name, Type, and Description and the Column Name, Type, Formula, and Description of the Virtual Report Columns.

  • For a Crawl Report, editing any details directly from the remote Data Source is prohibited. Only the attributes of the Virtual Columns can be edited.

  • Multiple reports cannot be selected for editing at once.

Summary Pages: Authors can also edit Virtual Reports and their corresponding virtual columns on two other pages with the 'Manage Reports' icon.

  • Report Summary Page

  • Report Column Summary Page

Edit APIs & API Attributes

The Virtual API and API Columns can be edited through the 'Manage APIs' icon, available on multiple pages across the Data Catalog.

API List Page: Clicking the 'Manage APIs’ icon reveals a drop-down menu with the 'Edit' option. Selecting an API enables editing of both the API and its associated Attributes.

  • Editing the chosen connector and API Group for an API is prohibited. However, modifications can be made to the Source Description and its associated Virtual API Attributes (Attribute Name, Data Type, Type, and Source Description)

  • For a Crawl API, editing any details directly from the remote Data Source is prohibited. Only the attributes of the Virtual Attributes can be edited.

  • Multiple APIs cannot be selected for editing at once.

Summary Pages: Authors can also edit Virtual APIs and their corresponding Virtual Attributes on two other pages with the 'Manage APIs' icon.

  • API Summary Page

  • API Column Summary Page

Delete Virtual Objects

  • Authors can remove virtual objects from the application if these objects are no longer relevant and are not intended to be added to the remote source.

  • Virtual Tables, Files, Reports, and APIs can be deleted by selecting them from the List Pages and using the 'Delete' function available through the 'Manage Table,' ‘Manage Files,’ 'Manage Report,' and ‘Manage APIs’ icons. Concurrently, the Virtual Columns associated with the selected Tables, Files, Reports, and APIs will be deleted.

Additionally, Virtual Columns can be deleted from the 'Manage Table,' ‘Manage Files,’ 'Manage Reports,' and ‘Manage APIs’ pop-ups by clicking the designated trash button beside the specific column details.

Convert Virtual Objects into Data Source Objects

Virtual Objects aim to become Data Source Objects with relevant data. The Database Administrator can manually make this transition. They must add the virtual object to the data source using the same name. Afterward, the administrator can initiate a re-crawl of the connector directly. This process applies to tables, reports, files, and APIs, including their columns.

After the re-crawl, users will have visibility into all the objects' crawled and profiled statistics (if profiling was conducted), as there will be associated data. The object's origin will also change from Virtual to Crawl, indicating the conversion from a virtual state to a state derived from the data source.

Converting Virtual Objects into Data Source Objects is crucial in integrating virtual data with tangible data in the system. By aligning virtual and physical datasets, organizations can ensure the smooth flow of information and enable efficient data management practices.

Manage Virtual Objects in Bulk

Create, update, and delete the following virtual objects or manual objects via LMDF:

  • Tables & Table Columns

  • Files & File Columns

  • Reports & Report Columns

  • APIs & API Attributes

Action Column Support

The Action column in LMDF templates has been enhanced to support Virtual Objects and Manual Objects with four options:

  • Add → Creates new Virtual Objects.

  • Modify → Updates metadata of existing Virtual Objects.

  • Delete → Removes Virtual Objects.

  • No Action → No action on the Virtual Objects

Admins must ensure that all mandatory fields shown in the UI are also filled in LMDF to perform the actions successfully.


Copyright © 2025, OvalEdge LLC, Peachtree Corners, GA USA

Last updated

Was this helpful?