Select Data Lake

The "File Explorer" displays all available file connections, with the following details:

• Click the Connection Name to explore files and folders and navigate directly to the File Explorer.

• Clicking the Data Lake OvalEdgeSight icon provides detailed statistics for the selected connector, offering insights into its folders, subfolders, and files. When the Folder Scan is completed, the icon will change to green.

• Clicking the Folder OvalSight icon schedules a Folder OvalSight scan for the connector. This scan retrieves data on total files, empty subfolders, total subfolders, the last folder level, and other details within the connector.

Authors can use the search icons in the respective columns to search for specific connections by name or created by, and can filter by type.

• Connector Name - Shows the name of the connected file system.

• Data Source Type - Displays the type of file storage used, such as NFS or S3.

• Created By - Displays the username of the person who created the connection.

• Last Modified On - Indicates the date and time when the connection was last updated.

• Data Lake OvalSight - Shows whether the data lake is enabled for OvalSight.

• Last OvalSight Scan - Displays the date and time of the most recent OvalSight scan.

• Folder OvalSight Scheduler - Shows the scheduler set for scanning folders with OvalSight.

Explore Folders & Files

In File Explorer, clicking a Connection Name will display the contents of the selected connection folder or file.

• Type: File or Folder

• Folder/File Name: File or Folder name

• File Type: Extension (e.g., .csv, .xlsx) - empty for folders

• Catalog: Categorize files and folders to enable better metadata management, which is required before profiling data. A check mark symbol shows that a file or folder is cataloged.

  • Automatic Cataloging: The first level of data (typically top-level folders) automatically catalogs during the connection crawling.

  • Manual Cataloging: Authors can manually catalog second-level or deeper folders and individual files using two methods:

    • Plus Sign (+): In File Explorer, click the "+" icon next to each file or folder.

    • 9-Dots: Use the 9-Dots menu in File Explorer to catalog multiple files/folders simultaneously.

• Folder OvalSight: Run Folder OvalSight on a selected first-level folder and restrict analysis to the second level if needed. The icon in the Folder OvalSight column turns green when the scan is complete. This feature provides detailed analysis of all nested subfolders and files up to the last level.

• File Size: File size

• Last Modified: Date of last modification in the source system

• Last OvalSight Scan: Date and time of the last Run Folder OvalSight.

• Preview Link: Copy the link to view the Data Catalog Summary Page in another browser tab.

File Explorer Details

The File Explorer displays detailed information for each file within a folder:

• Type: File or Folder

• Folder/File Name: File or Folder name

• File Type: Extension (e.g., .csv, .xlsx)

• Catalog: Categorize files for effective metadata management, which is required before profiling data. A check mark symbol indicates that a file or folder is cataloged.

  • Automatic Cataloging: The first level of data (typically top-level folders) automatically catalogs during the connection.

  • Manual Cataloging: Authors can manually catalog second-level or deeper files using two methods:

    • Plus Sign (+): Click the "+" icon next to each file.

    • 9-Dots: Use the 9-Dots menu in File Explorer or Data Catalog to catalog multiple files/folders simultaneously.

• Folder OvalSight: Run Folder OvalSight on a selected first-level folder and optionally limit the scan to the second level. The icon in the Folder OvalSight column turns green when the scan completes. This feature delivers a detailed analysis of all nested subfolders and files up to the last level.

• File Size: File size

• Last Modified: Date of last modification in the source system

• Last OvalSight Scan: Date and time of the last Run Folder OvalSight.

• Preview Link: Copy the link to view the Data Catalog Summary Page File/Folder in another browser tab.

User Actions

The 9-Dots icon in the top right corner provides a menu for various actions on files and folders:

• View File: Preview data in raw or table format.

  • Raw View: Unstructured data view.

    
  • Table View: Structured data view.

    
• Download File: Download the file uploaded to File Explorer to the desktop.

• Delete File: This option permanently removes a file (it cannot be recovered) from the application but not from the source system.

• Upload File: Upload a new file or folder (NFS connection only).

• Catalog Files/Folders: Categorize files/folders for visibility in the Data Catalog (required for profiling). A check mark symbol indicates a cataloged file or folder.

• Run Folder OvalSight: Execute Folder OvalSight on a selected first-level folder and optionally limit the scan to the second level.

Data Lake OvalSight

Data Lake OvalSight helps analyze folder structures and file details in data lakes like S3, ADL, Google Drive, NFS, and CIFS. It shows folder and file statistics, file types, sizes, and modification history. Users can view insights through dashboards, list and tree views, and schedule scans to monitor changes and data distribution across folders.

For more information on Data Lake OvalSight please click here.

---

Copyright © 2025, OvalEdge LLC, Peachtree Corners, GA USA