Archiving Audit Trail Data

Audit Data Archival is the process of transferring older logs from the OvalEdge database to a dedicated storage location. These logs capture all application activities and grow significantly over time, consuming storage space and affecting performance. Archiving ensures that outdated logs are moved to mass storage and later deleted, freeing up disk space and maintaining optimal system performance.

How Audit Data Archival Works

1. Navigate to Administration > System Settings and click the Audit Data Archival tab.

   
2. By default, OvalEdge archives all tables daily at 2:00 AM.

3. Administrators can enable archival for specific data objects by:

4. Selecting the Enable Archival checkbox.

5. Specifying the table name.

6. Defining the retention period (1 month to 1 year).

7. Once the retention period expires, the archived logs are automatically removed from the OvalEdge database.

Example: Suppose the audit log for the Lineage table is set with a retention period of 3 months.

• Logs older than 3 months are moved to archival storage.

• After the retention period ends, these logs are deleted automatically.

• This process ensures that the database retains only recent, relevant audit data, thereby maintaining stable performance.

Archiving Policy:

• Retention Period: Users can specify how long it takes to retain logs (default: 2 years). Logs exceeding this period are automatically deleted.

• Archive Format: Users can choose between CSV or SQL formats for archived data.

Audit Data Archival Configuration Details:

• Add Archival Policy – Select the table to be archived and specify the retention period in days.

• Current Row Count / Row Count – Displays the total number of audit trail entries currently stored.

• Retention Row Limit – The maximum number of rows allowed before archival begins.

• Retention Period (days) – Defines how long data is retained before archival or deletion.

• Processing Batch Size – The number of rows processed in each archival batch.

• CSV/SQL – Shows the selected archive format (CSV file or SQL script).

• Last Archive Date / Last Archived On – The date when the data object was last archived.

• Last Archived Rows – The number of rows archived during the last execution.

• Last Processed Date – The date when the data object was last processed for archival.

• Last Execution Status – The outcome of the most recent execution (success or failure).

• Last Run Error – The error details, if the last execution failed.

• Last Execution Start & End Time – The timestamps marking when the execution started and ended.

• Execution Duration (ms) – The total time taken to complete the last execution in milliseconds.

• Executed By – The user who initiated the archival job.

Disabling Audit Data Archival

To disable the Audit Data Archival feature:

1. Navigate to Administration > Schedule.

2. Select the Data Retention Thread Schedule and check the Active status.

   
3. If the status is Yes:

4. Click the Edit icon beside the schedule name.

5. The Update Cron Entry pop-up appears.

   
6. At the top right, set the status to Inactive using the toggle button.

   
7. Click Save Entry.

8. The Active status updates to No, and the data retention thread is disabled.