KBI 311636 Issue Addressed: Handle Large Volume Of Old Unprocessed Archive Data Files

Version

Argent Advanced Technology 5.1A-1804-A (C3) And Above

Date

Tuesday, 27 March 2018

Summary

When collecting Compliance data in an enterprise environment, Compliance reports might show up empty or incomplete for recent data ranges

See Empty Or Incomplete Compliance Reports

Further investigation shows there are a lot of unprocessed archive data file under directory ARCHIVE_DATA

If the file count is less than 3,000, they can be left untouched, as this is normal

The upgraded Engine can quickly process them and start bringing in new data

However, if the file count is over 3,000, it can take long time to catch up

For customers who needs the new data as soon as possible, do the following:

  1. Stop the Argent for Compliance Main Engine
  2. Rename directory ‘ARCHIVE_DATA’ to ‘ARCHIVE_DATA.OLD’
  3. Open Argent for Compliance main GUI and check the SQL Bulk Insert settings

    If it is not enabled, enable SQL Bulk Insert

  4. Start Argent for Compliance Main Engine
  5. At this point, Engine should start processing the newly coming archive data while old files sit under directory ‘ARCHIVE_DATA.OLD’ are not touched
  6. Start Command Prompt and change working directory to ArgentForCompliance
  7. Run command line:

    ARGSOFT_COMPLIANCE_PROCESS_ARCHIVE /folder=ARCHIVE_DATA.OLD

    Use argument ‘/?’ or ‘/help’ to show the command usage

  8. In the meantime, watch the archive data files in folder ‘ARCHIVE_DATA.OLD’ being processed sequentially

Technical Background

N/A

Resolution

Upgrade to Argent Advanced Technology 5.1A-1804-A (C3) or Above