Automation for Data Accessioner, XSLTProcessor, hashlib, OpenShield, and DART.

Data Accessioner

• Transfers files from disks onto a file server
• Output: XML file and the full directory from the input
• How the function works:
  • Recursively copies or moves files from the input directory
  • Preserves the original file timestamps
  • Generates an XML report
  • Recreates the full directory structure from the input directory
• Sample output:

XSLT Processor

• Parses the report from Data Accessioner
• Output: CSV and HTML reports
• How the function works:
  • Transfroms the XML report from previous function into a CSV and HTML report
• Sample output

  • CSV:

  • HTML:

Hashlib function

• Parses the report from Data Accessioner, creates a list of files and their checksums, then validates those checksums with the checksums on the disk
• Output: CSV and log report
• How the function works:
  • Recomputes MD5 checksums for all of the files in the input directory
  • Compares original checksum to stored checksum
  • Flags MISSING, MISMATCH, or ERROR (OK if they match)
• Sample output

  • CSV:

  • Log:

Virus scanning

• Runs Open Shield, a simple and fast antivirus check written in Python and using a database from MalwareBazaar.

Bagging function (optional)

• Bundles files and metadata based on APTrust's Digital Archivist's Resource Tool (DART).

This project mimics these 5 programs for automation.