SIP Processing of 2010Anthems FinalMixes on Transfer 12 - Archivematica 0.6.2 - 2011-01-13

Main Page > Vancouver Digital Archives > System Testing > SIP Processing of 2010Anthems FinalMixes on Transfer 12 - Archivematica 0.6.2 - 2011-01-13" on Transfer 8 - Archivematica 0.6.2 - 2011-01-13 Title

Date:2011-01-13

Conducted by: Glenn Dingwall

Purpose/Goal
Test of ingest using Archivematica 0.6.2


 * 2.4GB, 182 items from /Transfer12/Van2010_Anthem_Records/2010Anthems_FinalMixes - predominantly .wav sound files, and accompanying directory structure, but also including:
 * 1x .aif file /objects/zUnusedRejected_Versions/IRL Ireland National Anthem Ver2 Stereo.aif
 * 1x 1 zip container: /objects/GHANA_TONGA/Anthems.zip, containing 2 .wav files
 * Mac DS_Store files,
 * Some .wav files were removed from directories in order to reduce the size of the test case; the complete directory structure was retained. Some directories containing many .wav files were had the number of .wav files reduced to ~6-12 files. No files were deleted from directories containing 6 or fewer files.

Hardware/Software
Archivematica 0.6.2

DA LAN network consisting of: SIP UUID = 07be0b73-506b-4264-9431-439b26a5154e
 * 1 x Archivematica Server
 * 3 x Archivematica clients (Archivematica-1, Archivematica-2, Duplication Station)

Procedure

 * 1) Archivematica server and 3 clients still running after test conducted earlier today on /Day 27 Nov 25
 * 2) Prepare SIP
 * 3) Copy /Transfer12/Van2010_Anthem_Records/2010Anthems_FinalMixes to desktop
 * 4) Delete files from subdirectories in order to reduce size of SIP
 * 5) Run Restructure for Compliance command on /2010Anthems_FinalMixes'
 * 6) Run Add MD5 Checksum command on contents of /2010Anthems_FinalMixes/objects'
 * 7) Run Create DC within /2010Anthems_FinalMixes/metadata
 * 8) Copy and paste /2010Anthems_FinalMixes into /Receive SIP watched directory
 * 9) Processing Begins:
 * 10) Micro-Service: Create SIP backup -- Completed successfully
 * 11) Micro-Service: Verify SIP compliance -- Completed successfully
 * 12) Micro-Service: Assign file UUIDs and checksums -- Completed successfully
 * 13) Micro-Service: Verify metadata directory checksums -- Completed successfully
 * 14) Micro-Service: Prepare For Appraise SIP For Submission -- Completed successfully
 * 15) Micro-Service: Create or move DC -- Completed successfully
 * 16) Micro-Service: Appraise SIP For Submission -- Completed successfully
 * 17) Open appraiseSIPForSubmission/2010Anthems_FinalMixes
 * 18) Delete:
 * 19)  .../objects/.DS_Store (file)
 * 20) .../objects/z_UnUsedRejected_Versions (23 .wav files, 1 .aif file 434MB)
 * 21) Approve
 * 22) Micro-Service: Scan for removed files post appraise SIP for submission -- Completed successfully
 * 23) Micro-Service: Place in quarantine -- Completed successfully
 * 24) Micro-Service: Remove from Quarantine -- Completed successfully
 * 25) Micro-Service: Extract package -- Completed successfully
 * 26) Micro-Service: Detox filenames -- Completed successfully
 * 27) Micro-Service: Scan with ClamAV -- Completed successfully(*)
 * 28) Micro-Service: Characterizate and extract metadata -- Completed successfully
 * 29) Micro-Service: Prepare For Appraise SIP For Preservation -- Completed successfully
 * 30) Micro-Service: Appraise SIP For Preservation -- Completed successfully
 * 31) Open .../objects
 * 32) Delete all instances of /.DS_Store
 * 33) Delete .../GHANA_TOMGA/Anthems.zip
 * 34) Click "Approve"
 * 35) Micro-Service: Scan for removed files post appraise SIP for preservation -- Completed successfully
 * 36) Micro-Service: Create DIP director -- Completed successfullyy
 * 37) Micro-Service: Normalize -- Failed

END TEST

Results

 * 10 .wav files failed to normalize - reported as issue 368

Comments

 * ClamAV still not working even though the dashboard reports as "Completed successfully"

All error messages were of the type shown below: Task UUID: 000522e3-309d-4724-afed-540fca7ed913 File UUID: 2e08da85-03fe-40da-851e-48872dd0513f File name: ARM_Armenia_National_Anthem_5-1.wav Client: ica-atom normalize_v0.0 (exit code: 1)

NORMALIZING: ARM\_Armenia\_National\_Anthem\_5-1.wav {2e08da85-03fe-40da-851e-48872dd0513f} processing: /usr/bin/ffmpeg -i /var/archivematica/sharedDirectory/.currentlyProcessing/a103b9de-b36b-4c10-8993-03df9ae61fc0/SIPTest06\_2010Anthems\_FinalMixes-07be0b73-506b-4264-9431-439b26a5154e/objects/MULTIWAV\_5-1/ARM\_Armenia\_National\_Anthem\_5-1.wav -ab 192000 /var/archivematica/sharedDirectory/.currentlyProcessing/a103b9de-b36b-4c10-8993-03df9ae61fc0/SIPTest06\_2010Anthems\_FinalMixes-07be0b73-506b-4264-9431-439b26a5154e/DIP/objects/ARM\_Armenia\_National\_Anthem\_5-1.mp3 FFmpeg version SVN-r0.5.1-4:0.5.1-1ubuntu1, Copyright (c) 2000-2009 Fabrice Bellard, et al.  configuration: --extra-version=4:0.5.1-1ubuntu1 --prefix=/usr --enable-avfilter --enable-avfilter-lavf --enable-vdpau --enable-bzlib --enable-libgsm --enable-libschroedinger --enable-libspeex --enable-libtheora --enable-libvorbis --enable-pthreads --enable-zlib --disable-stripping --disable-vhook --enable-runtime-cpudetect --enable-gpl --enable-postproc --enable-swscale --enable-x11grab --enable-libdc1394 --enable-shared --disable-static libavutil    49.15. 0 / 49.15. 0  libavcodec    52.20. 1 / 52.20. 1  libavformat   52.31. 0 / 52.31. 0  libavdevice   52. 1. 0 / 52. 1. 0  libavfilter    0. 4. 0 / 0. 4. 0   libswscale     0. 7. 1 / 0. 7. 1   libpostproc   51. 2. 0 / 51. 2. 0  built on Mar  4 2010 12:35:30, gcc: 4.4.3 Input #0, wav, from '/var/archivematica/sharedDirectory/.currentlyProcessing/a103b9de-b36b-4c10-8993-03df9ae61fc0/SIPTest06\_2010Anthems\_FinalMixes-07be0b73-506b-4264-9431-439b26a5154e/objects/MULTIWAV\_5-1/ARM\_Armenia\_National\_Anthem\_5-1.wav': Duration: 00:01:07.71, bitrate: 6911 kb/s Stream #0.0: Audio: pcm\_s24le, 48000 Hz, 5.1, s16, 6912 kb/s Output #0, mp3, to '/var/archivematica/sharedDirectory/.currentlyProcessing/a103b9de-b36b-4c10-8993-03df9ae61fc0/SIPTest06\_2010Anthems\_FinalMixes-07be0b73-506b-4264-9431-439b26a5154e/DIP/objects/ARM\_Armenia\_National\_Anthem\_5-1.mp3': Stream #0.0: Audio: libmp3lame, 48000 Hz, 5.1, s16, 192 kb/s Stream mapping: Stream #0.0 -> #0.0 Error while opening codec for output stream #0.0 - maybe incorrect parameters such as bit\_rate, rate, width or height error code:1