Problem: Unable to start SIP in Appraisal Tab using ArchivesSpace sub-tab

[ross-spencer]

Testing with @kellyannewithane @sromkey and we have found that we cannot currently start a SIP from the ArchivesSpace sub-tab in the Appraisal tab of Archivematica.

The warning that is shown in the Appraisal tab is as follows:

Unable to start SIP; check dashboard logs.

@mamedin had a look at the dashboard logs per those instructions and we only see the following:

DEBUG     2017-12-20 17:06:09  archivematica.common:storageService:get_location:168:  Storage locations returned: [{u’uuid’: u'1a7e263b-78b2-4077-af97-1c0e8f05625b’, u’pipeline’: [u’/api/v2/pipeline/fd36026e-333d-4855-a219-3063e4ee4610/‘], u’used’: u'0', u’description’: u’/home’, u’space’: u’/api/v2/space/8f2fff4d-d858-41c7-9471-e1c57a968500/‘, u’enabled’: True, u’quota’: None, u’relative_path’: u’home’, u’purpose’: u’TS’, u’path’: u’/home’, u’resource_uri’: u’/api/v2/location/1a7e263b-78b2-4077-af97-1c0e8f05625b/‘}]
DEBUG     2017-12-20 17:06:10  archivematica.dashboard:views:_prepare_browse_response:83:  Properties for ubuntu: {u’object count’: 3, u’size’: 4096}
DEBUG     2017-12-20 17:06:10  archivematica.dashboard:views:_prepare_browse_response:83:  Properties for artefactual: {u’object count’: 2120, u’size’: 4096}
INFO      2017-12-20 17:06:17  elasticsearch:base:log_request_success:63:  PUT http://127.0.0.1:9200/aips [status:400 request:0.005s]
INFO      2017-12-20 17:06:17  elasticsearch:base:log_request_success:63:  PUT http://127.0.0.1:9200/transfers [status:400 request:0.003s]
INFO      2017-12-20 17:06:17  elasticsearch:base:log_request_success:63:  GET http://127.0.0.1:9200/transfers/_mapping/transferfile [status:200 request:0.004s]
INFO      2017-12-20 17:06:17  elasticsearch:base:log_request_success:63:  GET http://127.0.0.1:9200/aips/_mapping/aipfile [status:200 request:0.005s]
INFO      2017-12-20 17:06:17  elasticsearch:base:log_request_success:63:  GET http://127.0.0.1:9200/transfers/transfer/_search?fields=uuid%2Cstatus [status:200 request:0.005s]
INFO      2017-12-20 17:06:18  elasticsearch:base:log_request_success:63:  PUT http://127.0.0.1:9200/aips [status:400 request:0.005s]
INFO      2017-12-20 17:06:18  elasticsearch:base:log_request_success:63:  PUT http://127.0.0.1:9200/transfers [status:400 request:0.004s]
INFO      2017-12-20 17:06:18  elasticsearch:base:log_request_success:63:  GET http://127.0.0.1:9200/transfers/_mapping/transferfile [status:200 request:0.007s]
INFO      2017-12-20 17:06:18  elasticsearch:base:log_request_success:63:  GET http://127.0.0.1:9200/aips/_mapping/aipfile [status:200 request:0.006s]
INFO      2017-12-20 17:06:18  elasticsearch:base:log_request_success:63:  GET http://127.0.0.1:9200/transfers/transferfile/_search?size=0 [status:200 request:0.008s]
INFO      2017-12-20 17:06:18  elasticsearch:base:log_request_success:63:  GET http://127.0.0.1:9200/transfers/transfer/_search?search_type=count [status:200 request:0.008s]
INFO      2017-12-20 17:06:18  elasticsearch:base:log_request_success:63:  GET http://127.0.0.1:9200/transfers/transfer/_search?sort=name%3Aasc&size=10&from=0&_source=name%2Cuuid%2Cfile_count%2Cingest_date [status:200 request:0.018s]
DEBUG     2017-12-20 17:06:21  archivematica.dashboard:views:_prepare_browse_response:83:  Properties for -repositories-2-archival_objects-9285883f491d-f3f3-4684-95fe-08afa681137a: {‘object count’: 1}
INFO      2017-12-20 17:06:27  elasticsearch:base:log_request_success:63:  PUT http://127.0.0.1:9200/aips [status:400 request:0.004s]
INFO      2017-12-20 17:06:27  elasticsearch:base:log_request_success:63:  PUT http://127.0.0.1:9200/transfers [status:400 request:0.003s]
INFO      2017-12-20 17:06:27  elasticsearch:base:log_request_success:63:  GET http://127.0.0.1:9200/transfers/_mapping/transferfile [status:200 request:0.003s]
INFO      2017-12-20 17:06:27  elasticsearch:base:log_request_success:63:  GET http://127.0.0.1:9200/aips/_mapping/aipfile [status:200 request:0.005s]
INFO      2017-12-20 17:06:27  elasticsearch:base:log_request_success:63:  GET http://127.0.0.1:9200/transfers/transferfile/_search?size=50000 [status:200 request:0.010s]
INFO      2017-12-20 17:07:04  archivematica.dashboard:views:copy_to_arrange:759:  sources: [‘/originals/spencer-77ee7b01-468e-4ce5-8ca6-c4d8f8c7b5c6/objects/piiTestDataCreditCardNumbers.txt’]
INFO      2017-12-20 17:07:04  archivematica.dashboard:views:copy_to_arrange:760:  destinations: [‘/arrange/-repositories-2-archival_objects-9285883f491d-f3f3-4684-95fe-08afa681137a/digital_object_component_2/piiTestDataCreditCardNumbers.txt’]
DEBUG     2017-12-20 17:07:05  archivematica.common:storageService:get_location:168:  Storage locations returned: [{u’uuid’: u’c1c9a06e-1f76-4826-9684-90d0df2a531e’, u’pipeline’: [u’/api/v2/pipeline/fd36026e-333d-4855-a219-3063e4ee4610/‘], u’used’: u'5809102', u’description’: u’Default transfer backlog’, u’space’: u’/api/v2/space/8f2fff4d-d858-41c7-9471-e1c57a968500/‘, u’enabled’: True, u’quota’: None, u’relative_path’: u’var/archivematica/sharedDirectory/www/AIPsStore/transferBacklog’, u’purpose’: u’BL’, u’path’: u’/var/archivematica/sharedDirectory/www/AIPsStore/transferBacklog’, u’resource_uri’: u’/api/v2/location/c1c9a06e-1f76-4826-9684-90d0df2a531e/’}]
INFO      2017-12-20 17:07:05  archivematica.dashboard:views:copy_files_to_arrange:713:  arrange_path: /arrange/-repositories-2-archival_objects-9285883f491d-f3f3-4684-95fe-08afa681137a/digital_object_component_2/piiTestDataCreditCardNumbers.txt
DEBUG     2017-12-20 17:07:05  archivematica.dashboard:views:copy_files_to_arrange:714:  files to be added: [{‘original_path’: ‘originals/spencer-77ee7b01-468e-4ce5-8ca6-c4d8f8c7b5c6/objects/piiTestDataCreditCardNumbers.txt’, ‘file_uuid’: u’fe7abf07-aef8-4de6-b3f5-3ecb7bdcb7aa’, ‘transfer_uuid’: u'77ee7b01-468e-4ce5-8ca6-c4d8f8c7b5c6', ‘arrange_path’: ‘/arrange/-repositories-2-archival_objects-9285883f491d-f3f3-4684-95fe-08afa681137a/digital_object_component_2/piiTestDataCreditCardNumbers.txt’}]
INFO      2017-12-20 17:07:11  archivematica.dashboard:views:copy_to_arrange:759:  sources: [‘/originals/spencer-77ee7b01-468e-4ce5-8ca6-c4d8f8c7b5c6/objects/piiTestDataPhoneNumbers.txt’]
INFO      2017-12-20 17:07:11  archivematica.dashboard:views:copy_to_arrange:760:  destinations: [‘/arrange/-repositories-2-archival_objects-9285883f491d-f3f3-4684-95fe-08afa681137a/digital_object_component_3/piiTestDataPhoneNumbers.txt’]
DEBUG     2017-12-20 17:07:11  archivematica.common:storageService:get_location:168:  Storage locations returned: [{u’uuid’: u’c1c9a06e-1f76-4826-9684-90d0df2a531e’, u’pipeline’: [u’/api/v2/pipeline/fd36026e-333d-4855-a219-3063e4ee4610/‘], u’used’: u'5809102', u’description’: u’Default transfer backlog’, u’space’: u’/api/v2/space/8f2fff4d-d858-41c7-9471-e1c57a968500/‘, u’enabled’: True, u’quota’: None, u’relative_path’: u’var/archivematica/sharedDirectory/www/AIPsStore/transferBacklog’, u’purpose’: u’BL’, u’path’: u’/var/archivematica/sharedDirectory/www/AIPsStore/transferBacklog’, u’resource_uri’: u’/api/v2/location/c1c9a06e-1f76-4826-9684-90d0df2a531e/’}]
INFO      2017-12-20 17:07:11  archivematica.dashboard:views:copy_files_to_arrange:713:  arrange_path: /arrange/-repositories-2-archival_objects-9285883f491d-f3f3-4684-95fe-08afa681137a/digital_object_component_3/piiTestDataPhoneNumbers.txt
DEBUG     2017-12-20 17:07:11  archivematica.dashboard:views:copy_files_to_arrange:714:  files to be added: [{‘original_path’: ‘originals/spencer-77ee7b01-468e-4ce5-8ca6-c4d8f8c7b5c6/objects/piiTestDataPhoneNumbers.txt’, ‘file_uuid’: u'0715bcb6-e021-440d-b6c0-e7bdae28fcfd’, ‘transfer_uuid’: u'77ee7b01-468e-4ce5-8ca6-c4d8f8c7b5c6', ‘arrange_path’: ‘/arrange/-repositories-2-archival_objects-9285883f491d-f3f3-4684-95fe-08afa681137a/digital_object_component_3/piiTestDataPhoneNumbers.txt’}]
DEBUG     2017-12-20 17:07:15  archivematica.dashboard:views:access_arrange_start_sip:437:  archival object {u’lock_version’: 1, u’external_documents’: [], u’extents’: [], u’jsonmodel_type’: u’archival_object’, u’ref_id’: u'32b536a14dd5bdd10bc4cc22c56eb673', u’instances’: [], u’create_time’: u'2017-12-19T20:11:29Z’, u’parent’: {u’ref’: u’/repositories/2/archival_objects/9281'}, u’title’: u’Sub-series 2', u’display_string’: u’Sub-series 2', u’created_by’: u’archivematica’, u’subjects’: [], u’system_mtime’: u'2017-12-20T16:07:25Z’, u’linked_agents’: [], u’repository’: {u’ref’: u’/repositories/2'}, u’has_unpublished_ancestor’: False, u’user_mtime’: u'2017-12-19T20:11:29Z’, u’rights_statements’: [], u’linked_events’: [], u’external_ids’: [], u’suppressed’: False, u’dates’: [], u’resource’: {u’ref’: u’/repositories/2/resources/114'}, u’level’: u’subseries’, u’notes’: [], u’uri’: u’/repositories/2/archival_objects/9285', u’last_modified_by’: u’archivematica’, u’restrictions_apply’: False, u’position’: 0}
DEBUG     2017-12-20 17:07:15  archivematica.dashboard:views:access_arrange_start_sip:440:  resource {u’lock_version’: 1, u’external_documents’: [], u’extents’: [{u’lock_version’: 0, u’system_mtime’: u'2017-12-19T19:52:37Z’, u’jsonmodel_type’: u’extent’, u’user_mtime’: u'2017-12-19T19:52:37Z’, u’number’: u'2600', u’last_modified_by’: u’archivematica’, u’portion’: u’whole’, u’create_time’: u'2017-12-19T19:52:37Z’, u’created_by’: u’archivematica’, u’extent_type’: u’gigabytes’}], u’jsonmodel_type’: u’resource’, u’instances’: [], u’create_time’: u'2017-12-19T19:49:19Z’, u’publish’: True, u’title’: u’spencer’, u’related_accessions’: [], u’created_by’: u’archivematica’, u’subjects’: [], u’deaccessions’: [], u’system_mtime’: u'2017-12-19T19:52:37Z’, u’linked_agents’: [], u’repository’: {u’ref’: u’/repositories/2'}, u’user_mtime’: u'2017-12-19T19:52:37Z’, u’rights_statements’: [], u’revision_statements’: [], u’linked_events’: [], u’external_ids’: [], u’suppressed’: False, u’restrictions’: False, u’dates’: [{u’lock_version’: 0, u’system_mtime’: u'2017-12-19T19:52:37Z’, u’jsonmodel_type’: u’date’, u’date_type’: u’single’, u’user_mtime’: u'2017-12-19T19:52:37Z’, u’last_modified_by’: u’archivematica’, u’label’: u’creation’, u’create_time’: u'2017-12-19T19:52:37Z’, u’created_by’: u’archivematica’, u’expression’: u’From the beginning to the end of time. ‘}], u’classifications’: [], u’language’: u’eng’, u’level’: u’fonds’, u’notes’: [], u’tree’: {u’ref’: u’/repositories/2/resources/114/tree’}, u’uri’: u’/repositories/2/resources/114', u’last_modified_by’: u’archivematica’, u’id_2': u’two’, u’id_3': u’three’, u’id_0': u’spencer’, u’id_1': u’one’, u’resource_type’: u’records’}

This is how it manifests visually on two separate environments:

To recreate this, we:

• Connect to ArchivesSpace and look for the 'Example' Repository
• Create a series/subseries layout as shown in the images
• Create a new 'digital object'
• Drag a digital object onto this folder
• Click 'Finalize arrangement'

[jhsimpson]

This may be related to artefactual-labs/am#18

Can you take a look at that issue @ross-spencer and see if the ArchivesSpace instance you are testing with has all the required metadata in place? In particular, I would check if there is an Agent defined for the parent resource.

[ross-spencer]

@jhsimpson this is really helpful thank you. I aim to check first thing in the morning.

[ross-spencer]

Additional info to investigate here: https://wiki.archivematica.org/ArchivesSpace_integration

[ross-spencer]

One of our test Resources in ArchivesSpace:

[ross-spencer]

Having reviewed the available information, we can successfully start a SIP from the ArchivesSpace appraisal tab in Archivematica when the ArchivesSpace default values are filled in, plus, an Agent is linked to the collection/resource level item, e.g. fonds/series.

This minimum amount of information results in the following when the SIP is submitted:

As such, this issue can be closed without any further resolution being required.