Agent: unable to upload empty folders

[sanderegg]

The agent is unable to upload empty folders in code-server???

workaround (very painful):

docker run --rm -it -v dyv_1697094730_0a62461b-5059-4851-b070-d193d5569e8c_deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79_ecapskrow_krow_ums_emoh_:/vol busybox

# then delete the problematic folders
# restart agent

FYI @YuryHrytsuk

Shell subprocesses yielded nonzero error code 1 for command rclone --config /tmp/rclone_config.ini --low-level-retries 3 --retries 3 --transfers 5 --use-mmap --buffer-size 0M --stats 5s --stats-one-line sync /docker/volumes/dyv_1697094730_0a62461b-5059-4851-b070-d193d5569e8c_deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79_ecapskrow_krow_ums_emoh_/_data dst:/osparc-simcore-zombie-dy-volume-saves/production-simcore/ce661520-641e-11ee-9fe7-02420a0bfeeb/deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79/1697094730_0a62461b-5059-4851-b070-d193d5569e8c/home_smu_work_workspace_97dd5b69c8 --verbose --exclude .hidden_do_not_remove --exclude key_values.json
2024/10/21 08:07:21 ERROR : .config/code-server/Machine: failed to open directory ".config/code-server/Machine": open /docker/volumes/dyv_1697094730_0a62461b-5059-4851-b070-d193d5569e8c_deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79_ecapskrow_krow_ums_emoh_/_data/.config/code-server/Machine: permission denied
2024/10/21 08:07:21 ERROR : .config/code-server/extensions: failed to open directory ".config/code-server/extensions": open /docker/volumes/dyv_1697094730_0a62461b-5059-4851-b070-d193d5569e8c_deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79_ecapskrow_krow_ums_emoh_/_data/.config/code-server/extensions: permission denied
2024/10/21 08:07:21 ERROR : .config/code-server/User/globalStorage: failed to open directory ".config/code-server/User/globalStorage": open /docker/volumes/dyv_1697094730_0a62461b-5059-4851-b070-d193d5569e8c_deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79_ecapskrow_krow_ums_emoh_/_data/.config/code-server/User/globalStorage: permission denied
2024/10/21 08:07:21 ERROR : .config/code-server/User/History: failed to open directory ".config/code-server/User/History": open /docker/volumes/dyv_1697094730_0a62461b-5059-4851-b070-d193d5569e8c_deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79_ecapskrow_krow_ums_emoh_/_data/.config/code-server/User/History: permission denied
2024/10/21 08:07:22 ERROR : S3 bucket osparc-simcore-zombie-dy-volume-saves path production-simcore/ce661520-641e-11ee-9fe7-02420a0bfeeb/deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79/1697094730_0a62461b-5059-4851-b070-d193d5569e8c/home_smu_work_workspace_97dd5b69c8: not deleting files as there were IO errors
2024/10/21 08:07:22 ERROR : S3 bucket osparc-simcore-zombie-dy-volume-saves path production-simcore/ce661520-641e-11ee-9fe7-02420a0bfeeb/deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79/1697094730_0a62461b-5059-4851-b070-d193d5569e8c/home_smu_work_workspace_97dd5b69c8: not deleting directories as there were IO errors
2024/10/21 08:07:22 ERROR : Attempt 1/3 failed with 5 errors and: not deleting files as there were IO errors
2024/10/21 08:07:22 ERROR : .config/code-server/Machine: failed to open directory ".config/code-server/Machine": open /docker/volumes/dyv_1697094730_0a62461b-5059-4851-b070-d193d5569e8c_deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79_ecapskrow_krow_ums_emoh_/_data/.config/code-server/Machine: permission denied
2024/10/21 08:07:22 ERROR : .config/code-server/extensions: failed to open directory ".config/code-server/extensions": open /docker/volumes/dyv_1697094730_0a62461b-5059-4851-b070-d193d5569e8c_deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79_ecapskrow_krow_ums_emoh_/_data/.config/code-server/extensions: permission denied
2024/10/21 08:07:22 ERROR : .config/code-server/User/globalStorage: failed to open directory ".config/code-server/User/globalStorage": open /docker/volumes/dyv_1697094730_0a62461b-5059-4851-b070-d193d5569e8c_deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79_ecapskrow_krow_ums_emoh_/_data/.config/code-server/User/globalStorage: permission denied
2024/10/21 08:07:22 ERROR : .config/code-server/User/History: failed to open directory ".config/code-server/User/History": open /docker/volumes/dyv_1697094730_0a62461b-5059-4851-b070-d193d5569e8c_deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79_ecapskrow_krow_ums_emoh_/_data/.config/code-server/User/History: permission denied
2024/10/21 08:07:22 ERROR : S3 bucket osparc-simcore-zombie-dy-volume-saves path production-simcore/ce661520-641e-11ee-9fe7-02420a0bfeeb/deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79/1697094730_0a62461b-5059-4851-b070-d193d5569e8c/home_smu_work_workspace_97dd5b69c8: not deleting files as there were IO errors
2024/10/21 08:07:22 ERROR : S3 bucket osparc-simcore-zombie-dy-volume-saves path production-simcore/ce661520-641e-11ee-9fe7-02420a0bfeeb/deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79/1697094730_0a62461b-5059-4851-b070-d193d5569e8c/home_smu_work_workspace_97dd5b69c8: not deleting directories as there were IO errors
2024/10/21 08:07:22 ERROR : Attempt 2/3 failed with 5 errors and: not deleting files as there were IO errors
2024/10/21 08:07:22 ERROR : .config/code-server/extensions: failed to open directory ".config/code-server/extensions": open /docker/volumes/dyv_1697094730_0a62461b-5059-4851-b070-d193d5569e8c_deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79_ecapskrow_krow_ums_emoh_/_data/.config/code-server/extensions: permission denied
2024/10/21 08:07:22 ERROR : .config/code-server/Machine: failed to open directory ".config/code-server/Machine": open /docker/volumes/dyv_1697094730_0a62461b-5059-4851-b070-d193d5569e8c_deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79_ecapskrow_krow_ums_emoh_/_data/.config/code-server/Machine: permission denied
2024/10/21 08:07:22 ERROR : .config/code-server/User/History: failed to open directory ".config/code-server/User/History": open /docker/volumes/dyv_1697094730_0a62461b-5059-4851-b070-d193d5569e8c_deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79_ecapskrow_krow_ums_emoh_/_data/.config/code-server/User/History: permission denied
2024/10/21 08:07:22 ERROR : .config/code-server/User/globalStorage: failed to open directory ".config/code-server/User/globalStorage": open /docker/volumes/dyv_1697094730_0a62461b-5059-4851-b070-d193d5569e8c_deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79_ecapskrow_krow_ums_emoh_/_data/.config/code-server/User/globalStorage: permission denied
2024/10/21 08:07:22 ERROR : S3 bucket osparc-simcore-zombie-dy-volume-saves path production-simcore/ce661520-641e-11ee-9fe7-02420a0bfeeb/deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79/1697094730_0a62461b-5059-4851-b070-d193d5569e8c/home_smu_work_workspace_97dd5b69c8: not deleting files as there were IO errors
2024/10/21 08:07:22 ERROR : S3 bucket osparc-simcore-zombie-dy-volume-saves path production-simcore/ce661520-641e-11ee-9fe7-02420a0bfeeb/deb9fbb0-8f00-4c93-aaf2-7f8c96b5dd79/1697094730_0a62461b-5059-4851-b070-d193d5569e8c/home_smu_work_workspace_97dd5b69c8: not deleting directories as there were IO errors
2024/10/21 08:07:22 ERROR : Attempt 3/3 failed with 5 errors and: not deleting files as there were IO errors
2024/10/21 08:07:22 INFO  :           0 B / 0 B, -, 0 B/s, ETA -
2024/10/21 08:07:22 Failed to sync with 5 errors: last error was: not deleting files as there were IO errors