Crash when caching used in multiple processes

[sandorkertesz]

What happened?

When earthkit-data is used simultaneously in multiple processes to retrieve fdb data it crashes with:

OperationalError('database is locked')

It comes from the sqlite database used for indexing the cached files.

This happens when caching-policy is "user". In this case each process running under the same account uses the same cache area/database.

What are the steps to reproduce the bug?

See above

Version

lates

Platform (OS and architecture)

all

Relevant log output

No response

Accompanying data

No response

Organisation

No response

[sandorkertesz]

Could not reproduce this issue when retrieving MARS data or downloading data from URLS using 12 processes on a MacBook.