Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add retry with backoff to toDrive #48

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

carderne
Copy link

I frequently hit into Google's queue limit (3000), so I've added some code to catch this and use an exponential backoff (starting at 10 minutes) before trying again.

I haven't checked if this is against Google's terms/code of conduct or anything. Very useful for me but no problem if you don't want to add it! :)

Copy link
Member

@12rambau 12rambau left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @carderne and sorry for not answering earlier. I took over the maintenance of geetools earlier this year and put lots of effort in refactoring it (working on a proper documentation now).
The new paradigm for the export extension is to remain aligned with the vanilla GEE API i.e. build Task objects that can then be fully managed by the server. In your implementation the client machine needs to remain open during the whole process which is not the direction I (yes I know it's opinionated) I decided to follow.

I will leave this PR on stale and transfer the main idea to a tutorial.

Once it will be moved to the documentation I think I'll close it.

Again thanks a lot for your contribution, if you are still playing with GEE I would be happy to review another improvement proposal and don't hesitate to pass by if you face any bugs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants