only select pth files with prefix "model" as model checkpoint file #605
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
facebook-github-bot
added
CLA Signed
|
This pull request was exported from Phabricator. Differential Revision: D48021972 |
Summary: Pull Request resolved: facebookresearch#605 D2GO workflow async validation monitor the model checkpoint files *.pth in **e2e_train** folder (such as **model_0004999.pth**, **model_final.pth**) and launch async val operator as needed. All model files actually have prefix **"model"**. In some cases, there are non-model-checkpoint files also with pth file extension. To exclude them, add a filtering to check if the file prefix is "model". Differential Revision: D48021972 fbshipit-source-id: f1e3dc29c848082369d4b69f81c5081268ab41a7
stephenyan1231
force-pushed
the
export-D48021972
branch
from
31ddec5
to
0834c29
Compare
|
This pull request was exported from Phabricator. Differential Revision: D48021972 |
|
This pull request has been merged in 94c7f64. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary:
D2GO workflow async validation monitor the model checkpoint files *.pth in e2e_train folder (such as model_0004999.pth, model_final.pth) and launch async val operator as needed.
All model files actually have prefix "model". In some cases, there are non-model-checkpoint files also with pth file extension.
To exclude them, add a filtering to check if the file prefix is "model".
Differential Revision: D48021972