adding pre and post processing options which are unrelated to the ind… #258
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…ividual benchmark the issue is that fujitsu-mpi does not redirect to stdout, and on fugaku a usual workaround via -of|-std flags is currently disabled by the ops team and therefore we can at best redirect to a merged file of stdout+strerr for each rank via -std-proc so, the general ramble approach of `mpi_command exec >> log_file` does not work; pre_cmd and post_cmd don't work either, because they are part of the benchmark or part of a modifier (which isnt the case for an mpi) currently, only way i see to add this is via these pre_process and post_process variables which might be useful for others in the future, too redirect mpi output on fugaku
github-actions
bot
added
experiment
|
I'm currently working on a PR to address the conflicts here as well as add a few other conveniences on top of #195. I should have it ready by end of Monday (June 10th) |
scheibelp
added a commit
to scheibelp/benchpark
that referenced
this pull request
Jun 11, 2024
pearce8
pushed a commit
that referenced
this pull request
Jun 25, 2024
* show example of not using allocation modifier * restore test config * I was hoping I could expand variables into lists; but I don't think that will work * variable naming consistency * refactor as multi-line strings vs string lists * add test config; demonstrates an odd behavior for expansion of multi-line strings * expand test config * needed for emulating #258 * missing space * style fix * style fix 2 * forgot to re-add argument with new format * relocate execute_experiment template
daboehme
pushed a commit
that referenced
this pull request
Jul 10, 2024
* show example of not using allocation modifier * restore test config * I was hoping I could expand variables into lists; but I don't think that will work * variable naming consistency * refactor as multi-line strings vs string lists * add test config; demonstrates an odd behavior for expansion of multi-line strings * expand test config * needed for emulating #258 * missing space * style fix * style fix 2 * forgot to re-add argument with new format * relocate execute_experiment template
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
…ividual benchmark
the issue is that fujitsu-mpi does not redirect to stdout, and on fugaku a usual workaround via -of|-std flags is currently disabled by the ops team and therefore we can at best redirect to a merged file of stdout+strerr for each rank via -std-proc
so, the general ramble approach of
mpi_command exec >> log_filedoes not work; pre_cmd and post_cmd don't work either, because they are part of the benchmark or part of a modifier (which isnt the case for an mpi)currently, only way i see to add this is via these pre_process and post_process variables which might be useful for others in the future, too
redirect mpi output on fugaku