Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for ablation studies. #1929

Open
jprokos26 opened this issue May 12, 2023 · 1 comment
Open

Add support for ablation studies. #1929

jprokos26 opened this issue May 12, 2023 · 1 comment

Comments

@jprokos26
Copy link
Contributor

jprokos26 commented May 12, 2023

I.e. take in a collection of config files (or optimally a set of learning-rates or base-images or just a generic list of kwargs to modify) and output a single result file with each in a separate "result" object.

@swsuggs
Copy link
Contributor

swsuggs commented May 15, 2023

Are you aware of Armory's sweep attack capability? It's not the exact same thing, but maybe partially meets this need. It sounds like you are looking for a full result for each parameter value, while the sweep attack goes from weakest to strongest and I believe it skips samples if they were successfully broken with weaker parameters.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants