Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

All algorithms should count Oracle Complexities (and deterministic time) #260

Open
pokutta opened this issue Nov 5, 2021 · 0 comments
Open
Labels
enhancement New feature or request performance testing Testing

Comments

@pokutta
Copy link
Member

pokutta commented Nov 5, 2021

All algorithms should count and report in the state structure:

  1. Number of first-order oracle calls so far \nabla f(x)
  2. Number of zeroth-order oracle calls so far f(x)
  3. Number of LMO calls so far computer_extreme_points
  4. Number of active set accesses (if active set is used - otherwise simply report 0)

so that we can measure run time performance also in these typical measures. Note that many, except for maybe the most basic FW algorithms, might have more or less of 1 - 4 per iteration

We should then also in unit test check the number of oracle calls that should be done for certain tests to make sure that a change to the code did not (unintentionally) affects the algorithms' behavior.

I also would like to derive a notion of deterministic time from these measures -> to be discussed separately.

@pokutta pokutta added enhancement New feature or request performance testing Testing labels Nov 5, 2021
@pokutta pokutta changed the title All algorithms should count Oracle Complexities All algorithms should count Oracle Complexities (and deterministic time) Nov 5, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request performance testing Testing
Projects
None yet
Development

No branches or pull requests

1 participant