Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Lion optimizer and a "skip step" version of it #43

Merged
merged 14 commits into from
Sep 6, 2024
Merged

Add Lion optimizer and a "skip step" version of it #43

merged 14 commits into from
Sep 6, 2024

Commits on Sep 6, 2024

  1. Add Lion optimizer and a "skip step" version of it

    @epwalsh
    epwalsh committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    5a52c47 View commit details
    Browse the repository at this point in the history

  2. Add config classes

    @epwalsh
    epwalsh committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    276a4fb View commit details
    Browse the repository at this point in the history

  3. Integrate into trainer

    @epwalsh
    epwalsh committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    f7b6e76 View commit details
    Browse the repository at this point in the history

  4. changelog

    @epwalsh
    epwalsh committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    4fd8888 View commit details
    Browse the repository at this point in the history

  5. fix

    @epwalsh
    epwalsh committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    82d2c52 View commit details
    Browse the repository at this point in the history

  6. add test for Lion

    @epwalsh
    epwalsh committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    cc12cf0 View commit details
    Browse the repository at this point in the history

  7. refactor

    @epwalsh
    epwalsh committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    f6a5b5e View commit details
    Browse the repository at this point in the history

  8. record a metric for skipping steps

    @epwalsh
    epwalsh committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    067267c View commit details
    Browse the repository at this point in the history

  9. log to console

    @epwalsh
    epwalsh committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    d8bedfe View commit details
    Browse the repository at this point in the history

  10. fix config

    @epwalsh
    epwalsh committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    be93205 View commit details
    Browse the repository at this point in the history

  11. another fix

    @epwalsh
    epwalsh committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    f28ff2b View commit details
    Browse the repository at this point in the history

  12. improve how metric values of 0.0 are logged to console

    @epwalsh
    epwalsh committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    9c39484 View commit details
    Browse the repository at this point in the history

  13. fix?

    @epwalsh
    epwalsh committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    e56024d View commit details
    Browse the repository at this point in the history

  14. remove .abs() and avoid division by zero

    @epwalsh
    epwalsh committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    a14de85 View commit details
    Browse the repository at this point in the history