Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable chunk-wise processing for all peaks data functions #306

Merged
merged 10 commits into from
Nov 30, 2023

Commits on Nov 20, 2023

  1. feat: add functionality enabling chunk processing by default

    - Refactor the code to decide how to split `Spectra` for parallel processing:
      it's no longer done automatically by `dataStorage`.
    - Add a slot to `Spectra` allowing to set a processing chunk size. Issue #304
    - With chunk-wise processing only the data of one chunk is realized to memory in
      each iteration. This also enables to process data in parallel.
    jorainer committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    37b8c99 View commit details
    Browse the repository at this point in the history
  2. refactor: move function

    jorainer committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    432efc2 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2023

  1. Configuration menu
    Copy the full SHA
    2e7366e View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2023

  1. feat: enable chunk-wise processing for peaks data operations

    - Add and modify functions to enable default chunk-wise processing of peaks
      data (issue #304).
    - Split the documentation for chunk-wise (parallel) processing into a separate
      documentation entry.
    jorainer committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    17e733f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    67c88e3 View commit details
    Browse the repository at this point in the history
  3. docs: fix version

    jorainer committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    72c65ea View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2023

  1. refactor: update function to all use the new chunk settings

    - Use `processingChunkFactor` instead of `dataStorage` in functions to define
      splitting and processing.
    - Remove unnecessary functions.
    - Add a vignette on parallel/chunk-wise processing.
    jorainer committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    e6a50c8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    194f104 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    0e555dc View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2023

  1. Configuration menu
    Copy the full SHA
    3ba908b View commit details
    Browse the repository at this point in the history