Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve Incremental Release Benchmarks #188

Open
stanbrub opened this issue Oct 18, 2023 · 0 comments
Open

Improve Incremental Release Benchmarks #188

stanbrub opened this issue Oct 18, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@stanbrub
Copy link
Collaborator

As of now, most operational benchmarks are run in two ways; from static data, from incrementally released data. The latter has been virtually ignored in analysis of benchmarks. This is partly because incremental release doesn't compare well with other products. There is also a lack of confidence in the incremental benchmarks.

  • Investigate the impact of changing the initial release (recent feedback says it's better to release too little than too much)
  • Look at using a percentage of total rows, or an initial released row count based on the static run
@stanbrub stanbrub added the enhancement New feature or request label Oct 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant