-
Notifications
You must be signed in to change notification settings - Fork 32
Open
Description
We need to establish that the benchmark-ledger-ops
analysis of db-analyser
are useful in spotting potential performance regressions or optimizations. For that, we need its results to be reproducible and meaningful.
We need to run the benchmark-ledger-ops
analysis with the same build, data, machine, and workload and corroborate if the runs have small enough variance among each other. Additionally, we need to make sure the input data is suitable to clearly reveal any measurable changes wrt. ledger ops.
Requires #230
Acceptance criteria
- A set of input data is identified that:
- Reveals known performance problems.
- Exhibits low variance among runs.
Subtasks
- Validate that
benchmark-ledger-ops
exhibits the same mutator times as a running node. (eg Issue Compare --benchmark-ledger-ops to measurements of the actual node #1272) - Ensure we use the same RTS flags as
cardano-node
only for benchmark-specific invocations (which can be done in tools such asbeacon
or invocation scripts). - Calibrate and generate a useful set of input data (P&T)
- Feed this data to the variance analysis of P&T.
Metadata
Metadata
Assignees
Labels
No labels
Type
Projects
Status
No status