mirror of
https://github.com/XRPLF/rippled.git
synced 2026-09-30 16:58:30 +00:00
Merge branch 'pratik/otel-phase10-workload-validation' into pratik/otel-sync-diagnostics
Brings phase-10 up to f13524c93c, one commit: every harness failure now maps to
exit 2 and timings are captured unconditionally.
Merged clean -- git reported no conflicts, so no resolution decisions were made
here. Two incoming files, run-full-validation.sh and the runbook. No runtime C++,
no include changes, no change to either expected_*.json contract.
Relevant to this branch: the previous run failed the job through the regression
gate while the validation suite itself passed 264/264, and the failing step was
the reporter keying on the validation step's outcome rather than anything the
suite reported. A single exit code for every harness failure makes which stage
failed legible from the exit status instead of only from the log.
This commit is contained in:
@@ -4631,15 +4631,15 @@ docker/telemetry/workload/run-full-validation.sh --cleanup
|
||||
|
||||
Harness options (`run-full-validation.sh`):
|
||||
|
||||
| Flag | Default | Effect |
|
||||
| ------------------- | ----------------- | ----------------------------------------------------------------------------------------------------------------------------------------- |
|
||||
| `--xrpld PATH` | `.build/xrpld` | Binary to run. Also settable via the `XRPLD` env var. |
|
||||
| `--nodes NUM` | `5` | Size of the local validator cluster. |
|
||||
| `--profile NAME` | `full-validation` | Load profile from `workload-profiles.json` (`full-validation`, `quick-smoke`, `stress`). This is the **only** thing that sets load shape. |
|
||||
| `--skip-loki` | off | Skip the log-trace correlation checks and their per-leg diagnostics. Local exploration only; CI does not pass this. |
|
||||
| `--skip-regression` | off | Skip timing capture and the baseline comparison. Local exploration only. |
|
||||
| `--with-benchmark` | off | Also run `benchmark.sh` (telemetry-off vs telemetry-on overhead) after validation. |
|
||||
| `--cleanup` | — | Tear everything down and exit. |
|
||||
| Flag | Default | Effect |
|
||||
| ------------------- | ----------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------- |
|
||||
| `--xrpld PATH` | `.build/xrpld` | Binary to run. Also settable via the `XRPLD` env var. |
|
||||
| `--nodes NUM` | `5` | Size of the local validator cluster. |
|
||||
| `--profile NAME` | `full-validation` | Load profile from `workload-profiles.json` (`full-validation`, `quick-smoke`, `stress`). This is the **only** thing that sets load shape. |
|
||||
| `--skip-loki` | off | Skip the log-trace correlation checks and their per-leg diagnostics. Local exploration only; CI does not pass this. |
|
||||
| `--skip-regression` | off | Skip the baseline comparison. Timings are still captured, so the run still leaves a `timings.json` artifact to refresh the baseline from. Local exploration only. |
|
||||
| `--with-benchmark` | off | Also run `benchmark.sh` (telemetry-off vs telemetry-on overhead) after validation. |
|
||||
| `--cleanup` | — | Tear everything down and exit. |
|
||||
|
||||
`--rpc-rate`, `--rpc-duration`, `--tx-tps` and `--tx-duration` are accepted by the
|
||||
parser but **never read** — they predate profiles and have no effect. Use
|
||||
@@ -4647,7 +4647,9 @@ parser but **never read** — they predate profiles and have no effect. Use
|
||||
|
||||
Exit codes: `0` all checks and the regression gate passed; `1` a validation check
|
||||
failed or the gate detected a regression; `2` infrastructure error (stack or
|
||||
cluster did not come up, or timing capture failed).
|
||||
cluster did not come up, or timing capture failed while the regression gate was
|
||||
active). Every `die` in the script exits 2, including a bad command line, so read
|
||||
`die` rather than this summary if the two ever disagree.
|
||||
|
||||
### What Gets Validated
|
||||
|
||||
|
||||
Reference in New Issue
Block a user