mirror of
https://github.com/XRPLF/rippled.git
synced 2026-07-30 10:30:22 +00:00
kSubMillisecondBoundaries existed but nothing used it, so per-fetch read latency never reached Grafana -- only the coarse read_mean_us gauge did, which cannot separate "every read took 9us" from "most took 2 and a few took 900". Add a nodestore_read_us histogram, register its view against the sub- millisecond ladder rather than kMicrosecondBoundaries (whose first edge is 100us, above the entire range a warm read occupies), and record into it from NodeStoreScheduler::onFetch using FetchReport::elapsed, which a previous change widened to microseconds for exactly this purpose. The name and its labels live in a new include/xrpl/telemetry header because the view registration (xrpld.telemetry) and the record site (xrpld.app) sit in different levelization modules; a copy-pasted literal would let them drift and silently drop the bucket override. Same reason and same placement as GetObjectMetricNames.h. No new levelization edge: xrpld.app > xrpl.telemetry already exists. NodeStoreScheduler had no registry access, so it now takes a ServiceRegistry and resolves the registry per call. It is constructed in Application's initializer list, long before metricsRegistry_ is assigned in setup() and started in startTelemetry(), so capturing a pointer at construction would capture nullptr forever; the metric macros null-check the registry, the meter and the instrument, so early fetches are simply not recorded. Labels are fetch_type and found, both already carried on the report -- 4 series, fixed at compile time. A slow async read delays prefetch while a slow sync read blocks a caller, and a miss can cost a read of every backend, so neither dimension can be collapsed. Negative elapsed times are skipped: the SDK rejects them and logs a warning on every call, which on a per-fetch path is a log flood. Zero is still recorded, since a page-cache-served read genuinely rounds to it. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
200 lines
7.2 KiB
C++
200 lines
7.2 KiB
C++
#pragma once
|
|
|
|
// cspell:ignore ISTOGRAM
|
|
// The all-caps macro name XRPL_METRIC_HISTOGRAM_RECORD trips cspell's
|
|
// compound-word splitter, which emits the subword "ISTOGRAM"; ignore it here.
|
|
|
|
/**
|
|
* Metric name, description, label key and label values for the per-fetch
|
|
* NodeStore read-latency histogram.
|
|
*
|
|
* The name is referenced from two translation units in two different
|
|
* levelization modules, which is why these constants live in a header rather
|
|
* than in either unit's unnamed namespace:
|
|
*
|
|
* NodeStoreMetricNames.h
|
|
* |
|
|
* +--> NodeStoreScheduler.cpp (xrpld.app -- the record site, via
|
|
* | XRPL_METRIC_HISTOGRAM_RECORD_LABELED)
|
|
* |
|
|
* +--> MetricsRegistry.cpp (xrpld.telemetry -- registers the
|
|
* explicit sub-millisecond bucket
|
|
* boundaries for the same name)
|
|
*
|
|
* A copy-pasted literal would let the two drift, and a drifted name silently
|
|
* drops the bucket override: the histogram would fall back to the SDK default
|
|
* boundaries, whose lowest edge is far above the single-digit-microsecond
|
|
* range a warm read occupies, so every warm read would land in bucket 0 and
|
|
* the distribution would read as flat. This mirrors the reason
|
|
* GetObjectMetricNames.h exists for the `getobject_*` family.
|
|
*
|
|
* Placed under `include/xrpl/telemetry/` for the same levelization reason as
|
|
* GetObjectMetricNames.h: `xrpld.app > xrpl.telemetry` and
|
|
* `xrpld.telemetry > xrpl.telemetry` are both existing edges (see
|
|
* `.github/scripts/levelization/results/ordering.txt`), so `include/xrpl/` is
|
|
* the one level both consumers can already reach. Both sites include this file
|
|
* as `<xrpl/telemetry/NodeStoreMetricNames.h>`.
|
|
*
|
|
* Example usage -- registering the bucket view (MetricsRegistry.cpp):
|
|
* @code
|
|
* addHistogramView(
|
|
* *views,
|
|
* kNodeStoreReadUs,
|
|
* {kSubMillisecondBoundaries.begin(), kSubMillisecondBoundaries.end()});
|
|
* @endcode
|
|
*
|
|
* Example usage -- edge case: the record site labels one instrument with two
|
|
* independent dimensions, which is why the keys and all four values are
|
|
* constants rather than literals (a misspelling on either side would create a
|
|
* second, silently disjoint series):
|
|
* @code
|
|
* XRPL_METRIC_HISTOGRAM_RECORD_LABELED(
|
|
* app, kNodeStoreReadUs, kNodeStoreReadUsDesc, elapsed.count(),
|
|
* {{kFetchTypeLabel, std::string(kFetchTypeAsync)},
|
|
* {kFetchFoundLabel, std::string(kFetchFoundTrue)}});
|
|
* @endcode
|
|
*
|
|
* @note These are `constexpr char[]`, not `constexpr std::string_view`. The
|
|
* OTel C++ API takes `nostd::string_view`, which on this build is OTel's own
|
|
* type; it converts from `char const*` and from `std::string` but has no
|
|
* converting constructor from `std::string_view`, so a `string_view` constant
|
|
* would not compile at the call sites. Same reasoning as
|
|
* GetObjectMetricNames.h.
|
|
*
|
|
* @note Header-only constants with no runtime state, so there is nothing to
|
|
* synchronize -- safe to include from any thread context.
|
|
*/
|
|
|
|
namespace xrpl::telemetry {
|
|
|
|
// ===== Metric name and description ==========================================
|
|
|
|
/**
|
|
* Per-fetch NodeStore backend read latency, in microseconds.
|
|
*
|
|
* Referenced twice: at the record site in NodeStoreScheduler.cpp, and by the
|
|
* sub-millisecond `addHistogramView()` call in MetricsRegistry.cpp. Both must
|
|
* use this one constant.
|
|
*/
|
|
inline constexpr char kNodeStoreReadUs[] = "nodestore_read_us";
|
|
|
|
/**
|
|
* Description for kNodeStoreReadUs.
|
|
*/
|
|
inline constexpr char kNodeStoreReadUsDesc[] = "NodeStore backend fetch latency in microseconds";
|
|
|
|
// ===== Label keys ===========================================================
|
|
|
|
/**
|
|
* Label key separating an async (read-ahead) fetch from a synchronous one.
|
|
*
|
|
* The two mean different things: a slow async read delays prefetch, while a
|
|
* slow synchronous read blocks a caller outright. Merged into one series they
|
|
* cannot be told apart.
|
|
*/
|
|
inline constexpr char kFetchTypeLabel[] = "fetch_type";
|
|
|
|
/**
|
|
* Label key recording whether the fetch found the object.
|
|
*
|
|
* A miss and a hit have different cost profiles -- a miss can require reading
|
|
* every backend -- so mixing them would blur the distribution that matters.
|
|
*/
|
|
inline constexpr char kFetchFoundLabel[] = "found";
|
|
|
|
// ===== Label values =========================================================
|
|
|
|
/** @{ */
|
|
/**
|
|
* kFetchTypeLabel values, one per node_store::FetchType enumerator.
|
|
*/
|
|
inline constexpr char kFetchTypeAsync[] = "async";
|
|
inline constexpr char kFetchTypeSync[] = "sync";
|
|
/** @} */
|
|
|
|
/** @{ */
|
|
/**
|
|
* kFetchFoundLabel values. Spelled out rather than emitted as a bool
|
|
* AttributeValue so the exported label text is stable and matches the
|
|
* string-valued convention every other label in this codebase follows.
|
|
*/
|
|
inline constexpr char kFetchFoundTrue[] = "true";
|
|
inline constexpr char kFetchFoundFalse[] = "false";
|
|
/** @} */
|
|
|
|
// ===== Record-site helpers ==================================================
|
|
|
|
/**
|
|
* Map a fetch's async-ness to its kFetchTypeLabel value.
|
|
*
|
|
* Takes a bool rather than a node_store::FetchType because this header sits in
|
|
* `xrpl.telemetry`, which has no levelization edge to `xrpl.nodestore`. The
|
|
* caller does the one-line enum comparison; this function owns the mapping so
|
|
* the two label spellings live in exactly one place and are unit-testable.
|
|
*
|
|
* @param isAsync True for node_store::FetchType::Async.
|
|
* @return kFetchTypeAsync when @p isAsync, else kFetchTypeSync.
|
|
*
|
|
* @note Pure and reentrant: holds no state and performs no I/O.
|
|
*
|
|
* Example:
|
|
* @code
|
|
* fetchTypeLabelValue(true); // "async"
|
|
* fetchTypeLabelValue(false); // "sync"
|
|
* @endcode
|
|
*/
|
|
[[nodiscard]] constexpr char const*
|
|
fetchTypeLabelValue(bool isAsync) noexcept
|
|
{
|
|
return isAsync ? kFetchTypeAsync : kFetchTypeSync;
|
|
}
|
|
|
|
/**
|
|
* Map a fetch's hit/miss outcome to its kFetchFoundLabel value.
|
|
*
|
|
* @param wasFound node_store::FetchReport::wasFound.
|
|
* @return kFetchFoundTrue when @p wasFound, else kFetchFoundFalse.
|
|
*
|
|
* @note Pure and reentrant: holds no state and performs no I/O.
|
|
*
|
|
* Example:
|
|
* @code
|
|
* fetchFoundLabelValue(true); // "true"
|
|
* fetchFoundLabelValue(false); // "false"
|
|
* @endcode
|
|
*/
|
|
[[nodiscard]] constexpr char const*
|
|
fetchFoundLabelValue(bool wasFound) noexcept
|
|
{
|
|
return wasFound ? kFetchFoundTrue : kFetchFoundFalse;
|
|
}
|
|
|
|
/**
|
|
* Whether an elapsed microsecond count may be handed to the histogram.
|
|
*
|
|
* The OTel SDK rejects a negative histogram value and logs a warning on every
|
|
* such call, so a clock anomaly on a per-fetch path would turn into a log
|
|
* flood. Filtering here drops the bad sample instead.
|
|
*
|
|
* Zero is recordable: a fetch served from a warm page cache can genuinely
|
|
* round to 0 us, and suppressing that would make the fastest reads invisible.
|
|
*
|
|
* @param elapsedUs Measured fetch duration in microseconds.
|
|
* @return True when @p elapsedUs is zero or positive.
|
|
*
|
|
* @note Pure and reentrant: holds no state and performs no I/O.
|
|
*
|
|
* Example:
|
|
* @code
|
|
* shouldRecordFetchLatency(0); // true -- genuinely instant read
|
|
* shouldRecordFetchLatency(-1); // false -- clock anomaly, skip
|
|
* @endcode
|
|
*/
|
|
[[nodiscard]] constexpr bool
|
|
shouldRecordFetchLatency(long long elapsedUs) noexcept
|
|
{
|
|
return elapsedUs >= 0;
|
|
}
|
|
|
|
} // namespace xrpl::telemetry
|