mirror of
https://github.com/XRPLF/rippled.git
synced 2026-04-29 15:37:57 +00:00
* Set version to 2.4.0 * refactor: Remove unused and add missing includes (#5293) The codebase is filled with includes that are unused, and which thus can be removed. At the same time, the files often do not include all headers that contain the definitions used in those files. This change uses clang-format and clang-tidy to clean up the includes, with minor manual intervention to ensure the code compiles on all platforms. * refactor: Calculate numFeatures automatically (#5324) Requiring manual updates of numFeatures is an annoying manual process that is easily forgotten, and leads to frequent merge conflicts. This change takes advantage of the `XRPL_FEATURE` and `XRPL_FIX` macros, and adds a new `XRPL_RETIRE` macro to automatically set `numFeatures`. * refactor: Improve ordering of headers with clang-format (#5343) Removes all manual header groupings from source and header files by leveraging clang-format options. * Rename "deadlock" to "stall" in `LoadManager` (#5341) What the LoadManager class does is stall detection, which is not the same as deadlock detection. In the condition of severe CPU starvation, LoadManager will currently intentionally crash rippled reporting `LogicError: Deadlock detected`. This error message is misleading as the condition being detected is not a deadlock. This change fixes and refactors the code in response. * Adds hub.xrpl-commons.org as a new Bootstrap Cluster (#5263) * fix: Error message for ledger_entry rpc (#5344) Changes the error to `malformedAddress` for `permissioned_domain` in the `ledger_entry` rpc, when the account is not a string. This change makes it more clear to a user what is wrong with their request. * fix: Handle invalid marker parameter in grpc call (#5317) The `end_marker` is used to limit the range of ledger entries to fetch. If `end_marker` is less than `marker`, a crash can occur. This change adds an additional check. * fix: trust line RPC no ripple flag (#5345) The Trustline RPC `no_ripple` flag gets set depending on `lsfDefaultRipple` flag, which is not a flag of a trustline but of the account root. The `lsfDefaultRipple` flag does not provide any insight if this particular trust line has `lsfLowNoRipple` or `lsfHighNoRipple` flag set, so it should not be used here at all. This change simplifies the logic. * refactor: Updates Conan dependencies: RocksDB (#5335) Updates RocksDB to version 9.7.3, the latest version supported in Conan 1.x. A patch for 9.7.4 that fixes a memory leak is included. * fix: Remove null pointer deref, just do abort (#5338) This change removes the existing undefined behavior from `LogicError`, so we can be certain that there will be always a stacktrace. De-referencing a null pointer is an old trick to generate `SIGSEGV`, which would typically also create a stacktrace. However it is also an undefined behaviour and compilers can do something else. A more robust way to create a stacktrace while crashing the program is to use `std::abort`, which we have also used in this location for a long time. If we combine the two, we might not get the expected behaviour - namely, the nullpointer deref followed by `std::abort`, as handled in certain compiler versions may not immediately cause a crash. We have observed stacktrace being wiped instead, and thread put in indeterminate state, then stacktrace created without any useful information. * chore: Add PR number to payload (#5310) This PR adds one more payload field to the libXRPL compatibility check workflow - the PR number itself. * chore: Update link to ripple-binary-codec (#5355) The link to ripple-binary-codec's definitions.json appears to be outdated. The updated link is also documented here: https://xrpl.org/docs/references/protocol/binary-format#definitions-file * Prevent consensus from getting stuck in the establish phase (#5277) - Detects if the consensus process is "stalled". If it is, then we can declare a consensus and end successfully even if we do not have 80% agreement on our proposal. - "Stalled" is defined as: - We have a close time consensus - Each disputed transaction is individually stalled: - It has been in the final "stuck" 95% requirement for at least 2 (avMIN_ROUNDS) "inner rounds" of phaseEstablish, - and either all of the other trusted proposers or this validator, if proposing, have had the same vote(s) for at least 4 (avSTALLED_ROUNDS) "inner rounds", and at least 80% of the validators (including this one, if appropriate) agree about the vote (whether yes or no). - If we have been in the establish phase for more than 10x the previous consensus establish phase's time, then consensus is considered "expired", and we will leave the round, which sends a partial validation (indicating that the node is moving on without validating). Two restrictions avoid prematurely exiting, or having an extended exit in extreme situations. - The 10x time is clamped to be within a range of 15s (ledgerMAX_CONSENSUS) to 120s (ledgerABANDON_CONSENSUS). - If consensus has not had an opportunity to walk through all avalanche states (defined as not going through 8 "inner rounds" of phaseEstablish), then ConsensusState::Expired is treated as ConsensusState::No. - When enough nodes leave the round, any remaining nodes will see they've fallen behind, and move on, too, generally before hitting the timeout. Any validations or partial validations sent during this time will help the consensus process bring the nodes back together. --------- Co-authored-by: Michael Legleux <mlegleux@ripple.com> Co-authored-by: Bart <bthomee@users.noreply.github.com> Co-authored-by: Ed Hennis <ed@ripple.com> Co-authored-by: Bronek Kozicki <brok@incorrekt.com> Co-authored-by: Darius Tumas <Tokeiito@users.noreply.github.com> Co-authored-by: Sergey Kuznetsov <skuznetsov@ripple.com> Co-authored-by: cyan317 <120398799+cindyyan317@users.noreply.github.com> Co-authored-by: Vlad <129996061+vvysokikh1@users.noreply.github.com> Co-authored-by: Alex Kremer <akremer@ripple.com>
405 lines
10 KiB
C++
405 lines
10 KiB
C++
//------------------------------------------------------------------------------
|
|
/*
|
|
This file is part of rippled: https://github.com/ripple/rippled
|
|
Copyright (c) 2012, 2013 Ripple Labs Inc.
|
|
|
|
Permission to use, copy, modify, and/or distribute this software for any
|
|
purpose with or without fee is hereby granted, provided that the above
|
|
copyright notice and this permission notice appear in all copies.
|
|
|
|
THE SOFTWARE IS PROVIDED "AS IS" AND THE AUTHOR DISCLAIMS ALL WARRANTIES
|
|
WITH REGARD TO THIS SOFTWARE INCLUDING ALL IMPLIED WARRANTIES OF
|
|
MERCHANTABILITY AND FITNESS. IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR
|
|
ANY SPECIAL , DIRECT, INDIRECT, OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES
|
|
WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER IN AN
|
|
ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION, ARISING OUT OF
|
|
OR IN CONNECTION WITH THE USE OR PERFORMANCE OF THIS SOFTWARE.
|
|
*/
|
|
//==============================================================================
|
|
|
|
#ifndef RIPPLE_BASICS_BASICCONFIG_H_INCLUDED
|
|
#define RIPPLE_BASICS_BASICCONFIG_H_INCLUDED
|
|
|
|
#include <xrpl/basics/contract.h>
|
|
|
|
#include <boost/beast/core/string.hpp>
|
|
#include <boost/lexical_cast.hpp>
|
|
|
|
#include <algorithm>
|
|
#include <optional>
|
|
#include <string>
|
|
#include <unordered_map>
|
|
#include <vector>
|
|
|
|
namespace ripple {
|
|
|
|
using IniFileSections =
|
|
std::unordered_map<std::string, std::vector<std::string>>;
|
|
|
|
//------------------------------------------------------------------------------
|
|
|
|
/** Holds a collection of configuration values.
|
|
A configuration file contains zero or more sections.
|
|
*/
|
|
class Section
|
|
{
|
|
private:
|
|
std::string name_;
|
|
std::unordered_map<std::string, std::string> lookup_;
|
|
std::vector<std::string> lines_;
|
|
std::vector<std::string> values_;
|
|
bool had_trailing_comments_ = false;
|
|
|
|
using const_iterator = decltype(lookup_)::const_iterator;
|
|
|
|
public:
|
|
/** Create an empty section. */
|
|
explicit Section(std::string const& name = "");
|
|
|
|
/** Returns the name of this section. */
|
|
std::string const&
|
|
name() const
|
|
{
|
|
return name_;
|
|
}
|
|
|
|
/** Returns all the lines in the section.
|
|
This includes everything.
|
|
*/
|
|
std::vector<std::string> const&
|
|
lines() const
|
|
{
|
|
return lines_;
|
|
}
|
|
|
|
/** Returns all the values in the section.
|
|
Values are non-empty lines which are not key/value pairs.
|
|
*/
|
|
std::vector<std::string> const&
|
|
values() const
|
|
{
|
|
return values_;
|
|
}
|
|
|
|
/**
|
|
* Set the legacy value for this section.
|
|
*/
|
|
void
|
|
legacy(std::string value)
|
|
{
|
|
if (lines_.empty())
|
|
lines_.emplace_back(std::move(value));
|
|
else
|
|
lines_[0] = std::move(value);
|
|
}
|
|
|
|
/**
|
|
* Get the legacy value for this section.
|
|
*
|
|
* @return The retrieved value. A section with an empty legacy value returns
|
|
an empty string.
|
|
*/
|
|
std::string
|
|
legacy() const
|
|
{
|
|
if (lines_.empty())
|
|
return "";
|
|
if (lines_.size() > 1)
|
|
Throw<std::runtime_error>(
|
|
"A legacy value must have exactly one line. Section: " + name_);
|
|
return lines_[0];
|
|
}
|
|
|
|
/** Set a key/value pair.
|
|
The previous value is discarded.
|
|
*/
|
|
void
|
|
set(std::string const& key, std::string const& value);
|
|
|
|
/** Append a set of lines to this section.
|
|
Lines containing key/value pairs are added to the map,
|
|
else they are added to the values list. Everything is
|
|
added to the lines list.
|
|
*/
|
|
void
|
|
append(std::vector<std::string> const& lines);
|
|
|
|
/** Append a line to this section. */
|
|
void
|
|
append(std::string const& line)
|
|
{
|
|
append(std::vector<std::string>{line});
|
|
}
|
|
|
|
/** Returns `true` if a key with the given name exists. */
|
|
bool
|
|
exists(std::string const& name) const;
|
|
|
|
template <class T = std::string>
|
|
std::optional<T>
|
|
get(std::string const& name) const
|
|
{
|
|
auto const iter = lookup_.find(name);
|
|
if (iter == lookup_.end())
|
|
return std::nullopt;
|
|
return boost::lexical_cast<T>(iter->second);
|
|
}
|
|
|
|
/// Returns a value if present, else another value.
|
|
template <class T>
|
|
T
|
|
value_or(std::string const& name, T const& other) const
|
|
{
|
|
auto const v = get<T>(name);
|
|
return v.has_value() ? *v : other;
|
|
}
|
|
|
|
// indicates if trailing comments were seen
|
|
// during the appending of any lines/values
|
|
bool
|
|
had_trailing_comments() const
|
|
{
|
|
return had_trailing_comments_;
|
|
}
|
|
|
|
friend std::ostream&
|
|
operator<<(std::ostream&, Section const& section);
|
|
|
|
// Returns `true` if there are no key/value pairs.
|
|
bool
|
|
empty() const
|
|
{
|
|
return lookup_.empty();
|
|
}
|
|
|
|
// Returns the number of key/value pairs.
|
|
std::size_t
|
|
size() const
|
|
{
|
|
return lookup_.size();
|
|
}
|
|
|
|
// For iteration of key/value pairs.
|
|
const_iterator
|
|
begin() const
|
|
{
|
|
return lookup_.cbegin();
|
|
}
|
|
|
|
// For iteration of key/value pairs.
|
|
const_iterator
|
|
cbegin() const
|
|
{
|
|
return lookup_.cbegin();
|
|
}
|
|
|
|
// For iteration of key/value pairs.
|
|
const_iterator
|
|
end() const
|
|
{
|
|
return lookup_.cend();
|
|
}
|
|
|
|
// For iteration of key/value pairs.
|
|
const_iterator
|
|
cend() const
|
|
{
|
|
return lookup_.cend();
|
|
}
|
|
};
|
|
|
|
//------------------------------------------------------------------------------
|
|
|
|
/** Holds unparsed configuration information.
|
|
The raw data sections are processed with intermediate parsers specific
|
|
to each module instead of being all parsed in a central location.
|
|
*/
|
|
class BasicConfig
|
|
{
|
|
private:
|
|
std::unordered_map<std::string, Section> map_;
|
|
|
|
public:
|
|
/** Returns `true` if a section with the given name exists. */
|
|
bool
|
|
exists(std::string const& name) const;
|
|
|
|
/** Returns the section with the given name.
|
|
If the section does not exist, an empty section is returned.
|
|
*/
|
|
/** @{ */
|
|
Section&
|
|
section(std::string const& name);
|
|
|
|
Section const&
|
|
section(std::string const& name) const;
|
|
|
|
Section const&
|
|
operator[](std::string const& name) const
|
|
{
|
|
return section(name);
|
|
}
|
|
|
|
Section&
|
|
operator[](std::string const& name)
|
|
{
|
|
return section(name);
|
|
}
|
|
/** @} */
|
|
|
|
/** Overwrite a key/value pair with a command line argument
|
|
If the section does not exist it is created.
|
|
The previous value, if any, is overwritten.
|
|
*/
|
|
void
|
|
overwrite(
|
|
std::string const& section,
|
|
std::string const& key,
|
|
std::string const& value);
|
|
|
|
/** Remove all the key/value pairs from the section.
|
|
*/
|
|
void
|
|
deprecatedClearSection(std::string const& section);
|
|
|
|
/**
|
|
* Set a value that is not a key/value pair.
|
|
*
|
|
* The value is stored as the section's first value and may be retrieved
|
|
* through section::legacy.
|
|
*
|
|
* @param section Name of the section to modify.
|
|
* @param value Contents of the legacy value.
|
|
*/
|
|
void
|
|
legacy(std::string const& section, std::string value);
|
|
|
|
/**
|
|
* Get the legacy value of a section. A section with a
|
|
* single-line value may be retrieved as a legacy value.
|
|
*
|
|
* @param sectionName Retrieve the contents of this section's
|
|
* legacy value.
|
|
* @return Contents of the legacy value.
|
|
*/
|
|
std::string
|
|
legacy(std::string const& sectionName) const;
|
|
|
|
friend std::ostream&
|
|
operator<<(std::ostream& ss, BasicConfig const& c);
|
|
|
|
// indicates if trailing comments were seen
|
|
// in any loaded Sections
|
|
bool
|
|
had_trailing_comments() const
|
|
{
|
|
return std::any_of(map_.cbegin(), map_.cend(), [](auto s) {
|
|
return s.second.had_trailing_comments();
|
|
});
|
|
}
|
|
|
|
protected:
|
|
void
|
|
build(IniFileSections const& ifs);
|
|
};
|
|
|
|
//------------------------------------------------------------------------------
|
|
|
|
/** Set a value from a configuration Section
|
|
If the named value is not found or doesn't parse as a T,
|
|
the variable is unchanged.
|
|
@return `true` if value was set.
|
|
*/
|
|
template <class T>
|
|
bool
|
|
set(T& target, std::string const& name, Section const& section)
|
|
{
|
|
bool found_and_valid = false;
|
|
try
|
|
{
|
|
auto const val = section.get<T>(name);
|
|
if ((found_and_valid = val.has_value()))
|
|
target = *val;
|
|
}
|
|
catch (boost::bad_lexical_cast&)
|
|
{
|
|
}
|
|
return found_and_valid;
|
|
}
|
|
|
|
/** Set a value from a configuration Section
|
|
If the named value is not found or doesn't cast to T,
|
|
the variable is assigned the default.
|
|
@return `true` if the named value was found and is valid.
|
|
*/
|
|
template <class T>
|
|
bool
|
|
set(T& target,
|
|
T const& defaultValue,
|
|
std::string const& name,
|
|
Section const& section)
|
|
{
|
|
bool found_and_valid = set<T>(target, name, section);
|
|
if (!found_and_valid)
|
|
target = defaultValue;
|
|
return found_and_valid;
|
|
}
|
|
|
|
/** Retrieve a key/value pair from a section.
|
|
@return The value string converted to T if it exists
|
|
and can be parsed, or else defaultValue.
|
|
*/
|
|
// NOTE This routine might be more clumsy than the previous two
|
|
template <class T = std::string>
|
|
T
|
|
get(Section const& section,
|
|
std::string const& name,
|
|
T const& defaultValue = T{})
|
|
{
|
|
try
|
|
{
|
|
return section.value_or<T>(name, defaultValue);
|
|
}
|
|
catch (boost::bad_lexical_cast&)
|
|
{
|
|
}
|
|
return defaultValue;
|
|
}
|
|
|
|
inline std::string
|
|
get(Section const& section, std::string const& name, const char* defaultValue)
|
|
{
|
|
try
|
|
{
|
|
auto const val = section.get(name);
|
|
if (val.has_value())
|
|
return *val;
|
|
}
|
|
catch (boost::bad_lexical_cast&)
|
|
{
|
|
}
|
|
return defaultValue;
|
|
}
|
|
|
|
template <class T>
|
|
bool
|
|
get_if_exists(Section const& section, std::string const& name, T& v)
|
|
{
|
|
return set<T>(v, name, section);
|
|
}
|
|
|
|
template <>
|
|
inline bool
|
|
get_if_exists<bool>(Section const& section, std::string const& name, bool& v)
|
|
{
|
|
int intVal = 0;
|
|
auto stat = get_if_exists(section, name, intVal);
|
|
if (stat)
|
|
v = bool(intVal);
|
|
return stat;
|
|
}
|
|
|
|
} // namespace ripple
|
|
|
|
#endif
|