mirror of
https://github.com/XRPLF/xrpl-dev-portal.git
synced 2025-11-20 19:55:54 +00:00
233 lines
10 KiB
Markdown
233 lines
10 KiB
Markdown
---
|
|
html: server-wont-start.html
|
|
parent: troubleshoot-the-rippled-server.html
|
|
seo:
|
|
description: A collection of problems that would cause a rippled server not to start, and how to fix them.
|
|
labels:
|
|
- Core Server
|
|
---
|
|
# rippled Server Won't Start
|
|
|
|
This page explains possible reasons [the `rippled` server](../../concepts/networks-and-servers/index.md) does not start and how to fix them.
|
|
|
|
These instructions assume you have [installed `rippled`](../installation/index.md) on a supported platform.
|
|
|
|
|
|
## File Descriptors Limit
|
|
|
|
On some Linux variants, you may get an error message such as the following when trying to run `rippled`:
|
|
|
|
```text
|
|
WARNING: There are only 1024 file descriptors (soft limit) available, which
|
|
limit the number of simultaneous connections.
|
|
```
|
|
|
|
This occurs because the system has a security limit on the number of files a single process may open, but the limit is set too low for `rippled`. To fix the problem, **root access is required**. Increase the number of files `rippled` is allowed to open with the following steps:
|
|
|
|
1. Add the following lines to the end of your `/etc/security/limits.conf` file:
|
|
|
|
```
|
|
* soft nofile 65536
|
|
* hard nofile 65536
|
|
```
|
|
|
|
2. Check that the [hard limit on number of files that can be opened](https://ss64.com/bash/ulimit.html) is now `65536`:
|
|
|
|
```
|
|
ulimit -Hn
|
|
```
|
|
|
|
The command should output `65536`.
|
|
|
|
3. Try starting `rippled` again.
|
|
|
|
```
|
|
systemctl start rippled
|
|
```
|
|
|
|
4. If `rippled` still does not start, open `/etc/sysctl.conf` and append the following kernel-level setting:
|
|
|
|
```
|
|
fs.file-max = 65536
|
|
```
|
|
|
|
|
|
## Failed to open /etc/opt/ripple/rippled.cfg
|
|
|
|
If `rippled` crashes on startup with an error such as the following, it means that `rippled` cannot read its config file:
|
|
|
|
```text
|
|
Loading: "/etc/opt/ripple/rippled.cfg"
|
|
Failed to open '"/etc/opt/ripple/rippled.cfg"'.
|
|
Terminating thread rippled: main: unhandled St13runtime_error 'Can not create "/var/opt/ripple"'
|
|
Aborted (core dumped)
|
|
```
|
|
|
|
Possible solutions:
|
|
|
|
- Check that the config file exists (the default location is `/etc/opt/ripple/rippled.cfg`) and the user that runs your `rippled` process (usually `rippled`) has read permissions to the file.
|
|
|
|
- Create a config file that can be read by the `rippled` user at `$HOME/.config/ripple/rippled.cfg` (where `$HOME` points to the `rippled` user's home directory).
|
|
|
|
{% admonition type="success" name="Tip" %}The `rippled` repository contains [an example `rippled.cfg` file](https://github.com/XRPLF/rippled/blob/master/cfg/rippled-example.cfg) which is provided as the default config when you do an installation from a binary package. If you do not have the file, you can copy it from there.{% /admonition %}
|
|
|
|
- Specify the path to your preferred config file using the `--conf` [commandline option](../commandline-usage.md).
|
|
|
|
## Failed to open validators file
|
|
|
|
If `rippled` crashes on startup with an error such as the following, it means it can read its primary config file, but that config file specifies a separate validators config file (typically named `validators.txt`), which `rippled` cannot read.
|
|
|
|
```text
|
|
Loading: "/home/rippled/.config/ripple/rippled.cfg"
|
|
Terminating thread rippled: main: unhandled St13runtime_error 'The file specified in [validators_file] does not exist: /home/rippled/.config/ripple/validators.txt'
|
|
Aborted (core dumped)
|
|
```
|
|
|
|
Possible solutions:
|
|
|
|
- Check that the `validators.txt` file exists and the `rippled` user has permissions to read it.
|
|
|
|
{% admonition type="success" name="Tip" %}The `rippled` repository contains [an example `validators.txt` file](https://github.com/XRPLF/rippled/blob/master/cfg/validators-example.txt) which is provided as the default config when you do an installation from a binary package. If you do not have the file, you can copy it from there.{% /admonition %}
|
|
|
|
- Edit your `rippled.cfg` file and modify the `[validators_file]` setting to have the correct path to your `validators.txt` (or equivalent) file. Check for extra whitespace before or after the filename.
|
|
|
|
- Edit your `rippled.cfg` file and remove the `[validators_file]` setting. Add validator settings directly to your `rippled.cfg` file. For example:
|
|
|
|
```
|
|
[validator_list_sites]
|
|
https://vl.ripple.com
|
|
|
|
[validator_list_keys]
|
|
ED2677ABFFD1B33AC6FBC3062B71F1E8397C1505E1C42C64D11AD1B28FF73F4734
|
|
```
|
|
|
|
|
|
## Cannot create database path
|
|
|
|
If `rippled` crashes on startup with an error such as the following, it means the server does not have write permissions to the `[database_path]` from its config file.
|
|
|
|
```text
|
|
Loading: "/home/rippled/.config/ripple/rippled.cfg"
|
|
Terminating thread rippled: main: unhandled St13runtime_error 'Can not create "/var/lib/rippled/db"'
|
|
Aborted (core dumped)
|
|
```
|
|
|
|
The paths to the configuration file (`/home/rippled/.config/ripple/rippled.cfg`) and the database path (`/var/lib/rippled/db`) may vary depending on your system.
|
|
|
|
Possible solutions:
|
|
|
|
- Run `rippled` as a different user that has write permissions to the database path printed in the error message.
|
|
|
|
- Edit your `rippled.cfg` file and change the `[database_path]` setting to use a path that the `rippled` user has write permissions to.
|
|
|
|
- Grant the `rippled` user write permissions to the configured database path.
|
|
|
|
|
|
## State DB Error
|
|
|
|
The following error can occur if the `rippled` server's state database is corrupted. This can occur as the result of being shutdown unexpectedly, or if you change the type of database from RocksDB to NuDB without changing the `path` and `[database_path]` settings in the config file.
|
|
|
|
```text
|
|
2018-Aug-21 23:06:38.675117810 SHAMapStore:ERR state db error:
|
|
writableDbExists false archiveDbExists false
|
|
writableDb '/var/lib/rippled/db/rocksdb/rippledb.11a9' archiveDb '/var/lib/rippled/db/rocksdb/rippledb.2d73'
|
|
|
|
To resume operation, make backups of and remove the files matching /var/lib/rippled/db/state* and contents of the directory /var/lib/rippled/db/rocksdb
|
|
|
|
Terminating thread rippled: main: unhandled St13runtime_error 'state db error'
|
|
```
|
|
|
|
The easiest way to fix this problem is to delete the databases entirely. You may want to back them up elsewhere instead. For example:
|
|
|
|
```sh
|
|
mv /var/lib/rippled/db /var/lib/rippled/db-bak
|
|
```
|
|
|
|
Or, if you are sure you don't need the databases:
|
|
|
|
```sh
|
|
rm -r /var/lib/rippled/db
|
|
```
|
|
|
|
{% admonition type="success" name="Tip" %}It is generally safe to delete the `rippled` databases, because any individual server can re-download ledger history from other servers in the XRP Ledger network.{% /admonition %}
|
|
|
|
Alternatively, you can change the paths to the databases in the config file. For example:
|
|
|
|
```
|
|
[node_db]
|
|
type=NuDB
|
|
path=/var/lib/rippled/custom_nudb_path
|
|
|
|
[database_path]
|
|
/var/lib/rippled/custom_sqlite_db_path
|
|
```
|
|
|
|
|
|
## Online Delete is Less Than Ledger History
|
|
|
|
An error message such as the following indicates that the `rippled.cfg` file has contradictory values for `[ledger_history]` and `online_delete`.
|
|
|
|
```text
|
|
Terminating thread rippled: main: unhandled St13runtime_error 'online_delete must not be less than ledger_history (currently 3000)
|
|
```
|
|
|
|
The `[ledger_history]` setting represents how many ledgers of history the server should seek to back-fill. The `online_delete` field (in the `[node_db]` stanza) indicates how many ledgers of history to keep when dropping older history. The `online_delete` value must be equal to or larger than `[ledger_history]` to prevent the server from deleting historical ledgers that it is also trying to download.
|
|
|
|
To fix the problem, edit the `rippled.cfg` file and change or remove either the `[ledger_history]` or `online_delete` options. (If you omit `[ledger_history]`, it uses a default of 256 ledger versions. If you specify the `online_delete` field, it must be larger than 256. If you omit `online_delete`, it disables automatic deletion of old ledger versions.)
|
|
|
|
|
|
## Bad node_size value
|
|
|
|
An error such as the following indicates that the `rippled.cfg` file has an improper value for the `node_size` setting:
|
|
|
|
```text
|
|
Terminating thread rippled: main: unhandled N5beast14BadLexicalCastE 'std::bad_cast'
|
|
```
|
|
|
|
Valid parameters for the `node_size` field are `tiny`, `small`, `medium`, `large`, or `huge`. For more information see [Node Size](../installation/capacity-planning.md#node-size).
|
|
|
|
|
|
## Shard path missing
|
|
|
|
An error such as the following indicates that the `rippled.cfg` has an incomplete [history sharding](../configuration/data-retention/history-sharding.md) configuration:
|
|
|
|
```text
|
|
Terminating thread rippled: main: unhandled St13runtime_error 'shard path missing'
|
|
```
|
|
|
|
If your config includes a `[shard_db]` stanza, it must contain a `path` field, which points to a directory where `rippled` can write the data for the shard store. This error means the `path` field is missing or located in the wrong place. Check for extra whitespace or typos in your config file, and compare against the [Shard Configuration Example](../configuration/data-retention/configure-history-sharding.md#2-edit-rippledcfg).
|
|
|
|
## Unsupported shard store type: RocksDB
|
|
|
|
RocksDB is no longer supported as a backend for [history sharding](../configuration/data-retention/history-sharding.md). If you have an existing configuration that defines a RocksDB shard store, the server fails to start.
|
|
|
|
In this case, the process dies shortly after the log startup command, with a message such as the following appearing earlier in the output log:
|
|
|
|
```text
|
|
ShardStore:ERR Unsupported shard store type: RocksDB
|
|
```
|
|
|
|
|
|
To fix this problem, do one of the following, then restart the server:
|
|
|
|
- Change your shard store to use NuDB instead.
|
|
- Disable history sharding.
|
|
|
|
|
|
## See Also
|
|
|
|
- **Concepts:**
|
|
- [The `rippled` Server](../../concepts/networks-and-servers/index.md)
|
|
- [Technical FAQ](/about/faq.md)
|
|
- **Tutorials:**
|
|
- [Understanding Log Messages](understanding-log-messages.md)
|
|
- [Capacity Planning](../installation/capacity-planning.md)
|
|
- **References:**
|
|
- [rippled API Reference](../../references/http-websocket-apis/index.md)
|
|
- [`rippled` Commandline Usage](../commandline-usage.md)
|
|
- [server_info method][]
|
|
|
|
<!-- SPELLING_IGNORE: cfg, node_size -->
|
|
|
|
{% raw-partial file="/docs/_snippets/common-links.md" /%}
|