Online deletion revisions

- Split ledger history section into a parent concept page w/ online
deletion and history sharding as child pages
- Clarified how much data is stored in general
- Covered the special case for backfilling with advisory_delete enabled
(including updating the diagram)
- Changed full history recommendation to NuDB only
This commit is contained in:
mDuo13
2018-12-18 14:21:51 -08:00
parent ab6b4d4435
commit a3400378c4
11 changed files with 317 additions and 166 deletions

View File

@@ -64,14 +64,18 @@ RocksDB has performance-related configuration options that you can set in `rippl
```
[node_db]
type=RocksDB
path={path_to_ledger_store}
path=/var/lib/rippled/db/rocksdb
open_files=512
filter_bits=12
cache_mb=512
file_size_mb=64
file_size_mult=2
online_delete=2000
advisory_delete=0
```
(Adjust the `path` to the directory where you want to keep the ledger store on disk. Adjust the `online_delete` and `advisory_delete` settings as desired for your configuration.)
#### More About Using NuDb
[NuDB](https://github.com/vinniefalco/nudb#introduction) is an append-only key-value store that is optimized for SSD drives.
@@ -80,8 +84,17 @@ NuDB has nearly constant performance and memory footprints regardless of the amo
Non-validator production servers should be configured to use NuDB and to store the amount of historical data required for the use case.
NuDB does not have performance-related configuration options available in `rippled.cfg`.
NuDB does not have performance-related configuration options available in `rippled.cfg`. Here is the recommended configuration for a `rippled` server using NuDB:
```
[node_db]
type=NuDB
path=/var/lib/rippled/db/nudb
online_delete=2000
advisory_delete=0
```
(Adjust the `path` to the directory where you want to keep the ledger store on disk. Adjust the `online_delete` and `advisory_delete` settings as desired for your configuration.)
### Historical Data
@@ -98,7 +111,7 @@ The following table approximates the requirements for different amounts of histo
| 90 days | 2,250,000 | 720 GB | 1 TB |
| 1 year | 10,000,000 | 3 TB | 4.5 TB |
| 2 years | 20,000,000 | 6 TB | 9 TB |
| Full history (through 2018) | 43,000,000+ | 9 TB | (Unknown) |
| Full history (through 2018) | 43,000,000+ | (Not recommended) | ~9 TB |
These numbers are estimates. They depend on several factors, most importantly the volume of transactions in the network. As transaction volume increases, each ledger version stores more unique data.