Commit Graph

69 Commits

Author SHA1 Message Date
CJ Cobb
7c6979ae57 optimized ledger_data 2022-03-21 13:57:35 -07:00
CJ Cobb
16e3c87dcc don't create strands for cache download. output cache info in server_info 2022-03-21 13:57:35 -07:00
CJ Cobb
15505905cb populate cache using coroutines. optionally disable cache 2022-03-21 13:57:35 -07:00
CJ Cobb
6fe957ef8f cache fixes. remove defer reads flag. check latest sequence in etl 2022-03-11 20:01:39 -05:00
CJ Cobb
59a0b47df4 fix wrong loop index in for loop 2022-03-10 16:55:25 -05:00
CJ Cobb
8f1895c099 better logging on corrupt successor table 2022-03-10 16:47:42 -05:00
CJ Cobb
48de81a4de log missing object in fetchLedgerPage 2022-03-10 16:09:28 -05:00
CJ Cobb
1510f24f4b ETL fixes
* Don't use cache if cache is more recent than extracted ledger
* Use hardFetchLedgerRangeNoThrow exclusively in ETL, to prevent race
  condition
2022-03-08 00:26:21 -05:00
CJ Cobb
ce01414fb3 Catch database timeout in coroutine 2022-03-07 15:55:48 -05:00
CJ Cobb
9dda99f70a adjust log level of cache miss/hit messages 2022-03-07 15:55:48 -05:00
CJ Cobb
b332c388d2 Load cache from our own database 2022-03-07 15:55:42 -05:00
CJ Cobb
b3948590f8 fix sync interval failover bug 2022-03-04 10:00:45 -05:00
CJ Cobb
f84733cb20 refactor publish sequence logic for read only 2022-03-03 08:24:01 -08:00
CJ Cobb
be1d1a13be more aggressive postgres partitioning 2022-03-03 08:24:01 -08:00
CJ Cobb
b170ecc990 make sync interval for Cassandra configurable 2022-03-03 08:24:01 -08:00
Nathan Nichols
3db9db9354 Fix memory errors (#108)
* frees getUint64Tuple tuple iterator

* explicitly create strand in synchronous()
2022-03-01 17:13:28 -06:00
Brandon Kong
a8b4c1f0c6 Added README documentation for unit tests and fixed typos (#106)
* Fixed minor typos in readme

* Created a README for general unit testing purposes and fixed typo in main.cpp of unittests.
2022-03-01 15:02:26 -05:00
undertome
cd407d715e Fix unused variable errors (#101) 2022-02-22 10:07:36 -06:00
CJ Cobb
199144d092 Add a flag to defer cache reads while the cache is being updated (#97) 2022-02-18 20:44:07 -05:00
undertome
c03b72ad51 Advance DOSGuard (#96)
* Add C++20 features
* Make whitelist const
2022-02-18 17:43:02 -05:00
natenichols
d016253264 Make database reads async
* yield on db read using asio
* PostgresBackend fetches multiple transactions or objects in parallel
2022-02-16 09:36:51 -05:00
undertome
954adb0e7d Build fix: specify template parameters (#89)
* Build fix: specify template parameters
2022-02-01 14:12:07 -05:00
CJ Cobb
95a35caf49 don't publish stale data 2022-01-26 20:49:27 +00:00
CJ Cobb
bc131f666a General purpose function to retry on database timeout 2022-01-25 20:10:28 +00:00
Michael Legleux
bdfd07f154 clang-format (#86)
* clang-format

* ignore clang-format commit; run clang-format in github actions
2022-01-24 15:26:53 -05:00
CJ Cobb
23f1699e3b partition successor table in Postgres 2022-01-13 18:39:23 +00:00
CJ Cobb
d6e8e0bcde Bug fixes
* Handle empty ranges in initial download
* Don't skip records in last marker
* Add identifier for timed out Cassandra writes
2022-01-13 18:38:23 +00:00
CJ Cobb
6e6f47421d Postgres fixes (#84)
* Postgres fixes

* Create partial index for ledger_diffs, to avoid indexing the first
  ledger's objects

* Don't write duplicate keys to successor table

* default to 4 markers when syncing cache

* remove isFirst from writeLedger interface
2022-01-07 14:48:48 -05:00
CJ Cobb
49c7c9989f Forward client IP to rippled when proxying (#77) 2022-01-05 14:51:00 -05:00
Nathan Nichols
9c93e948f5 refactor account_tx (#70)
Revert compound partition key to avoid large rows.
2022-01-03 15:47:56 -05:00
CJ Cobb
c7e31aff56 Add state data cache and successor table. Remove keys table
* Adds a cache for the most recently validated ledger state
* Replaces the keys table with successor table
* Adds support for ledger diffs in the database
* Removes BackendIndexer
2021-12-20 14:40:23 -05:00
CJ Cobb
694fb6b1fd fix gcc 9.3 compilation issue 2021-10-14 16:31:18 -04:00
CJ Cobb
728eb05cd2 handle case where fetchLedgerPage times out and ledger is incomplete 2021-10-05 19:13:59 -04:00
CJ Cobb
8966178702 add upper bound to time spent in fetchLedgerPage 2021-10-05 18:53:53 -04:00
CJ Cobb
8e15adcd74 fix issue with account_tx stored procedure 2021-10-05 18:50:46 -04:00
CJ Cobb
2cb74ae706 fix recursion issue with fetchLedgerPage 2021-10-05 18:30:11 -04:00
CJ Cobb
bc9a0227a6 fix warning about accountTxSchema 2021-10-01 14:42:10 -04:00
CJ Cobb
96c72eec49 remove rippled license 2021-09-24 12:13:11 -04:00
CJ Cobb
01aed9f6e8 Add date to transactions table.
* Add date to account_tx response
* Add support for signer_lists to account_info
* Add support for converting seeds to accounts
* Add urlgravatar to account_info
2021-09-09 15:25:54 -04:00
CJ Cobb
cc76ece6f2 add date to transaction tables 2021-09-07 10:46:10 -04:00
CJ Cobb
5427467ce2 fix assert 2021-08-26 19:39:38 -04:00
CJ Cobb
2da0f53709 fix book_offers limit issue and fetchLedgerPage short circuit 2021-08-26 17:40:48 -04:00
CJ Cobb
a81ad20049 Order book refactor
* Add support for snapshot to books stream
* Add helper function for processing order book after db fetch
* Fix bug in isFrozen
2021-08-26 11:10:58 -04:00
CJ Cobb
d65bbfc841 first half of support for books stream 2021-08-23 14:44:46 -04:00
CJ Cobb
79ac95ae8e fix transaction on db restart bug 2021-08-19 10:28:14 -04:00
CJ Cobb
ac5bbc9ea1 update backend README 2021-08-12 18:11:28 -04:00
CJ Cobb
ea5f9162b7 remove unused offers code 2021-08-06 12:32:06 -04:00
CJ Cobb
56e81eb1d8 reorg 2021-08-02 15:54:37 -04:00
CJ Cobb
97f6081390 delivered amount 2021-07-22 20:30:44 +00:00
CJ Cobb
9b88f79594 handle forward for account_tx with postgres 2021-07-16 19:38:38 +00:00