Commit Graph

31 Commits

Author SHA1 Message Date
Nathan Nichols
ce49de4fee impliment book offers for async etl 2021-05-06 23:07:52 -05:00
CJ Cobb
64d0c5d050 async populate caches 2021-05-03 21:18:38 +00:00
CJ Cobb
971437f456 async write to keys and books with recovery and warnings 2021-05-03 21:18:38 +00:00
Nathan Nichols
ee763ec1ea merge master 2021-05-03 12:13:50 -05:00
CJ Cobb
c0612e740e Many changes around ledger_data and book_offers
* populate caches on startup
* implement new algorithms for Postgres
* use one shift interval instead of two
* block etl at flag ledger until writes are finished
* write one flag ledger ahead
* abandon ledger_diff component of ledger_data
2021-04-29 21:30:05 +00:00
CJ Cobb
f1ff81ddc5 postgres support for new books and keys tables 2021-04-29 14:51:03 +00:00
CJ Cobb
e747c61873 Merge branch 'ledger_data_indexer' into master_new 2021-04-28 20:12:28 +00:00
CJ Cobb
5ebc515978 support for read replicas with postgres 2021-04-28 19:02:44 +00:00
CJ Cobb
0cfce33724 drop hash index on objects.ledger_sequence. was making initial ingestion slow 2021-04-28 18:44:21 +00:00
CJ Cobb
3aed708262 make threadpool a class object 2021-04-27 16:19:45 +00:00
Nathan Nichols
0bcf3a4601 Order book offers by quality 2021-04-21 23:27:14 -05:00
CJ Cobb
1b7d672427 fix cursor issue with account_tx stored procedure 2021-04-20 17:20:35 +00:00
CJ Cobb
777dbb5826 account_tx stored procedure 2021-04-20 16:09:22 +00:00
CJ Cobb
e833bfb38c simulate async fetch batch transactions 2021-04-16 18:53:05 +00:00
CJ Cobb
5364830224 fix postgres account_tx performance issue 2021-04-16 16:02:44 +00:00
CJ Cobb
d9a8ff5399 index during ETL. not tested 2021-04-15 14:10:28 +00:00
CJ Cobb
14fd6d24ad add ancestry check 2021-03-24 14:46:48 -04:00
CJ Cobb
564d46cb5f online delete with postgres. seems to work 2021-03-23 15:55:09 -04:00
CJ Cobb
f476777ef5 fix book_offers postgres issue 2021-03-18 11:34:20 -04:00
CJ Cobb
6f06c60eef fix book offers paging 2021-03-18 11:34:20 -04:00
CJ Cobb
4609010967 Add database timeout exception. clear out incomplete cassandra data. add ledger_entry rpc 2021-03-12 16:37:27 -05:00
CJ Cobb
d2f0537f02 handle postgres timeouts 2021-03-11 16:44:43 -05:00
CJ Cobb
d62f7accfe fix race condition in Postgres backend. add cursor to account_tx response. test script verifies account_tx 2021-03-11 13:14:21 -05:00
CJ Cobb
f781bd6c00 ledger rpc accepts more flags. binary options for all rpcs. tests to verify ledger and account_info 2021-03-09 16:33:24 -05:00
CJ Cobb
e3a121e571 bug fixes in both backends. add ledger_range rpc. improve test scripts 2021-03-05 16:46:55 -05:00
CJ Cobb
7a6dfe5967 postgres fixes 2021-03-05 11:25:12 -05:00
CJ Cobb
6bbb5579ca Ledger handler 2021-03-04 14:34:55 -05:00
CJ Cobb
694ec7bfe5 bug fixes. insert objects in batch 2021-03-04 12:50:36 -05:00
CJ Cobb
308c585801 partial refactor of CassandraBackend 2021-03-02 16:19:14 -05:00
CJ Cobb
805bc14994 add cursor and limit to book offers 2021-03-02 10:15:14 -05:00
CJ Cobb
f992140646 implemented postgres queries (need to update schema) 2021-03-01 16:25:47 -05:00