CJ Cobb
562f96a30f
tests working for postges and cassandra. removed books index. need to
...
implement book_offers
2021-05-28 21:42:25 -04:00
CJ Cobb
96f896c117
checkpoint
2021-05-26 21:23:16 +00:00
CJ Cobb
db0595c083
update cache asynchronously
2021-05-25 20:19:09 +00:00
CJ Cobb
cadf2fa972
checkpoint
2021-05-24 18:23:36 +00:00
CJ Cobb
f513438a95
create postgres database if it doesn't exist
2021-05-20 18:36:20 +00:00
CJ Cobb
0babf5bc44
online delete for postgres working
2021-05-20 17:02:20 +00:00
CJ Cobb
24816c021d
online delete for cassandra. doesn't crash, but not sure it works
2021-05-20 16:59:50 +00:00
CJ Cobb
ca886fe2c8
add types to make it harder to mix up book index and key index
2021-05-20 16:59:46 +00:00
Nathan Nichols
ed58095029
add a limit
2021-05-14 09:45:31 -05:00
Nathan Nichols
d2815ec32e
make keys unique after merge
2021-05-13 11:41:29 -05:00
Nathan Nichols
db92f420d9
address comments
2021-05-13 09:06:20 -05:00
Nathan Nichols
f2c7d54b0d
address pr feedback
2021-05-13 06:40:23 -05:00
Nathan Nichols
d57cf3a518
add warning
2021-05-12 11:42:53 -05:00
Nathan Nichols
84911f9424
save for testing
2021-05-11 18:16:43 -05:00
Nathan Nichols
d7ce14983a
Impliments book_offers in postgres
2021-05-10 15:40:03 -05:00
Nathan Nichols
945598d953
merge master into branch
2021-05-10 15:10:58 -05:00
Nathan Nichols
3faf27fc4f
impliment cassandra like fetch in postgres
2021-05-10 15:09:29 -05:00
CJ Cobb
f32af6bb2d
various fixes. make shift info optional in config. Properly check book flag ledger is complete
2021-05-07 20:49:42 +00:00
Nathan Nichols
ce49de4fee
impliment book offers for async etl
2021-05-06 23:07:52 -05:00
CJ Cobb
144ad5eb19
allow different shifts for books and keys. default to 10 and 20 respectively
2021-05-06 20:13:04 +00:00
CJ Cobb
64d0c5d050
async populate caches
2021-05-03 21:18:38 +00:00
CJ Cobb
971437f456
async write to keys and books with recovery and warnings
2021-05-03 21:18:38 +00:00
Nathan Nichols
ee763ec1ea
merge master
2021-05-03 12:13:50 -05:00
CJ Cobb
c0612e740e
Many changes around ledger_data and book_offers
...
* populate caches on startup
* implement new algorithms for Postgres
* use one shift interval instead of two
* block etl at flag ledger until writes are finished
* write one flag ledger ahead
* abandon ledger_diff component of ledger_data
2021-04-29 21:30:05 +00:00
CJ Cobb
f1ff81ddc5
postgres support for new books and keys tables
2021-04-29 14:51:03 +00:00
CJ Cobb
e747c61873
Merge branch 'ledger_data_indexer' into master_new
2021-04-28 20:12:28 +00:00
CJ Cobb
5ebc515978
support for read replicas with postgres
2021-04-28 19:02:44 +00:00
CJ Cobb
0cfce33724
drop hash index on objects.ledger_sequence. was making initial ingestion slow
2021-04-28 18:44:21 +00:00
CJ Cobb
3aed708262
make threadpool a class object
2021-04-27 16:19:45 +00:00
Nathan Nichols
0bcf3a4601
Order book offers by quality
2021-04-21 23:27:14 -05:00
CJ Cobb
1b7d672427
fix cursor issue with account_tx stored procedure
2021-04-20 17:20:35 +00:00
CJ Cobb
777dbb5826
account_tx stored procedure
2021-04-20 16:09:22 +00:00
CJ Cobb
e833bfb38c
simulate async fetch batch transactions
2021-04-16 18:53:05 +00:00
CJ Cobb
5364830224
fix postgres account_tx performance issue
2021-04-16 16:02:44 +00:00
CJ Cobb
d9a8ff5399
index during ETL. not tested
2021-04-15 14:10:28 +00:00
CJ Cobb
14fd6d24ad
add ancestry check
2021-03-24 14:46:48 -04:00
CJ Cobb
564d46cb5f
online delete with postgres. seems to work
2021-03-23 15:55:09 -04:00
CJ Cobb
f476777ef5
fix book_offers postgres issue
2021-03-18 11:34:20 -04:00
CJ Cobb
6f06c60eef
fix book offers paging
2021-03-18 11:34:20 -04:00
CJ Cobb
4609010967
Add database timeout exception. clear out incomplete cassandra data. add ledger_entry rpc
2021-03-12 16:37:27 -05:00
CJ Cobb
d2f0537f02
handle postgres timeouts
2021-03-11 16:44:43 -05:00
CJ Cobb
d62f7accfe
fix race condition in Postgres backend. add cursor to account_tx response. test script verifies account_tx
2021-03-11 13:14:21 -05:00
CJ Cobb
f781bd6c00
ledger rpc accepts more flags. binary options for all rpcs. tests to verify ledger and account_info
2021-03-09 16:33:24 -05:00
CJ Cobb
e3a121e571
bug fixes in both backends. add ledger_range rpc. improve test scripts
2021-03-05 16:46:55 -05:00
CJ Cobb
7a6dfe5967
postgres fixes
2021-03-05 11:25:12 -05:00
CJ Cobb
6bbb5579ca
Ledger handler
2021-03-04 14:34:55 -05:00
CJ Cobb
694ec7bfe5
bug fixes. insert objects in batch
2021-03-04 12:50:36 -05:00
CJ Cobb
308c585801
partial refactor of CassandraBackend
2021-03-02 16:19:14 -05:00
CJ Cobb
805bc14994
add cursor and limit to book offers
2021-03-02 10:15:14 -05:00
CJ Cobb
f992140646
implemented postgres queries (need to update schema)
2021-03-01 16:25:47 -05:00