CJ Cobb
5f265c5850
checkpoint
2021-06-07 20:19:47 -04:00
CJ Cobb
51ff08b3ae
partial merge needs fixing
2021-06-07 21:35:33 +00:00
CJ Cobb
5f6edee312
book offers seems to work
2021-06-04 05:53:38 +00:00
CJ Cobb
2299d59fda
lots of refactor and bug fix
2021-06-02 17:47:14 +00:00
CJ Cobb
7f16951a18
clean up logs
2021-05-28 22:08:40 -04:00
CJ Cobb
562f96a30f
tests working for postges and cassandra. removed books index. need to
...
implement book_offers
2021-05-28 21:42:25 -04:00
CJ Cobb
db8cfa518b
tests working
2021-05-27 16:24:20 -04:00
Nathan Nichols
cb045ad581
wrap up refactor
2021-05-26 13:48:03 -05:00
CJ Cobb
db0595c083
update cache asynchronously
2021-05-25 20:19:09 +00:00
CJ Cobb
cadf2fa972
checkpoint
2021-05-24 18:23:36 +00:00
CJ Cobb
f513438a95
create postgres database if it doesn't exist
2021-05-20 18:36:20 +00:00
CJ Cobb
0e52ebef48
create cassandra keyspace if it doesn't exist
2021-05-20 17:12:33 +00:00
CJ Cobb
0babf5bc44
online delete for postgres working
2021-05-20 17:02:20 +00:00
CJ Cobb
24816c021d
online delete for cassandra. doesn't crash, but not sure it works
2021-05-20 16:59:50 +00:00
CJ Cobb
ca886fe2c8
add types to make it harder to mix up book index and key index
2021-05-20 16:59:46 +00:00
Nathan Nichols
1de29d3a44
Implement paychannel verify/authorize
2021-05-20 11:08:46 -04:00
Nathan Nichols
ed58095029
add a limit
2021-05-14 09:45:31 -05:00
Nathan Nichols
d2815ec32e
make keys unique after merge
2021-05-13 11:41:29 -05:00
Nathan Nichols
db92f420d9
address comments
2021-05-13 09:06:20 -05:00
Nathan Nichols
cabd9e0c45
fix message
2021-05-13 08:26:42 -05:00
Nathan Nichols
9b8e0bdf99
adjust complete query
2021-05-13 07:43:40 -05:00
Nathan Nichols
f2c7d54b0d
address pr feedback
2021-05-13 06:40:23 -05:00
Nathan Nichols
945598d953
merge master into branch
2021-05-10 15:10:58 -05:00
CJ Cobb
f32af6bb2d
various fixes. make shift info optional in config. Properly check book flag ledger is complete
2021-05-07 20:49:42 +00:00
Nathan Nichols
ce49de4fee
impliment book offers for async etl
2021-05-06 23:07:52 -05:00
CJ Cobb
144ad5eb19
allow different shifts for books and keys. default to 10 and 20 respectively
2021-05-06 20:13:04 +00:00
CJ Cobb
20b8059151
fix up some issues with async indexer
2021-05-05 20:35:19 +00:00
CJ Cobb
736e0a675f
small fixes in CassandraBackend
2021-05-03 21:19:06 +00:00
CJ Cobb
64d0c5d050
async populate caches
2021-05-03 21:18:38 +00:00
CJ Cobb
971437f456
async write to keys and books with recovery and warnings
2021-05-03 21:18:38 +00:00
CJ Cobb
4e58c76eac
Fix crashing bug related to account_tx writes
2021-05-03 21:18:36 +00:00
Nathan Nichols
ee763ec1ea
merge master
2021-05-03 12:13:50 -05:00
CJ Cobb
c0612e740e
Many changes around ledger_data and book_offers
...
* populate caches on startup
* implement new algorithms for Postgres
* use one shift interval instead of two
* block etl at flag ledger until writes are finished
* write one flag ledger ahead
* abandon ledger_diff component of ledger_data
2021-04-29 21:30:05 +00:00
CJ Cobb
e747c61873
Merge branch 'ledger_data_indexer' into master_new
2021-04-28 20:12:28 +00:00
CJ Cobb
20184527af
Merge branch 'postgres_partitioning' into master_new
2021-04-28 19:55:25 +00:00
CJ Cobb
5ebc515978
support for read replicas with postgres
2021-04-28 19:02:44 +00:00
Nathan Nichols
3c8ecc01f1
impliment cursor for book_offers
2021-04-26 15:35:29 -05:00
Nathan Nichols
0bcf3a4601
Order book offers by quality
2021-04-21 23:27:14 -05:00
CJ Cobb
d9a8ff5399
index during ETL. not tested
2021-04-15 14:10:28 +00:00
CJ Cobb
ed4ce93481
remove mention of keys table
2021-04-15 13:48:47 +00:00
CJ Cobb
5f9e5d03f4
speed up indexer
2021-04-05 15:22:07 +00:00
CJ Cobb
df8b6f15d9
make cassandra driver thread count configurable
2021-04-01 23:43:42 +00:00
CJ Cobb
0d11898730
indexer picks up from where it left off
2021-04-01 23:43:11 +00:00
CJ Cobb
db37c05b7b
new book offers algorithm, seems to work
2021-03-31 19:22:53 +00:00
Ubuntu
d27b53e4f7
actually write to keys table
2021-03-30 19:36:55 +00:00
Ubuntu
ef555b00a7
indexer values look good. Nothing is being written yet
2021-03-30 18:35:40 +00:00
CJ Cobb
d1f47b490a
iterate through diffs. don't write anything
2021-03-30 11:13:51 -04:00
CJ Cobb
58509093ac
make cassandra driver thread count configurable
2021-03-26 08:42:23 -04:00
CJ Cobb
168283f0aa
the best ledger_data implementation yet
2021-03-25 21:57:04 -04:00
CJ Cobb
d72867ec64
switch deserialization order
2021-03-24 21:00:49 -04:00