96 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Ubuntu	ef555b00a7	indexer values look good. Nothing is being written yet	2021-03-30 18:35:40 +00:00
CJ Cobb	d1f47b490a	iterate through diffs. don't write anything	2021-03-30 11:13:51 -04:00
CJ Cobb	168283f0aa	the best ledger_data implementation yet	2021-03-25 21:57:04 -04:00
CJ Cobb	2af6d72d7e	reduce etl queue size based on number of extractor threads	2021-03-25 21:57:04 -04:00
CJ Cobb	d72867ec64	switch deserialization order	2021-03-24 21:00:49 -04:00
CJ Cobb	29424fd863	remove sparsity algorithm in cassandra ledger page	2021-03-24 20:44:39 -04:00
Ubuntu	a77d13449d	update test.py and metrics.py	2021-03-25 00:42:44 +00:00
CJ Cobb	0e23a2e0b5	update metrics.py to print aggregate at end	2021-03-24 15:19:27 -04:00
CJ Cobb	fbd4a19f31	update metrics.py	2021-03-24 15:08:44 -04:00
CJ Cobb	59124e7b0a	fix publish bug. check ledger range	2021-03-24 15:00:11 -04:00
CJ Cobb	14fd6d24ad	add ancestry check	2021-03-24 14:46:48 -04:00
CJ Cobb	c74f9654af	inc current sequence in load thread	2021-03-24 13:27:46 -04:00
CJ Cobb	3062b5e678	add avg extract time	2021-03-24 13:13:28 -04:00
Ubuntu	694111a9b7	numExtractors is config	2021-03-24 17:03:15 +00:00
CJ Cobb	6eb87bfaff	proper parallel extraction	2021-03-24 05:33:27 -04:00
CJ Cobb	a7a71ec0c7	etl pipeline	2021-03-24 04:29:54 -04:00
CJ Cobb	c69fb9672e	update cmake version	2021-03-24 01:54:45 -04:00
CJ Cobb	564d46cb5f	online delete with postgres. seems to work	2021-03-23 15:55:09 -04:00
CJ Cobb	c6a42fa9f2	change log level of extract phase perf logging	2021-03-23 10:58:43 -04:00
CJ Cobb	2ef28ff9be	enhance test.py and metrics.py	2021-03-22 11:16:10 -04:00
CJ Cobb	4fc44c5ac8	log parser	2021-03-18 13:05:47 -04:00
CJ Cobb	8d021f2019	don't cascade delete to objects and books	2021-03-18 11:34:20 -04:00
CJ Cobb	aed0f8707f	read only mode. ledger_data makes sure ledger is present first	2021-03-18 11:34:20 -04:00
CJ Cobb	f476777ef5	fix book_offers postgres issue	2021-03-18 11:34:20 -04:00
CJ Cobb	6f06c60eef	fix book offers paging	2021-03-18 11:34:20 -04:00
CJ Cobb	d84c593064	add ledger entry handler (should have been added in prior commit)	2021-03-12 17:31:12 -05:00
CJ Cobb	9281ffb6e6	add cursor to offers response. verify offers work	2021-03-12 17:30:50 -05:00
CJ Cobb	4609010967	Add database timeout exception. clear out incomplete cassandra data. add ledger_entry rpc	2021-03-12 16:37:27 -05:00
CJ Cobb	d2f0537f02	handle postgres timeouts	2021-03-11 16:44:43 -05:00
CJ Cobb	d62f7accfe	fix race condition in Postgres backend. add cursor to account_tx response. test script verifies account_tx	2021-03-11 13:14:21 -05:00
CJ Cobb	b340f24e2c	checkpoint	2021-03-10 17:47:31 -05:00
CJ Cobb	c3b7983618	refactor CassandraBackend async bookkeeping	2021-03-10 16:03:56 -05:00
CJ Cobb	f781bd6c00	ledger rpc accepts more flags. binary options for all rpcs. tests to verify ledger and account_info	2021-03-09 16:33:24 -05:00
CJ Cobb	e3a121e571	bug fixes in both backends. add ledger_range rpc. improve test scripts	2021-03-05 16:46:55 -05:00
CJ Cobb	7a6dfe5967	postgres fixes	2021-03-05 11:25:12 -05:00
CJ Cobb	6bbb5579ca	Ledger handler	2021-03-04 14:34:55 -05:00
CJ Cobb	694ec7bfe5	bug fixes. insert objects in batch	2021-03-04 12:50:36 -05:00
CJ Cobb	5606d4a7dd	add type field to config. clean up cassandra code more	2021-03-04 10:36:42 -05:00
CJ Cobb	5771b31076	Merge branch 'backend_interface'	2021-03-03 16:58:53 -05:00
CJ Cobb	db09ec23a8	don't write to keys table	2021-03-03 16:50:46 -05:00
CJ Cobb	6d39a5494f	implement second version of fetchLedgerPage	2021-03-03 16:48:00 -05:00
CJ Cobb	997e3ac2e7	refactor of CassandraBackend. compiles, not tested	2021-03-03 16:26:34 -05:00
CJ Cobb	308c585801	partial refactor of CassandraBackend	2021-03-02 16:19:14 -05:00
CJ Cobb	8691cff8df	rename CassandraFlatMapBackend to CassandraBackend and rename file	2021-03-02 10:23:58 -05:00
CJ Cobb	805bc14994	add cursor and limit to book offers	2021-03-02 10:15:14 -05:00
CJ Cobb	f992140646	implemented postgres queries (need to update schema)	2021-03-01 16:25:47 -05:00
CJ Cobb	6839538b3c	postgres writes	2021-03-01 11:53:53 -05:00
CJ Cobb	009688175e	cleanup and postgres stubs	2021-02-24 14:28:15 -05:00
CJ Cobb	78c6bde902	clean up ledger page interface. wire up account_tx	2021-02-23 16:13:48 -05:00
CJ Cobb	5534d9c75e	created backend interface. Cassandra derives from it	2021-02-23 14:28:38 -05:00