Commit Graph

118 Commits

Author SHA1 Message Date
Savinda Senevirathne
a2f12dcacc Updating local cluster docker file to include versioned hpcore docker image. (#338) 2021-07-29 15:53:41 +05:30
Chalith Desaman
4a5c3554bd Hotpocket version changes (#336) 2021-07-28 16:33:58 +05:30
Ravin Perera
cdf3a73c7d Added ncc build to nodejs contracts. (#334) 2021-07-22 12:38:02 +05:30
Ravin Perera
4790c7951c Refactored docker images. (#331) 2021-07-14 16:27:17 +05:30
Ravin Perera
d315f9c316 Introduced smart contract run-as user. (#329)
* Added contract run_as config.
* Run smart contract process under the run_as user.
* Integrated run_as user to contract hpfs startup.
2021-06-30 16:15:11 +05:30
Ravin Perera
d7733698de Updated docker images. (#326) 2021-06-23 12:54:39 +05:30
Ravin Perera
c1e1cd12a8 Input responses while syncing. (#323)
* Send pending input responses after syncing.
* Send input statuses on expired inputs.
* Sqlite no journal.
2021-06-12 15:14:21 +05:30
Ravin Perera
aae1617ec0 Metrics script improvements. (#322) 2021-06-09 13:22:14 +05:30
Ravin Perera
03cbc27f0e Cluster event stream scripts. (#321) 2021-06-09 11:43:59 +05:30
Ravin Perera
9741865027 Limit cap increase. (#320) 2021-06-07 15:41:55 +05:30
Ravin Perera
07962bc3d5 Improvements for larger clsuters. (#316)
- Cluster script improvements.
- Skipped msg too old check unverified peer sessions.
- Moved known peer maintenance to peer loop.
2021-05-30 12:32:51 +05:30
Ravin Perera
2f0a6673d5 Added Vultr api scripts. (#315) 2021-05-29 13:01:33 +05:30
Ravin Perera
7cd56a1475 Consensus proposal pruning improvement. (#314)
Consensus proposal pruning improvement.
hpfs binary fd leak fix.
2021-05-29 12:53:49 +05:30
ravinsp
6cfa47418c Minor updates to echo contract and hpfs. 2021-05-23 17:14:34 +05:30
Chalith Desaman
2bb6be0ce5 Fixed full history hpfs log syncing issues (#311) 2021-05-19 19:06:47 +05:30
Ravin Perera
63f62228c2 hpfs binary update and vm cluster script improvements. (#305)
* Updated hpfs binary for log file extending fix.
* Updated vmcluster scripts to include separate hpfiles dir per contract.
2021-05-12 09:23:36 +05:30
Ravin Perera
4e75b497ec Improvements to vm cluster scripts. (#304)
* Improvements to vm cluster scripts.
* Fixed sync priority change issue.
2021-05-11 09:01:09 +05:30
Ravin Perera
321ae2d753 hpfs binary with optimized write fix. (#303)
* Updated hpfs bin.
* Improved logs.
* Local cluster script log level fix.
2021-05-08 17:51:16 +05:30
ravinsp
f85059ea2a Updated hpws binary with tcp packet delay fix. 2021-05-04 09:04:07 +05:30
Ravin Perera
a8ae9c5876 Updated hpfs binary off_t return type fix. Introduced hpfs log level to hp config. (#300)
Updated hpfs binary off_t return type fix. Introduced hpfs log level to hp config
2021-05-02 08:54:40 +05:30
Savinda Senevirathne
3381608afd Updating hpws binary after hpws poll interval increase. (#298) 2021-04-30 10:20:57 +05:30
Ravin Perera
f55341f49e Updated hpfs binary with write optimization support. (#297) 2021-04-30 05:59:31 +05:30
Ravin Perera
e8d63c95f2 Improved vmscripts and js client lib reliability. (#293)
* Added certbot ssl support to vm scripts.
* Client lib blake3 init improvement.
* Client lib connection review process improvement.
2021-04-23 13:28:47 +05:30
Ravin Perera
23dac682d1 Minor improvements to vm cluster scripts. (#292) 2021-04-20 21:44:44 +05:30
Chalith Desaman
05e8077e5b Persisting hpfs log responses to the hpfs (#291)
Fixing the in memory raw shard hash update.
Passing the seq_no of index update to verify that the index records are consistent.
Restart rw session after completing last primary shard sync.
Fixed issue in fs read write by multiple threads.
Hpfs log sync modifications.
2021-04-16 20:06:20 +05:30
Ravin Perera
83bb158dd3 Fixed integer serialization issue with bson. (#287) 2021-04-12 07:15:57 +05:30
Ravin Perera
370e03fe84 Switched user input nonce from string to uint64. (#286) 2021-04-11 14:51:57 +05:30
Ravin Perera
3941f5f6c6 Revamped ledger input/output storage and query execution. (#285)
- Ledger sqlite db improvements.
- Removed flatbuffers from ledger blob data storage.
- Added consensus private mode blob data filtration.
2021-04-11 11:45:14 +05:30
Ravin Perera
0a3183a3d6 Included output hash and ledger info in output return message. (#284) 2021-04-08 10:42:33 +05:30
Ravin Perera
d4646179c2 Returned input hash and ledger info for input submissions. (#283)
- Introduced input hash which can later be used to query the ledger.
- Returned input hash and ledger info at input submission.
- Updated js client lib to support input hash.
- Updated consensus proposal candidate expiration rules.
2021-04-07 21:22:29 +05:30
Savinda Senevirathne
137d7633e0 Updated hpfs binary and its relevant hpcore changes. (#282)
* Hpfs index file is updated to match the file with the hpfs version.
* Added updated hpfs binary.
* Version log changes because Plog is not initialized at the time of version init.
2021-04-02 10:36:29 +05:30
Chalith Desaman
5833431157 hpfs binary update, hpfs log serving and passing to hpfs (#281)
* full history announcement in peer challenge and ability to send random messages only to full history nodes.

* log sync infrastructure codes.

* Resolving merge conflict  induced errors.

* Fork detection implementation.

* Cleanup.

* Resolving PR comments.

* hpfs binary update, hpfs log serving and persisting

* Fixed merge conflict and added missing log

Co-authored-by: Savinda Senevirathne <savindadilsara@gmail.com>
2021-04-01 17:13:58 +05:30
Ravin Perera
bba5266f5d Fixed consensus issues with large no. of users and inputs. (#280)
* Fixed issue in consensus contract output  sorting.

* Improved load test script.

* Removed flatbuffer verifier restrictions to support large no. of users and inputs.

* Improved consensus proposal cleanup.

* Restored the earlier proposal cleanup logic.

* Minor fixes.

* const fix.
2021-04-01 17:12:39 +05:30
Savinda Senevirathne
140b2f80fd Truncate log and hpfs index file from given sequence number. (#276)
- Truncation is invoked by making truncate system call on /hpfs::index.<seq_no> file.
- Updating hpfs binary.
- Truncation waits until any active RW and RO sessions are finished.
2021-03-29 13:22:55 +05:30
Chalith Desaman
44fa3134ea Updating hpfs log index on ledger creation (#274) 2021-03-24 16:49:38 +05:30
Savinda Senevirathne
7cec6d01c1 Changes for unstable consensus. (#272)
* Return empty hash when set or vector is empty in crypto.

* Changing <operator in sequence_hash struct.

* Fixing vm script and allowing only single sync target per vpath.

* Making vm cluster log level to debug.

* Increasing hpws max message size and fixing lcl mode in vm cluster scripts.

* lcl block fix.
2021-03-17 12:17:50 +05:30
Chalith Desaman
00a3da9a2b Request historical shards when max shard range is increased (#266)
* Remove and request historical shards at the startup

* Shard history requesting only at the first consensus round

* Removed test log

* Skip max shard seq no file in removing loop

* Updated the code comments

* Persisting condition changed

* Fixed code comment typos

* Fixed code comment typos

* Resolved PR comments

* Halt consensus until completing only the latest shard sync

* Added meaningful comments

* Resolved PR comments and updated hpfs binary

* Logic enhancement and cleanup

* Cleanup the code comment
2021-03-12 12:13:46 +05:30
Savinda Senevirathne
70a83893b0 Fixing connection not closing when threshold exceeded from a single attempt. (#261)
* Fixing connection not closing when threshold exceeded from a sigle message.

* Updated hpws binary.
2021-03-05 16:58:41 +05:30
Savinda Senevirathne
a775b0e419 Configs to support full history mode. (#252)
* Adding full history mode and max shard configs for primary and blob shards.

* Commenting validation checks for hpfs responses until bug is fixed.

* Comment update.
2021-02-19 14:45:25 +05:30
Ravin Perera
8eac87fb85 Added smart contract upgrade support. (#250)
Supports smart contract self-upgrades by allowing "post_exec.sh" script to be executed after consensus contract execution.
2021-02-18 17:25:42 +05:30
Ravin Perera
e394497698 Used uint32 for roundtime and timeout fields. (#248) 2021-02-17 12:21:51 +05:30
Ravin Perera
9f4499653a Dynamic roundtime detection. (#244)
When consensus is unreliable detect roundtime based on roundtime reported by peers.
2021-02-16 13:34:29 +05:30
Ravin Perera
c366e8acfa Generate tls key files on hpcore new. (#237) 2021-02-05 15:36:11 +05:30
Ravin Perera
e1b1382599 Read request configuration options. (#236)
* Ignores read requests when contract execution disabled.
* Added concurrent_read_reqeuests config.
* Improved metric test script.
2021-02-05 14:54:42 +05:30
Savinda Senevirathne
a4399544b9 Separate contract and ledger file system mounts. (#235)
- Creating two separate hpfs folders for contract and ledger file systems (contract_fs and ledger_fs).
- Added separate mounts for contract and ledger file systems.
- Added separate instances for contract serving and ledger serving.
- Added separate instances for contract syncing and ledger syncing.
- Modified cluster creating script to accompany folder name changes in contract folder.
2021-02-05 11:48:52 +05:30
Ravin Perera
08680ee8d4 hpws upgrade with websocket protocol improvements. (#232)
* Updated hpws binary and header.
* Improved binary encoding support in client lib.
2021-02-01 22:31:28 +05:30
Ravin Perera
d34b7bce53 Performance metric collection scripts. (#230)
* Scripts to collect performance metrics.
* Added log level to hp client lib.
2021-01-31 18:08:32 +05:30
Ravin Perera
70493d827d Contract id mismatch log message. (#227)
* Added contract id mismatch log.
* Added individual docker image run script.
2021-01-22 16:36:34 +05:30
Ravin Perera
610b67cec0 Contract execute config flag. (#226)
* Added contract execute flag. Made bin_path optional.
* Updated docker cluster default config.
* Renamed contract config to hp config.
2021-01-22 14:33:07 +05:30
Ravin Perera
e8e7921ac1 Single-process hpfs integration. (#212) 2021-01-06 21:53:39 +05:30