Commit Graph

603 Commits

Author SHA1 Message Date
Arsham Teymouri 3e8e7e40ec adding servicemonitor for the core service
changing the ci to trigger automatically
2021-08-16 09:46:27 +03:00
James Wilson 502fd2e91a Merge pull request #367 from paritytech/jsdw-sharding-gatekeeper
Flume, Metrics and Message control when overloaded
2021-08-13 14:35:43 +01:00
James Wilson 46b0641dfd Clarify wording 2021-08-13 11:45:03 +01:00
James Wilson 77460ffc27 cargo fmt 2021-08-13 11:35:24 +01:00
James Wilson b842c7fc8b expose dropped message counts and fix some typos/wording 2021-08-13 11:33:53 +01:00
arshamparity 8e82106586 Merge pull request #366 from arshamparity/helm
fixing helm chart issues
2021-08-13 13:27:07 +03:00
James Wilson 811babca27 Merge branch 'master' into jsdw-sharding-gatekeeper 2021-08-13 11:16:47 +01:00
James Wilson 425ac73422 Merge pull request #365 from paritytech/jsdw-minor-fixes
Jsdw minor fixes
2021-08-13 10:51:17 +01:00
James Wilson 18627a9f02 No e2e feature flag; just ignore and pattern match on 'e2e' to run 2021-08-12 16:58:35 +01:00
James Wilson 05a3ba3fef Fix/expand a few comments 2021-08-12 16:20:05 +01:00
James Wilson 230987036a cargo fmt 2021-08-12 16:01:35 +01:00
James Wilson 9017f328f0 Add comment explaining prometheus metrics endpoint body 2021-08-12 16:01:33 +01:00
James Wilson 92da674d4d Expose metrics in a format that prometheus understands 2021-08-12 16:01:32 +01:00
James Wilson 4f7b2c8ec5 Confirm that densemap len wont panic if lots of retired items 2021-08-12 16:01:30 +01:00
James Wilson 6db7f484ef Fix compile err with diagnostic msg 2021-08-12 16:01:29 +01:00
James Wilson ab2303ce5c more diagnostic logging 2021-08-12 16:01:27 +01:00
James Wilson 3319709f7b Add periodic interval to core loop and print debug info 2021-08-12 16:01:25 +01:00
James Wilson f72f8c1fd5 test runner: fix soak test for multiple ids per ndoe 2021-08-12 16:01:24 +01:00
James Wilson 20463ce159 test runner: enable tokio features 2021-08-12 16:01:19 +01:00
James Wilson e3fcd4e8c2 Clean up soak test runner and add more config options 2021-08-12 16:01:18 +01:00
James Wilson bd7a21ec39 Flumify everything 2021-08-12 16:01:17 +01:00
James Wilson 11b0b3a3c7 remove final use of futures::mpsc and replace with flume 2021-08-12 16:01:15 +01:00
James Wilson 703a9ddc4e use flume throughout telemetry_core 2021-08-12 16:01:14 +01:00
James Wilson 8268cf2afe print feed 1 msg len 2021-08-12 16:01:12 +01:00
James Wilson 98c9ccd278 fmt, clean warnings, tidy aggregator opts and add queue length limit 2021-08-12 16:01:11 +01:00
James Wilson 968dd2b957 Try to force new thread for msg counter to ensure it has time to print 2021-08-12 16:01:09 +01:00
James Wilson b97aec99a8 monitoring queue len 2021-08-12 16:01:07 +01:00
James Wilson 87c0ee7d0d monitor aggregator length (dont discard msgs yet) 2021-08-12 16:00:56 +01:00
James Wilson 35cfb16ed9 Copy and adapt better CI from Soketto instead. Hopefully cache bits will improve build speed 2021-08-12 14:57:10 +01:00
Arsham Teymouri c169650ed5 fixing helm chart issues 2021-08-12 15:50:11 +03:00
James Wilson d4b5c2b0c8 split e2e tests out and run them separately, not blocking the build or marking it as failed 2021-08-12 13:38:29 +01:00
James Wilson 7aa4ad49b3 bump the msg timeout a little higher 2021-08-12 13:10:17 +01:00
James Wilson 7563909609 Fix typo
Co-authored-by: Niklas Adolfsson <niklasadolfsson1@gmail.com>
2021-08-12 12:59:39 +01:00
James Wilson 28b798debe Fix gitlab CI to run on master and auto build/deploy to staging on merge to master 2021-08-12 12:57:03 +01:00
James Wilson bb25a8c3e2 enforce rustfmt and valid doc links in CI 2021-08-12 12:53:14 +01:00
James Wilson 770dd04b57 invert logic to make name make sense and fix comment typo 2021-08-12 12:47:29 +01:00
James Wilson f887510beb remove lint warning on cargo test 2021-08-12 12:42:44 +01:00
James Wilson 4480bbe72a Allow errors as well as closes for now to remove some brittleness 2021-08-12 12:40:53 +01:00
James Wilson 705d57a3b6 Merge pull request #349 from paritytech/jsdw-sharding
Sharded Telemetry Server
2021-08-12 10:40:36 +01:00
James Wilson 9f2db87811 Add a note about the verbosity level of --telemetry-url 2021-08-12 10:20:26 +01:00
James Wilson 80d6ad916e Address David's comments 2021-08-11 17:23:22 +01:00
James Wilson f26b39ac63 Address feedback from Niklas 2021-08-11 16:59:11 +01:00
James Wilson f089ad1758 Tweak CI with fix from Arsham 2021-08-11 12:42:53 +01:00
arshamparity 796ef7e08e Merge pull request #361 from arshamparity/frontend-helm
Frontend helm
2021-08-11 13:32:48 +03:00
Arsham Teymourı 8f6452fba5 remove command section from frontend-deployment 2021-08-11 00:11:14 +03:00
Arsham Teymourı 72311d9b61 adding front to the CI
adding frontend configmaps and envVars

optimizing docker-compose and DockerfIle
2021-08-10 20:07:07 +03:00
Arsham Teymourı ac20d3d845 adding frontend to the helm chart 2021-08-10 13:36:28 +03:00
James Wilson 9f76fabaed give tokio threads a more convenient name for monitoring purposes 2021-08-09 11:36:46 +01:00
James Wilson b22efc804a Fix comment typo 2021-08-09 10:56:01 +01:00
James Wilson 626fe95d89 1 aggregator loop by default for now 2021-08-09 10:13:10 +01:00