Commit Graph

623 Commits

Author SHA1 Message Date
James Wilson 28b798debe Fix gitlab CI to run on master and auto build/deploy to staging on merge to master 2021-08-12 12:57:03 +01:00
James Wilson bb25a8c3e2 enforce rustfmt and valid doc links in CI 2021-08-12 12:53:14 +01:00
James Wilson 770dd04b57 invert logic to make name make sense and fix comment typo 2021-08-12 12:47:29 +01:00
James Wilson f887510beb remove lint warning on cargo test 2021-08-12 12:42:44 +01:00
James Wilson 4480bbe72a Allow errors as well as closes for now to remove some brittleness 2021-08-12 12:40:53 +01:00
dependabot[bot] 534118f08d Bump ws from 5.2.2 to 5.2.3 in /frontend
Bumps [ws](https://github.com/websockets/ws) from 5.2.2 to 5.2.3.
- [Release notes](https://github.com/websockets/ws/releases)
- [Commits](https://github.com/websockets/ws/compare/5.2.2...5.2.3)

---
updated-dependencies:
- dependency-name: ws
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-12 09:43:34 +00:00
dependabot[bot] 8abd0dbf68 Bump url-parse from 1.4.7 to 1.5.3 in /frontend
Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.4.7 to 1.5.3.
- [Release notes](https://github.com/unshiftio/url-parse/releases)
- [Commits](https://github.com/unshiftio/url-parse/compare/1.4.7...1.5.3)

---
updated-dependencies:
- dependency-name: url-parse
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-12 09:43:33 +00:00
James Wilson 705d57a3b6 Merge pull request #349 from paritytech/jsdw-sharding
Sharded Telemetry Server
2021-08-12 10:40:36 +01:00
James Wilson 9f2db87811 Add a note about the verbosity level of --telemetry-url 2021-08-12 10:20:26 +01:00
dependabot[bot] fecc11199a chore(deps): bump path-parse from 1.0.6 to 1.0.7 in /frontend
Bumps [path-parse](https://github.com/jbgutierrez/path-parse) from 1.0.6 to 1.0.7.
- [Release notes](https://github.com/jbgutierrez/path-parse/releases)
- [Commits](https://github.com/jbgutierrez/path-parse/commits/v1.0.7)

---
updated-dependencies:
- dependency-name: path-parse
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-12 06:12:19 +00:00
James Wilson 80d6ad916e Address David's comments 2021-08-11 17:23:22 +01:00
James Wilson f26b39ac63 Address feedback from Niklas 2021-08-11 16:59:11 +01:00
James Wilson f089ad1758 Tweak CI with fix from Arsham 2021-08-11 12:42:53 +01:00
arshamparity 796ef7e08e Merge pull request #361 from arshamparity/frontend-helm
Frontend helm
2021-08-11 13:32:48 +03:00
Arsham Teymourı 8f6452fba5 remove command section from frontend-deployment 2021-08-11 00:11:14 +03:00
Arsham Teymourı 72311d9b61 adding front to the CI
adding frontend configmaps and envVars

optimizing docker-compose and DockerfIle
2021-08-10 20:07:07 +03:00
Arsham Teymourı ac20d3d845 adding frontend to the helm chart 2021-08-10 13:36:28 +03:00
James Wilson 9f76fabaed give tokio threads a more convenient name for monitoring purposes 2021-08-09 11:36:46 +01:00
James Wilson b22efc804a Fix comment typo 2021-08-09 10:56:01 +01:00
James Wilson 626fe95d89 1 aggregator loop by default for now 2021-08-09 10:13:10 +01:00
James Wilson c469ef8dfe make AggregatorSet close to zero cost when only 1 aggregator asked for 2021-08-09 10:09:17 +01:00
James Wilson c99cbee1e9 Allow multiple aggregator loops in the core to try and spread feed subscription/send cost out 2021-08-07 17:08:58 +01:00
James Wilson 9c001bdcfd Add a comment on core worker threads 2021-08-06 17:50:50 +01:00
James Wilson 8017d8b00f Cargo fmt 2021-08-06 17:49:19 +01:00
James Wilson 78ad7115e5 set sensible worker thread limits again but allow full control to caller 2021-08-06 17:49:04 +01:00
James Wilson 88c3db3562 cargo fmt 2021-08-06 17:44:26 +01:00
James Wilson 74cf55174e Use rayon to speed up subscribe message serializing 2021-08-06 17:42:03 +01:00
James Wilson 0788270756 Add 'subscribe' benchmark 2021-08-06 14:22:01 +01:00
James Wilson 2dae6c90ce Keep file handle limit comment in sync 2021-08-05 12:22:22 +01:00
James Wilson dbabd453e0 Remove feed message cap; it wasn't pulling its weight 2021-08-05 12:21:16 +01:00
James Wilson bc75ebb068 default core/shard worker threads to 8/4 respectively 2021-08-05 12:18:44 +01:00
James Wilson 4da299bf76 Tweak logging around connections opening and messages coming in 2021-08-05 12:11:46 +01:00
James Wilson acfe3d45d1 num-cpus to worker-threads; more accurate name 2021-08-05 11:31:47 +01:00
James Wilson 5c5c7e592a allow configuration of cpus in soak tests 2021-08-05 11:16:10 +01:00
James Wilson 759d28b1a2 add --num-cpus option 2021-08-05 11:11:23 +01:00
James Wilson 6221cbfd17 Dev tweaks for testing 2021-08-05 11:11:05 +01:00
James Wilson 7d00d72baa Small tweak to make it more obvious when feeds are disconnected 2021-08-04 10:52:53 +01:00
James Wilson db5284a3db Add a comment explaining realistic_soak_test and --release on all 2021-08-03 15:42:42 +01:00
James Wilson 5d81128e74 create more realistic soak test so that we can see a more representative UI in action 2021-08-03 15:40:20 +01:00
arshamparity a85e13e0ec Merge pull request #360 from arshamparity/helm
exposing the shard service to the internet
2021-08-03 15:29:28 +03:00
Arsham Teymourı cf3f323c2e exposing the shard service to the internet 2021-08-03 15:22:09 +03:00
James Wilson f5df1ef68b Merge pull request #356 from arshamparity/helm
Helm
2021-08-02 14:18:33 +01:00
James Wilson 4b00ac79bb Point sahrd to correct port for core 2021-08-02 14:16:20 +01:00
Arsham Teymourı 55537af6f5 extending the helm chart
exposing telemetry core service

adding hpa support for telemetry shard
2021-08-02 12:00:42 +03:00
James Wilson c2892286a6 Add a comment 2021-08-02 09:54:11 +01:00
James Wilson b79759a412 Tidy up close handling and allow either side to close 2021-08-02 09:50:31 +01:00
James Wilson 963ef576f3 add on_close to abstract and simplify ws_client socket closing 2021-08-02 09:30:29 +01:00
James Wilson 13afb96f93 Be more fussy with Soketto channel wrapper; Soketto might do otherwise, but we only explicitly close the connection when both ends of the channel handed out are closed (or we encounter a connection error) 2021-07-30 21:26:52 +01:00
James Wilson 18918e6d3e undo a previous change; close the connection if either side of the channel handed back is dropped/fails 2021-07-30 19:43:26 +01:00
James Wilson a5b04cb4f0 improve socket channel close handling, and test the node banning (roughly) 2021-07-30 18:58:10 +01:00