Commit Graph

3070 Commits

Author SHA1 Message Date
Vsevolod Stakhov a97ee7b122 Some improvements in the statement-distribution histograms (#5154) 2022-03-18 15:23:34 +00:00
Robert Klotzner 3688e46d1b Don't wait for dispute coordinator (#5157)
* Don't wait for dispute coordinator

in backing and approval-voting - we are single threaded there, so this
is blocking everything.

* Add missing import.

* Don't warn on dropped receiver.
2022-03-18 15:15:50 +00:00
dependabot[bot] 495b6cc937 Bump quote from 1.0.15 to 1.0.16 (#5152)
Bumps [quote](https://github.com/dtolnay/quote) from 1.0.15 to 1.0.16.
- [Release notes](https://github.com/dtolnay/quote/releases)
- [Commits](https://github.com/dtolnay/quote/compare/1.0.15...1.0.16)

---
updated-dependencies:
- dependency-name: quote
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-18 16:15:04 +01:00
Shawn Tabrizi 4d3f6a202e Remove Superfluous Test in Crowdloan Migration (#5158)
* remove stupid check

* here too
2022-03-18 15:06:45 +00:00
asynchronous rob d76583cd3b fix freshness calculations in statement distribution (#5151)
* fix freshness calculations in statement distribution

* Fix logic.

Co-authored-by: Robert Klotzner <robert.klotzner@gmx.at>
2022-03-18 15:40:44 +01:00
Bernhard Schuster 6e3b5f1888 bitfield dist logging cleanup and enhancements (#5147)
* split metrics from bitfield signing

* cleanup all logging

* add a unit test for subset generation

* chore: add one more test to assert need is properly represented

* u8 as usize

* chore: overseer fixin

* fix test

* Update node/network/bitfield-distribution/src/metrics.rs

Co-authored-by: Andrei Sandu <54316454+sandreim@users.noreply.github.com>

* Update node/network/bitfield-distribution/src/metrics.rs

Co-authored-by: Andrei Sandu <54316454+sandreim@users.noreply.github.com>

* fallout from suggested rename

* consistency

Co-authored-by: Andrei Sandu <54316454+sandreim@users.noreply.github.com>
2022-03-18 13:44:38 +00:00
dependabot[bot] 61a6004cf1 Bump parity-scale-codec from 3.1.0 to 3.1.2 (#5153)
Bumps [parity-scale-codec](https://github.com/paritytech/parity-scale-codec) from 3.1.0 to 3.1.2.
- [Release notes](https://github.com/paritytech/parity-scale-codec/releases)
- [Changelog](https://github.com/paritytech/parity-scale-codec/blob/master/CHANGELOG.md)
- [Commits](https://github.com/paritytech/parity-scale-codec/commits)

---
updated-dependencies:
- dependency-name: parity-scale-codec
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-18 10:32:49 +00:00
Robert Klotzner 569599853d Logs for large messages + metrics on size. (#5143)
* Logs for large messages + metrics on size.

* Fix typo
2022-03-17 19:57:35 +00:00
Shawn Tabrizi dd6fdf0f14 Fix Benchmark Regressions in Polkadot Parachain Auction System (#5139)
* integration tests use offset

* fix slots

* fix auctions

* add auctions benchmark

* fix crowdloan
2022-03-17 15:56:50 +00:00
Bernhard Schuster 16fe04dc79 track tof for inter subsystem messages (#5135) 2022-03-17 11:19:11 +01:00
dependabot[bot] 5c21822e17 Bump syn from 1.0.88 to 1.0.89 (#5146)
Bumps [syn](https://github.com/dtolnay/syn) from 1.0.88 to 1.0.89.
- [Release notes](https://github.com/dtolnay/syn/releases)
- [Commits](https://github.com/dtolnay/syn/compare/1.0.88...1.0.89)

---
updated-dependencies:
- dependency-name: syn
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-17 10:57:57 +01:00
Vsevolod Stakhov 310a2e9911 Sligth improvements to the collator side metrics and logs (#5144)
* Use more reasonable buckets for `process_msg` histogram

* Another adjustments of the buckets

* Move historgram timer to a more relevant place

* Add a dedicated collation distribution time metric

* Cargo fmt
2022-03-17 09:39:44 +00:00
Bernhard Schuster 20d0cf0ae9 provisioner logs minor janitor duties (#5142)
* provisioner data, one more log

* minor cleanups in provisioner logs

* remove deprecated foo in overseer

Closes #5128

* candidate_hash needs the ? prefix in gum

* demote to trace
2022-03-17 09:02:49 +00:00
Georges 1c443c65ef Companion to Moving NposSolution to frame #11031 (#5112)
* using `frame_npos_elections_solution_type`

* forget to commit one change

* substrate pallet renaming

* `Support` moved to frame in substrate

* update lockfile for {"substrate"}

Co-authored-by: parity-processbot <>
2022-03-16 22:03:25 +00:00
Tsvetomir Dimitrov f35f5ae9a4 Additional tracing in provisioner (#5125)
* Additional tracing in provisioner

Add debug logs for `fn send_inherent_data`.

* Code review feedback

* Code review feedback

* Code review feedback

* Fix unit tests
2022-03-16 15:55:10 +00:00
Mara Robin B 8ba34ef1fe update weights (#5097)
* westend: update weights

* kusama: update weights

* polkadot: update weights

* westend: update weights (production profile)

* kusama: update weights (production profile)

* polkadot: update weights (production profile)

* kusama: update weights (production profile pt 2)

* westend: update weights (production profile pt 2)

* fixup

* fixup

* cargo run --quiet --profile=production  --features=runtime-benchmarks -- benchmark --chain=polkadot-dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/

* cargo run --quiet --profile=production  --features=runtime-benchmarks -- benchmark --chain=kusama-dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/kusama/src/weights/

* cargo run --quiet --profile=production  --features=runtime-benchmarks -- benchmark --chain=westend-dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/westend/src/weights/

Co-authored-by: Parity Bot <admin@parity.io>
2022-03-16 16:47:22 +01:00
Robert Habermeier 1d695612c4 strengthen signals-received atomics (#5132)
* strengthen signals-received atomics

* Update node/overseer/overseer-gen/src/lib.rs

Co-authored-by: Andrei Sandu <54316454+sandreim@users.noreply.github.com>

* fmt

Co-authored-by: Andrei Sandu <54316454+sandreim@users.noreply.github.com>
2022-03-16 16:40:32 +01:00
Shawn Tabrizi a69330f081 Add Child Bounties to Polkadot and Kusama (#4863)
* add to kusama

* polkadot too

* cargo run --quiet --profile=production  --features=runtime-benchmarks -- benchmark --chain=kusama-dev --steps=50 --repeat=20 --pallet=pallet_child_bounties --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/kusama/src/weights/

* cargo run --quiet --profile=production  --features=runtime-benchmarks -- benchmark --chain=polkadot-dev --steps=50 --repeat=20 --pallet=pallet_child_bounties --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/

* Update Cargo.lock

* Update runtime/kusama/src/lib.rs

* Update runtime/polkadot/src/lib.rs

* import

Co-authored-by: Parity Bot <admin@parity.io>
2022-03-16 13:41:16 +00:00
Vsevolod Stakhov 11d78a049b Collator protocol debug (#5129)
* add two more timers

* Update node/network/availability-recovery/src/metrics.rs

* Try to improve comments spelling

* Cargo fmt iteration

* Add some presumably useful debugging for collator protocol

* Address review comments

Co-authored-by: Bernhard Schuster <bernhard@ahoi.io>
2022-03-16 06:43:50 +00:00
Robert Habermeier 5904ae418e make more subsystems blocking, fix blocking subsystem spawning (#5133)
* make more subsystems blocking

* actually spawn blocking subsystems on their own threads
2022-03-16 06:41:20 +00:00
dependabot[bot] 2ead4ce12d Bump syn from 1.0.87 to 1.0.88 (#5118)
Bumps [syn](https://github.com/dtolnay/syn) from 1.0.87 to 1.0.88.
- [Release notes](https://github.com/dtolnay/syn/releases)
- [Commits](https://github.com/dtolnay/syn/compare/1.0.87...1.0.88)

---
updated-dependencies:
- dependency-name: syn
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-15 21:18:18 +01:00
Robert Klotzner 582f8628ea Add more info to logs. (#5123) 2022-03-15 19:39:43 +00:00
Bernhard Schuster d309a24e50 observability: add two more timers (#5124)
* add two more timers

* Update node/network/availability-recovery/src/metrics.rs

* Try to improve comments spelling

* Cargo fmt iteration

Co-authored-by: Vsevolod Stakhov <vsevolod.stakhov@parity.io>
2022-03-15 15:23:05 +00:00
Mara Robin B 2c8ea1e0e4 [ci] scripts: don't rebuild for every pallet benchmark (#5126)
* scripts: don't rebuild for every pallet benchmark

* ci: remove orphan variable

* [ci] run_benches_for_runtime.sh: explicit relative path names

* [ci] scripts: handle failing benchmarks
2022-03-15 15:59:33 +01:00
dependabot[bot] 109c422149 Bump reqwest from 0.11.9 to 0.11.10 (#5117)
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.9 to 0.11.10.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.9...v0.11.10)

---
updated-dependencies:
- dependency-name: reqwest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-15 13:36:16 +00:00
Doordashcon b72bd9ef6c StatementDistributionMessage::get_metadata is a footgun and should be removed (#5101)
* remove get_metadata method

* cargo fmt

* add get_metadata function in test

* cargo fmt

* Update node/network/statement-distribution/src/tests.rs

Co-authored-by: Robert Habermeier <rphmeier@gmail.com>

* update

* update

Co-authored-by: Robert Habermeier <rphmeier@gmail.com>
2022-03-15 11:52:01 +00:00
Vsevolod Stakhov 3a862e2a54 Add metrics timer for the PerRequest structure lifetime (#5108)
* Add metrics timer for the PerRequest structure lifetime

* Add custom buckets
2022-03-15 11:05:35 +00:00
Bernhard Schuster d631f1dea8 observability: tracing gum, automatically cross ref traceID (#5079)
* add some gum

* bump expander

* gum

* fix all remaining issues

* last fixup

* Update node/gum/proc-macro/src/lib.rs

Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>

* change

* netowrk

* fixins

* chore

* allow optional fmt str + args, prep for expr as kv field

* tracing -> gum rename fallout

* restrict further

* allow multiple levels of field accesses

* another round of docs and a slip of the pen

* update ADR

* fixup lock fiel

* use target: instead of target=

* minors

* fix

* chore

* Update node/gum/README.md

Co-authored-by: Andrei Sandu <54316454+sandreim@users.noreply.github.com>

Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>
Co-authored-by: Andrei Sandu <54316454+sandreim@users.noreply.github.com>
2022-03-15 11:05:16 +00:00
Dan Shields fa359fd1f7 Rococo rm uneeded migrations, as network reset to "2.1" (#5115)
* rm uneeded migrations, rococo reset to "2.1"

* rm unimplimented generics
README update

* rm unused imports

* Randomness rm
2022-03-15 01:49:17 -05:00
Dan Shields 1b985c5d36 Rococo to use BABE randomness, Westend & Rococo runtime synchronization in file format (#5082)
* * Rococo to use BABE randomness
* Westend & Rococo runtime syncronization in file format (starting)

* explicit frame_support::weights::Weight
2022-03-15 00:34:34 +00:00
Robert Habermeier 474a2c02c4 Some small log improvements (#5110)
* improve provisioner log

* change log target from availability to availability-store
2022-03-14 19:22:48 +00:00
dependabot[bot] 3335ddc0da Bump parity-scale-codec from 3.0.0 to 3.1.0 (#5096)
Bumps [parity-scale-codec](https://github.com/paritytech/parity-scale-codec) from 3.0.0 to 3.1.0.
- [Release notes](https://github.com/paritytech/parity-scale-codec/releases)
- [Changelog](https://github.com/paritytech/parity-scale-codec/blob/master/CHANGELOG.md)
- [Commits](https://github.com/paritytech/parity-scale-codec/compare/v3.0...parity-scale-codec-v3.1.0)

---
updated-dependencies:
- dependency-name: parity-scale-codec
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-14 19:34:46 +01:00
dependabot[bot] 111f5b0692 Bump syn from 1.0.86 to 1.0.87 (#5095)
Bumps [syn](https://github.com/dtolnay/syn) from 1.0.86 to 1.0.87.
- [Release notes](https://github.com/dtolnay/syn/releases)
- [Commits](https://github.com/dtolnay/syn/compare/1.0.86...1.0.87)

---
updated-dependencies:
- dependency-name: syn
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-14 19:28:01 +01:00
Vsevolod Stakhov 55b38b2b8f Approval-distribution: Fix out-of-view messages caused by a race condition in view updates (#5089)
* Try to fix out-of-view messages in approval distribution

Suggested by: @ordian

* Cargo fmt

* Add a unit test for the proposed fix

* Spelling fix

* Use a simplier approach to fix the race condition as suggested by @rphmeier

* Cargo fmt run
2022-03-14 17:07:32 +01:00
Tsvetomir Dimitrov c18e804c3d Fix units usage in node/service/src/chain_spec.rs (#5099)
For clarity replace `DOT` with `WND` and `ROC` in
`westend_testnet_genesis` and `rococo_testnet_genesis` functions.
2022-03-14 15:24:18 +00:00
Mara Robin B f67517f3b3 ci: use production profile for all benchmarks (follow-up for #5100) (#5102) 2022-03-14 13:44:24 +01:00
Georges 22229991fa Companion to Move sp-npos-elections-solution-type to frame-election-provider-support #11016 (#5090)
* using `frame_npos_elections_solution_type`

* forget to commit one change

* substrate pallet renaming

* cargo update -p sp-io

Co-authored-by: kianenigma <kian@parity.io>
2022-03-14 11:38:49 +00:00
Mara Robin B 68209b7a5f ci: use production profile for benchmarks (#5100) 2022-03-14 12:22:55 +01:00
Andrei Sandu 3e357ec0a8 Zombienet: add cpu/mem resource requests (#5080)
* Ensure request/limits for CPU and memory for nodes

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* docker.io/paritytech/zombienet:v1.2.19

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* Deny failure

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* add retry back

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
2022-03-14 10:47:37 +00:00
Oliver Tale-Yazdi eec58039f1 Parachain runtime dependent weights (#5091)
* Prepare for parachain runtime dependent weights

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Lockfile

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* CI

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* fmt

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* CI

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* CI

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>
2022-03-12 19:37:24 +00:00
Oliver Tale-Yazdi 2b8f6e9d0a Runtime dependent weights (#5064)
* Copy Substrate weights into each runtime

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Define weights per runtime

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Do the same for test-runtime

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Fix CI

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Generate multiplier tests via macro

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Fix tests

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Fix CI

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Fix imports

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Fix test

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Fix imports

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Change rococo tests to use ExtrinsicBaseWeight

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Fix imports

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Spellcheck on

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Spellcheck on

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Spellcheck

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Re-Export weight constants in the runtime

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Prepare for cumulus companion

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Fmt

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

Co-authored-by: Shawn Tabrizi <shawntabrizi@gmail.com>
2022-03-11 16:36:08 +00:00
dependabot[bot] 078bf68037 Bump expander from 0.0.5 to 0.0.6 (#5086)
Bumps [expander](https://github.com/drahnr/expander) from 0.0.5 to 0.0.6.
- [Release notes](https://github.com/drahnr/expander/releases)
- [Commits](https://github.com/drahnr/expander/compare/v0.0.5...v0.0.6)

---
updated-dependencies:
- dependency-name: expander
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-11 16:27:14 +01:00
Chris Sosnin 681f3f4ed9 Fix session index lookup for activated leaf (#4850) 2022-03-11 12:14:48 +01:00
Dan Shields 6fc2da146f Bump all spec version to 9180 and versions to 0.9.18 (#5083)
* bump all spec version to 9180 and versions to 0.9.18

* all to 0.9.18

* lock update
2022-03-11 10:19:47 +01:00
Robert Habermeier 8a17c614f0 Check signatures as "Compact" in statement distribution (#5071)
* allow converting payloads _up_

* convert to superpayload in statement-distribution

* Update primitives/src/v2/signed.rs

Co-authored-by: Andronik <write@reusable.software>

Co-authored-by: Andronik <write@reusable.software>
2022-03-10 20:49:35 +00:00
Amar Singh 22a7fad75f Add babe randomness to well known keys (#5030)
* add babe randomness storage keys to well known keys

* Update primitives/src/v1/mod.rs

Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>
2022-03-10 19:00:57 +00:00
Bernhard Schuster 9369dd3384 update mick jaeger and add some sanity unit tests (#5067)
* test: verify identifier generation is correct in jaeger

* bump mick jaeger to 0.1.8

Fixes the trace endianness issue.

* more docs, extra traceID field for CandidateHash as extra tag

* chore: spellcheck

* fix assert statement
2022-03-10 17:25:54 +00:00
Alexander Samusev 3a11be1683 [ci] cancel pipeline if test-linux-stable fail (#5066)
* [Do not merge] cancel pipeline if test-linux-stable fail

* empty commit for pipeline rerun

* fix test-linux-stable

* fail test-linux-stable

* empty commit for pipeline rerun

* fix test-linux-stable

* Update .gitlab-ci.yml

Co-authored-by: Denis Pisarev <denis.pisarev@parity.io>

* small fixes

* add needs

Co-authored-by: Denis Pisarev <denis.pisarev@parity.io>
2022-03-10 18:20:33 +01:00
Mara Robin B 114b82fab6 bump transaction_version (#5074)
* kusama: bump transaction_version

* polkadot: bump transaction_version

* westend: bump transaction_version
2022-03-10 11:49:46 +01:00
dependabot[bot] a863bfe69d Bump tracing from 0.1.31 to 0.1.32 (#5075)
Bumps [tracing](https://github.com/tokio-rs/tracing) from 0.1.31 to 0.1.32.
- [Release notes](https://github.com/tokio-rs/tracing/releases)
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-0.1.31...tracing-0.1.32)

---
updated-dependencies:
- dependency-name: tracing
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-10 09:45:57 +00:00