afc7dd3735
node/core/pvf: strip some deps ( #6016 )
2022-09-15 12:25:03 +00:00
1acc3fa150
Sync versions with current release (v0.9.29) ( #5982 )
...
* Bump transaction_version for westend
* Bump transaction_version for rococo
* Bump transaction_version for kusama
* Bump transaction_version for polkadot
* Bump spec_version to 9290
* Bump crate versions
2022-09-09 11:24:06 +00:00
fc97080cb2
version bumps (0.9.28) ( #5933 )
...
* Bump crate versions
* Bump spec_version to 9280 for kusama
* Bump spec_version to 9280 for polkadot
* Bump spec_version to 9280 for rococo
* Bump spec_version to 9280 for westend
* update Cargo.lock
Co-authored-by: parity-processbot <>
2022-08-29 18:01:58 +02:00
85dabbd850
Backport crate version bumps to 0.9.27 ( #5826 )
...
* Bump crate versions
* Update cargo.lock
2022-07-28 10:03:27 +00:00
9fc4e16eff
Version bump to v0.9.26/9260 ( #5755 )
...
* Bump spec_version to 9260
* Version bump to v0.9.26
2022-07-06 10:31:45 +00:00
09b10fa25e
Bump parity-scale-codec from 3.1.2 to 3.1.5 ( #5720 )
...
Bumps [parity-scale-codec](https://github.com/paritytech/parity-scale-codec ) from 3.1.2 to 3.1.5.
- [Release notes](https://github.com/paritytech/parity-scale-codec/releases )
- [Changelog](https://github.com/paritytech/parity-scale-codec/blob/master/CHANGELOG.md )
- [Commits](https://github.com/paritytech/parity-scale-codec/compare/parity-scale-codec-3.1.2...parity-scale-codec-3.1.5 )
---
updated-dependencies:
- dependency-name: parity-scale-codec
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-27 10:27:49 +00:00
94a85eeac7
pvf: ensure enough stack space ( #5712 )
...
* pvf: ensure enough stack space
* fix typos
Co-authored-by: Andronik <write@reusable.software >
* Use rayon to cache the thread
Co-authored-by: Andronik <write@reusable.software >
2022-06-24 13:16:36 +02:00
e03c24ec47
pvf: unignore terminates_on_timeout test ( #5722 )
2022-06-23 12:45:19 +00:00
97f9b840e4
bump versions to 0.9.25 ( #5684 )
...
* kusama: bump spec_version to 9250
* polkadot: bump spec_version to 9250
* rococo: bump spec_version to 9250
* westend: bump spec_version to 9250
* bump version to 0.9.25
* bump transaction version (polkadot & kusama) (#5690 )
* kusama: bump transaction_version to 12
* polkadot: bump transaction_version to 13
2022-06-21 13:02:04 +00:00
026848c932
Companion to Substrate #11490 ( #5603 )
...
* Fix warnings
* Bump
2022-05-30 11:21:03 +01:00
7eba8f2162
bump to 0.9.23 ( #5593 )
...
* bump version to 0.9.23
* bump spec_version to 9230
2022-05-27 10:18:23 +02:00
d9eff4ecd4
Switch to pooling copy-on-write instantiation strategy for WASM (companion for Substrate#11232) ( #5337 )
...
* Switch to pooling copy-on-write instantiation strategy for WASM
* Fix compilation of `polkadot-test-service`
* Update comments
* Move `max_memory_size` to `Semantics`
* Rename `WasmInstantiationStrategy` to `WasmtimeInstantiationStrategy`
* Update a safety comment
* update lockfile for {"substrate"}
Co-authored-by: parity-processbot <>
2022-05-19 13:06:34 +02:00
3b685fbf91
version bumps (0.9.22) ( #5495 )
...
* bump versions to 0.9.22
* bump spec_version to 9220
2022-05-16 13:24:24 +02:00
b89dc00ec0
Fixes the dead lock when any of the channels get at capacity. ( #5297 )
...
The PVF host is designed to avoid spawning tasks to minimize knowledge
of outer code. Using `async_std::task::spawn` (or Tokio's counterpart)
deemed unacceptable, `SpawnNamed` undesirable. Instead there is only one
task returned that is spawned by the candidate-validation subsystem.
The tasks from the sub-components are polled by that root task.
However, the way the tasks are bundled was incorrect. There was a giant
select that was polling those tasks. Particularly, that implies that as soon as
one of the arms of that select goes into await those sub-tasks stop
getting polled. This is a recipe for a deadlock which indeed happened
here.
Specifically, the deadlock happened during sending messages to the
execute queue by calling
[`send_execute`](https://github.com/paritytech/polkadot/blob/a68d9be35656dcd96e378fd9dd3d613af754d48a/node/core/pvf/src/host.rs#L601 ).
When the channel to the queue reaches the capacity, the control flow is
suspended until the queue handles those messages. Since this code is
essentially reached from [one of the select
arms](https://github.com/paritytech/polkadot/blob/a68d9be35656dcd96e378fd9dd3d613af754d48a/node/core/pvf/src/host.rs#L371 ),
the queue won't be given the control and thus no further progress can be
made.
This problem is solved by bundling the tasks one level higher instead,
by `selecting` over those long-running tasks.
We also stop treating returning from those long-running tasks as error
conditions, since that can happen during legit shutdown.
2022-04-09 10:57:34 +00:00
7ed275bff8
bump version to 0.9.19 ( #5290 )
2022-04-08 11:48:43 +00:00
b424e5e741
Companion for Substrate#11107 ( #5197 )
...
* Rename to BagError
* Additional parameter for 'revert' command
* Set aux revert param to None
* Align to changes in how the WASM executor is configured in `substrate`
* update lockfile for {"substrate"}
* update lockfile for {"substrate"}
* Update substrate
* Update substrate
Co-authored-by: Keith Yeung <kungfukeith11@gmail.com >
Co-authored-by: Davide Galassi <davxy@datawok.net >
Co-authored-by: Shawn Tabrizi <shawntabrizi@gmail.com >
Co-authored-by: parity-processbot <>
2022-03-24 15:56:57 -04:00
1656c4cd02
Companion to Implementing MaxEncodedLen for generate_solution_type #11032 ( #5145 )
...
* Fixing `generate_solution_type`
This is needed after changes to substrate
* `VoterSnapshotPerBlock` -> `MaxElectingVoters`
* rename `SizeBound` to `MaxVoters`
* cargo update -p sp-io
* ignore failing test
* spell-check
* fix pub OffchainRepeat
Co-authored-by: kianenigma <kian@parity.io >
Co-authored-by: Kian Paimani <5588131+kianenigma@users.noreply.github.com >
2022-03-23 13:18:57 +00:00
fbfcf3f066
Bump async-std from 1.10.0 to 1.11.0 ( #5186 )
...
Bumps [async-std](https://github.com/async-rs/async-std ) from 1.10.0 to 1.11.0.
- [Release notes](https://github.com/async-rs/async-std/releases )
- [Changelog](https://github.com/async-rs/async-std/blob/master/CHANGELOG.md )
- [Commits](https://github.com/async-rs/async-std/compare/v1.10.0...v1.11.0 )
---
updated-dependencies:
- dependency-name: async-std
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-23 11:16:30 +01:00
61a6004cf1
Bump parity-scale-codec from 3.1.0 to 3.1.2 ( #5153 )
...
Bumps [parity-scale-codec](https://github.com/paritytech/parity-scale-codec ) from 3.1.0 to 3.1.2.
- [Release notes](https://github.com/paritytech/parity-scale-codec/releases )
- [Changelog](https://github.com/paritytech/parity-scale-codec/blob/master/CHANGELOG.md )
- [Commits](https://github.com/paritytech/parity-scale-codec/commits )
---
updated-dependencies:
- dependency-name: parity-scale-codec
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-18 10:32:49 +00:00
d631f1dea8
observability: tracing gum, automatically cross ref traceID ( #5079 )
...
* add some gum
* bump expander
* gum
* fix all remaining issues
* last fixup
* Update node/gum/proc-macro/src/lib.rs
Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com >
* change
* netowrk
* fixins
* chore
* allow optional fmt str + args, prep for expr as kv field
* tracing -> gum rename fallout
* restrict further
* allow multiple levels of field accesses
* another round of docs and a slip of the pen
* update ADR
* fixup lock fiel
* use target: instead of target=
* minors
* fix
* chore
* Update node/gum/README.md
Co-authored-by: Andrei Sandu <54316454+sandreim@users.noreply.github.com >
Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com >
Co-authored-by: Andrei Sandu <54316454+sandreim@users.noreply.github.com >
2022-03-15 11:05:16 +00:00
3335ddc0da
Bump parity-scale-codec from 3.0.0 to 3.1.0 ( #5096 )
...
Bumps [parity-scale-codec](https://github.com/paritytech/parity-scale-codec ) from 3.0.0 to 3.1.0.
- [Release notes](https://github.com/paritytech/parity-scale-codec/releases )
- [Changelog](https://github.com/paritytech/parity-scale-codec/blob/master/CHANGELOG.md )
- [Commits](https://github.com/paritytech/parity-scale-codec/compare/v3.0...parity-scale-codec-v3.1.0 )
---
updated-dependencies:
- dependency-name: parity-scale-codec
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-14 19:34:46 +01:00
6fc2da146f
Bump all spec version to 9180 and versions to 0.9.18 ( #5083 )
...
* bump all spec version to 9180 and versions to 0.9.18
* all to 0.9.18
* lock update
2022-03-11 10:19:47 +01:00
a863bfe69d
Bump tracing from 0.1.31 to 0.1.32 ( #5075 )
...
Bumps [tracing](https://github.com/tokio-rs/tracing ) from 0.1.31 to 0.1.32.
- [Release notes](https://github.com/tokio-rs/tracing/releases )
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-0.1.31...tracing-0.1.32 )
---
updated-dependencies:
- dependency-name: tracing
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-10 09:45:57 +00:00
e8cb6cdaac
Companion to "Updating scale to v3" ( #4958 )
...
* Updating dependencies
* Adapting code to scale v3
* Upgrade bitvec to 1.0.0
* Fix bitvec arithmetics
* Update Cargo.lock
* Update sp-io
* Fixing the build
* Yanked scale-info 2.0.0
Co-authored-by: Bastian Köcher <info@kchr.de >
2022-02-25 13:07:06 +01:00
d9d53c17a1
Switch to edition 2021 ( #4976 )
...
* Switch to edition 2021
* Reset bridges
* Fix compilation
* Fix test-runtime
* Fix malus
2022-02-24 10:20:58 +00:00
6fdd026010
Bump tracing from 0.1.30 to 0.1.31 ( #4941 )
...
Bumps [tracing](https://github.com/tokio-rs/tracing ) from 0.1.30 to 0.1.31.
- [Release notes](https://github.com/tokio-rs/tracing/releases )
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-0.1.30...tracing-0.1.31 )
---
updated-dependencies:
- dependency-name: tracing
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-02-18 09:54:13 +00:00
98a1343cd9
Bump rand from 0.8.4 to 0.8.5 ( #4917 )
...
Bumps [rand](https://github.com/rust-random/rand ) from 0.8.4 to 0.8.5.
- [Release notes](https://github.com/rust-random/rand/releases )
- [Changelog](https://github.com/rust-random/rand/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-random/rand/compare/0.8.4...0.8.5 )
---
updated-dependencies:
- dependency-name: rand
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-02-14 11:37:02 +01:00
f00f24e656
Bump tracing from 0.1.29 to 0.1.30 ( #4897 )
...
Bumps [tracing](https://github.com/tokio-rs/tracing ) from 0.1.29 to 0.1.30.
- [Release notes](https://github.com/tokio-rs/tracing/releases )
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-0.1.29...tracing-0.1.30 )
---
updated-dependencies:
- dependency-name: tracing
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-02-11 23:17:19 +01:00
167df32561
Bump version ( #4904 )
...
* Bump spec_version
* Bump version to 0.9.17
2022-02-11 20:43:39 +01:00
cb611c255c
Bump futures from 0.3.19 to 0.3.21 ( #4886 )
...
Bumps [futures](https://github.com/rust-lang/futures-rs ) from 0.3.19 to 0.3.21.
- [Release notes](https://github.com/rust-lang/futures-rs/releases )
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.19...0.3.21 )
---
updated-dependencies:
- dependency-name: futures
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-02-11 10:13:02 +01:00
7e9a58fc99
Version bumps to v0.9.16 and 9160 ( #4767 )
...
* Bump spec_version
* Bump version to 0.9.16
2022-02-02 15:22:32 +01:00
50828ad145
Update pvf metric histogram buckets ( #4818 )
...
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
2022-01-31 17:28:58 +00:00
bab7c8d4f1
Bump pin-project from 1.0.8 to 1.0.9 ( #4606 )
...
* Bump pin-project from 1.0.8 to 1.0.9
Bumps [pin-project](https://github.com/taiki-e/pin-project ) from 1.0.8 to 1.0.9.
- [Release notes](https://github.com/taiki-e/pin-project/releases )
- [Changelog](https://github.com/taiki-e/pin-project/blob/main/CHANGELOG.md )
- [Commits](https://github.com/taiki-e/pin-project/compare/v1.0.8...v1.0.9 )
---
updated-dependencies:
- dependency-name: pin-project
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
* Update pin-project to fix compilation
* Also bump the old ones
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Bastian Köcher <info@kchr.de >
2022-01-02 18:25:56 +01:00
48dc675047
Companion for substrate#9732 ( #4104 )
...
* merge master (do not compile)
* fix
* lock
* update lock
* Update to refactoring.
* runtime version
* fmt
* remove trie patch
* remove patch
* No layout alias for bridge proof.
* update depupdate depss
* No switch until migration.
* master lock
* test
* test
* Revert "test"
This reverts commit 57325ef73332bf4b054aa4a667bb716fcf8a0d89.
* Revert "test"
This reverts commit ce74d0e2062806f72c0e9e9ca07b14165f43521e.
* rename feature
* state version as parameter, use the feature only on runtimes.
* update
* update to state version in runtime
* state version from storage
* update lockfile for substrate
Co-authored-by: parity-processbot <>
2021-12-24 09:27:35 +00:00
9df7dea61f
Bump futures from 0.3.18 to 0.3.19 ( #4567 )
...
Bumps [futures](https://github.com/rust-lang/futures-rs ) from 0.3.18 to 0.3.19.
- [Release notes](https://github.com/rust-lang/futures-rs/releases )
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19 )
---
updated-dependencies:
- dependency-name: futures
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 11:43:46 +01:00
1493fed1ed
PVF validation host: do not alter niceness ( #4525 )
...
We wanted to change niceness to accomodate the fact that some of the
preparation tasks are low priority. For example, when a node sees that
there is a new para was onboarded the node may start preparing right
away. Since all other activities are more important, such as network I/O
or validation of the backed candidates and preparation of the
immediatelly needed PVFs.
However, it turned out that this approach does not work: generally
non-root processes can only decrease niceness and they cannot increase
it to the previous value, as was assumed by the code.
Apart from that, https://github.com/paritytech/polkadot/pull/4123
assumes all PVFs are prepared in the same way. Specifically, that if a
PVF preparation failed before, then PVF pre-checking will also report
that it was failed, even though it could happen that preparation failed
due to being low-priority. In order to avoid such cases, we decided to
simplify the whole preparation model. Preparation under low priority
does not work well with that.
Closes https://github.com/paritytech/polkadot/issues/4520
2021-12-14 17:17:45 +01:00
c328d1e63b
Companion for Substrate#10394 ( #4471 )
...
* Align PVF executor to changes in Substrate
* Update to the newest `substrate`
2021-12-14 09:47:10 +00:00
3f861f4f45
Upgrade Substrate and downgrade libc ( #4514 )
...
Libc 0.2.110 was yanked, so we move one version.
2021-12-11 10:02:20 +01:00
1bc85624f8
Bump libc from 0.2.108 to 0.2.110 ( #4502 )
...
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.108 to 0.2.110.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.108...0.2.110 )
---
updated-dependencies:
- dependency-name: libc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-11 08:05:39 +01:00
77d70ac0d3
Companion PR for removing Prometheus metrics prefix ( #3623 )
...
* Companion PR for removing Prometheus metrics prefix
* Was missing some metrics
* Fix missing renames
* Fix test
* Fixes
* Update test
* Update Substrate
* Second time
* remove prefix from intergration test for zombienet
* update zombienet image
* Update Substrate
Co-authored-by: Bastian Köcher <info@kchr.de >
Co-authored-by: Javier Viola <pepoviola@gmail.com >
2021-12-10 15:24:54 +01:00
762ec19ac0
cli: introduce host-perf-check command ( #4342 )
2021-12-09 12:26:16 +01:00
4adb8466a3
dev-comment spelling mistakes ( #4434 )
2021-12-06 15:20:29 +01:00
172f355ca4
Treat non-deterministic prep errors as internal errors ( #4364 )
...
Closes https://github.com/paritytech/polkadot/issues/4293
This PR changes the way how we treat a certain subset of PVF preparation
errors. Specifically, now only the deterministic errors are treated as
invalid candidates. That is, the errors that are easily
attributable to either the the PVF contents or the wasmtime code, but
not e.g. I/O errors that could be triggered by the OS (insufficient
memory, disk failure, too much load, etc). The latter are treated as
internal errors and thus do not trigger the disputes.
2021-11-29 15:42:43 +01:00
7c49545315
Fix typo: ambigious -> ambiguous ( #4380 )
...
* Do not log PVF prunning every hour
This lowers the level of the PVF pruning.
Closes https://github.com/paritytech/polkadot/issues/4361
* Fix typo: ambigious -> ambiguous
The correct spelling is ambiguous
([dictionary](https://dictionary.cambridge.org/dictionary/english/ambiguous ))
2021-11-27 10:14:00 +01:00
f6b4215100
Do not log PVF prunning every hour ( #4372 )
...
This lowers the level of the PVF pruning.
Closes https://github.com/paritytech/polkadot/issues/4361
2021-11-26 16:41:58 +01:00
48f6c17e77
OCD: Remove ,) in PVF ( #4362 )
2021-11-24 14:27:30 +01:00
5310bd5585
Bump libc from 0.2.107 to 0.2.108 ( #4343 )
...
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.107 to 0.2.108.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.107...0.2.108 )
---
updated-dependencies:
- dependency-name: libc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-11-22 11:51:17 +01:00
bd422af092
prepare worker: Catch unexpected unwinds ( #4304 )
...
* prepare worker: Catch unexpected unwinds
* Use more specific wording for unknown panic payload
2021-11-18 19:11:13 +01:00
4a2e412000
Bump async-process from 1.1.0 to 1.3.0 ( #4260 )
...
Bumps [async-process](https://github.com/smol-rs/async-process ) from 1.1.0 to 1.3.0.
- [Release notes](https://github.com/smol-rs/async-process/releases )
- [Changelog](https://github.com/smol-rs/async-process/blob/master/CHANGELOG.md )
- [Commits](https://github.com/smol-rs/async-process/compare/v1.1.0...v1.3.0 )
---
updated-dependencies:
- dependency-name: async-process
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-11-16 18:07:55 +01:00
08b8929c32
bump versions ( #4285 )
2021-11-15 14:05:12 +01:00
Andronik