Commit Graph

3537 Commits

Author SHA1 Message Date
Andrei Sandu d7eaaeee65 Remove orchestra and metered channel (#6086)
* Use orchestra and metered channel from repo

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* Update node/subsystem-util/Cargo.toml

Co-authored-by: Andronik <write@reusable.software>

* Update node/subsystem-types/Cargo.toml

Co-authored-by: Andronik <write@reusable.software>

* Update node/metrics/Cargo.toml

Co-authored-by: Andronik <write@reusable.software>

* Update node/overseer/Cargo.toml

Co-authored-by: Andronik <write@reusable.software>

* Update node/overseer/Cargo.toml

Co-authored-by: Andronik <write@reusable.software>

* update cargo lock

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
Co-authored-by: Andronik <write@reusable.software>
2022-10-03 12:26:23 +02:00
Serban Iorga 5458406927 Companion for pallet-mmr: generate historical proofs (#6061)
* BEEFY: generate historical proofs

Signed-off-by: Serban Iorga <serban@parity.io>

* cargo update -p sp-io

* Properly set max proof size for runtimes

* Properly set max proof size for mocks

* cargo fmt

* Set appropriate UMP service total proof size weight

* Disable zombienet-tests-parachains-disputes CI

* Add comment explaining weight math

* Use MAX_POV_SIZE for max proof size

* Cast to u64

* Remove comment

Signed-off-by: Serban Iorga <serban@parity.io>
Co-authored-by: Keith Yeung <kungfukeith11@gmail.com>
2022-10-02 10:42:24 +01:00
omahs f45a8de8ae Fix: minor typo (#6088)
Fix: minor typo
2022-10-01 09:16:32 +03:00
Andrei Sandu 372e6a95f3 add para_id to fetch_pov logging (#6084)
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
2022-09-30 11:56:45 +03:00
Robert Klotzner 260f70e39e Demote warning (#6080)
This can happen under heavy load - no value in warning here.

Scenario this happens:

- New slot
- We get asked about what fork to build on
- We start building (create inherent gets called)
- We learn about a better fork (but Babe does not care as it already has a fork)
- 6 seconds passed - New slot
- Babe asks about what for to build on - we answer with the best block we learned about 6 seconds ago (slightly after we got asked the last time)
- We start building (on that old block)
- Milliseconds later we learn about a new block (the one from the slot we are actually in now)
- We kick the old leaf -> create inherent fails

Full discussion: https://github.com/paritytech/substrate/issues/12375
2022-09-29 15:19:19 +02:00
Robert Klotzner 548b4c6c71 Validate chunks from disk in availability-recovery (#6078)
* Don't use corrupted chunks from disk.

Otherwise we would be going to dispute the candidate and get slashed.

* Add tests
2022-09-29 14:16:12 +02:00
Nikos Kontakis 39e55ffd0a Rename zombienet extension (#6073)
* Rename extension files and respective entries from '.feature' to '.zndsl'

* Rename zombienet extension for 0001-dispute-valid-block test
2022-09-29 07:22:15 +00:00
Kian Paimani 9196f32bc0 add fast-unstsake pallet to all runtimes (#6050)
* add fast-unstsake pallet to all runtimes

* ".git/.scripts/fmt.sh" 1

* ".git/.scripts/bench-bot.sh" runtime polkadot-dev pallet_fast_unstake

* ".git/.scripts/bench-bot.sh" runtime westend-dev pallet_fast_unstake

* fix up all the weight stuff

* update substrate

* update mistake in kusama

* add stub file

* Update runtime/polkadot/src/lib.rs

Co-authored-by: Nitwit <47109040+BustaNit@users.noreply.github.com>

* Update runtime/westend/src/lib.rs

Co-authored-by: Nitwit <47109040+BustaNit@users.noreply.github.com>

* cargo update -p sp-io

* add signed extension as well

* Revert "add signed extension as well"

This reverts commit deb936fe5a9a13a62d02757045b1dfa40dccb190.

* cargo update -p sp-io

* ".git/.scripts/bench-bot.sh" runtime kusama-dev pallet_fast_unstake

* ".git/.scripts/bench-bot.sh" runtime polkadot-dev pallet_fast_unstake

* update sub

* integrate latest substrate changes

* ".git/.scripts/fmt.sh" 1

* ".git/.scripts/bench-bot.sh" runtime westend-dev pallet_fast_unstake

Co-authored-by: command-bot <>
Co-authored-by: Nitwit <47109040+BustaNit@users.noreply.github.com>
2022-09-28 09:39:38 +00:00
Mara Robin B efd2bfb085 Remove executed runtime migrations (nompools MigrateToV3, InitiateNominationPools) (#6056) 2022-09-27 11:50:40 +00:00
dependabot[bot] 1f4ec021f0 Bump bytes from 1.1.0 to 1.2.1 (#6017)
Bumps [bytes](https://github.com/tokio-rs/bytes) from 1.1.0 to 1.2.1.
- [Release notes](https://github.com/tokio-rs/bytes/releases)
- [Changelog](https://github.com/tokio-rs/bytes/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tokio-rs/bytes/compare/v1.1.0...v1.2.1)

---
updated-dependencies:
- dependency-name: bytes
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-27 10:55:17 +02:00
Andronik 4df643271d make spellcheck green again (#6059)
* make spellcheck green again

* remove the comment

* Fix a comment in `provisioner`

Co-authored-by: Tsvetomir Dimitrov <tsvetomir@parity.io>
2022-09-27 08:48:49 +00:00
Niklas Adolfsson d9ea02c09a staking miner: CLI make request and connection timeout configurable (#6004)
* staking miner: CLI request and connection timeout

Make it possible to configure the `connection timeout` and `request timeout` via CLI flags.

* cargo fmt
2022-09-26 20:56:12 +00:00
Bernhard Schuster c3e45a04fc [orchestra] fix: require the initialization with F: FnOnce to be Send (#6051)
* add regression test for missing Send requirement

* fix: require the initialization with `F: FnOnce` to be `Send` as well

If creating intermediate variables of the builder type within
a future, rustc will complain about the future not being send,
while the thing itself isn't even using the closure based field
initialization. Adding an additional bound, resolves this and
pushes the error message "closer" to the user, and out of the
generated code.

* import fixins
2022-09-26 22:11:36 +02:00
Chris Sosnin fd1856e1e9 paras: unblock offboarding when pvf-check concludes (#6032)
* Unblock offboarding for upgrading paras

* ".git/.scripts/fmt.sh" 1

Co-authored-by: command-bot <>
2022-09-26 19:02:05 +02:00
Aaro Altonen 2a9800f20a Companion for paritytech/substrate#12264 (#5973)
* Companion for paritytech/substrate#12198

* Use `ProtocolName` from sc-network-common

* Update node service

* Revert Cargo.lock changes

* Fix node service test

* cargo-fmt

* disable cancel-pipeline-test-linux-stable to check companion

* update lockfile for {"substrate"}

Co-authored-by: alvicsam <alvicsam@gmail.com>
Co-authored-by: parity-processbot <>
2022-09-26 13:15:41 +00:00
Andronik 5dd7026383 orchestra: hide subsystem cycle warnings by default (#6047) 2022-09-26 12:39:56 +00:00
Alexander Samusev fc8d1765ef [ci] Split gitlab-ci config to separate files (#6031)
* [WIP][ci] Split gitlab-ci config to separate files

* add stage

* move short benches

* rename stage short_benchmark

* include short-benchmarks

* add check

* add test stage

* quickfix check-no-default-features

* add build stage

* add weights and publish

* rename stage

* rename stage

* fix publish miner image

* fix publish miner image

* add dag

* fix image

* start build-short-benchmark with the pipeline

* some more DAGs

* empty line to short-benchmarks

* add change from master

Co-authored-by: parity-processbot <>
2022-09-26 10:50:25 +02:00
ZhiYong 4262e80377 Companion for substrate#11983. (#5992)
* Companion for substrate#11983.

* update lockfile for {"substrate"}

Co-authored-by: parity-processbot <>
2022-09-26 08:26:44 +00:00
Davide Galassi fa2a7d1efa Companion - Independence of Slot-based algorithms from Timestamp (#5997)
* Companion for substrate #12224

* update lockfile for {"substrate"}

Co-authored-by: parity-processbot <>
2022-09-23 18:32:04 +00:00
Robert Klotzner 5045aeb2f9 Some more information on disputes for the guide (#6006)
* Add some notes about treatment of already finalized blocks.

* More info in the guide as discussed with Jakob.

* Remove references to private repo.
2022-09-23 14:41:06 +02:00
marcin-cb 85e43afdd5 Increase BlockHashCount parameter (#6037) 2022-09-22 20:54:57 +00:00
Shawn Tabrizi 2b07b39911 Companion for #12283 (Anon -> Pure Proxy) (#6038)
* anon -> pure

* fn pure -> fn create_pure

* update lockfile for {"substrate"}

Co-authored-by: parity-processbot <>
2022-09-22 15:13:43 +00:00
Sebastian Kunert 9b669edf22 Change visibility of open_database for use in cumulus (#6034)
* Make some helper methods public

* Make availability config const.
2022-09-22 08:45:58 +00:00
Ankan 8d8616d656 [Companion] Get rid of HistoryDepth storage (#5996)
* remove history depth from storage and add it as config for pallet staking

* add migration to v11 for staking pallet

* revert local substrate dependency patch

* remove history depth from storage and add it as config for pallet staking

* add migration to v11 for staking pallet

* revert local substrate dependency patch

* update substrate dependencies

* update cargo lock

* update to latest substrate

* revert all changes to Cargo.lock

* cargo update -p sp-io

* mark migration job as failable

Co-authored-by: kianenigma <kian@parity.io>
2022-09-21 15:24:14 +00:00
Sergej Sakac 937c4e76ae Rename Origin (#6020)
* Rename Origin

* fmt

* fixes

* more fixes

* fix

* more fixing

* small fixes

* last touches

* update lockfile for {"substrate"}

Co-authored-by: Shawn Tabrizi <shawntabrizi@gmail.com>
Co-authored-by: parity-processbot <>
2022-09-20 22:53:12 +00:00
Javier Viola 8d8bd99582 [Zombienet] add upgrade test (#5970)
* add upgrade test

* fix node names

* changes from feedback

* rename bash script

* fix upgrade node test

* upgrade node test, use env

* bump zombienet version and fix upgrade test

* bump zombienet version

* bump zombienet

* fix raw link for binary

* adjust within time
2022-09-20 14:13:55 +02:00
Andronik 18c077a818 runtime/disputes: slashing (#5535)
* disputes: runtime part of slashing

* disputes: reward winners

* disputes/slashing: validate_unsigned impl

* fmt

* disputes/slashing: report_dispute_lost_unsigned

* disputes/slashing: separate winners from losers and report winners

* disputes/slashing: refactoring

* impl HandleReports

* enable on Wenstend

* fmt

* add slashing pallet to the mock and test runtimes

* fix a bug in report_dispute_lost_unsigned

* fmt

* disputes: remove new_participants from summary

* disputes: remove punish_inconclusive

* impl SlashingHandler for Pallet for type-safety

* do not impl slashing::Config on mainnets yet

* teach spellcheck deduplication

* simplify interfaces and resolve some TODOs

* resolve some more TODOs

* minor typos

* move slashing into a folder

* remove unnecessary clone

* fix validator_set_count calculation

* introduce ValidatorSetCount

* store ValidatorSetCount

* fmt

* add the benchmark

* fmt

* unflatten slashing

* post-rebase fixes

* remove winners eagerly

* use real slashing weights for westend

* remove bench test suite

* zombinet: modify disputes test to check for an offence report

* zombinet: add a timeout

* add slashing pallet to Rococo

* zombienet: revert back to rococo-local

* fmt

* remove TODOs

* revert some accidental changes

* slashing is submodule of disputes

* Change the log target

Co-authored-by: Kian Paimani <5588131+kianenigma@users.noreply.github.com>

* wrap comments with rustfmt, more docs, constants

* use Defensive trait

* cargo update -p sp-io

* merge offence types, remove rewards for now

* cargo update -p sp-io

* benchmark fixes

* fmt

* unused var

* fix block_author impl

* ressurect RewardValidators trait

* remove outdated comment

* more module docs

* introduce BenchmarkingConfig

* typo fix

* teach spellcheck unapplied

* use Weight::new()

* fix mocking rewards

* use RefTimeWeight

* ".git/.scripts/bench-bot.sh" runtime westend-dev runtime_parachains::disputes::slashing

* refactor maybe_identify_validators

* no more ticket in disguise

* remove outdated comments

* lower against valid to 0.1%

* bump zombienet version for debug

* use from_perthousand

* post-merge fixes

* another day, another Weight changes

* Revert "bump zombienet version for debug"

This reverts commit 0d9978711f8ec9a746a5e1c45e8ffbe7c75e7b5c.

* do not reward block authors

* fix outdated comment

* use Pays from frame_support::dispatch::Pays

* add timeout to is up

Co-authored-by: Kian Paimani <5588131+kianenigma@users.noreply.github.com>
Co-authored-by: command-bot <>
Co-authored-by: Javier Viola <javier@parity.io>
Co-authored-by: Javier Viola <pepoviola@gmail.com>
2022-09-20 10:56:55 +00:00
Alexander Samusev b6ed41a464 [ci] Revert cancel-pipeline job (#6028)
* [WIP][ci] Revert cancel-pipeline job

* fail test-linux-stable

* fix test-linux-stable
2022-09-20 11:56:44 +02:00
Tsvetomir Dimitrov 6ae9720c36 Improved dispute votes import in provisioner (#5567)
* Add `DisputeState` to `DisputeCoordinatorMessage::RecentDisputes`

The new signature of the message is:
```
RecentDisputes(oneshot::Sender<Vec<(SessionIndex, CandidateHash, DisputeStatus)>>),
```

As part of the change also add `DispiteStatus` to
`polkadot_node_primitives`.

* Move dummy_signature() in primitives/test-helpers

* Enable staging runtime api on Rococo

* Implementation

* Move disputes to separate module
* Vote prioritisation
* Duplicates handling
* Double vote handling
* Unit tests
* Logs and metrics
* Code review feedback
* Fix ACTIVE/INACTIVE separation and update partition names
* Add `fn dispute_is_inactive` to node primitives and refactor `fn get_active_with_status()` logic
* Keep the 'old' logic if the staging api is not enabled
* Fix some comments in tests
* Add warning message if there are any inactive_unknown_onchain disputes
* Add file headers and remove `use super::*;` usage outside tests
* Adding doc comments
* Fix test methods names

* Fix staging api usage

* Fix `get_disputes` runtime function implementation

* Fix compilation error

* Fix arithmetic operations in tests

* Use smaller test data

* Rename `RuntimeApiRequest::StagingDisputes` to `RuntimeApiRequest::Disputes`

* Remove `staging-client` feature flag

* fmt

* Remove `vstaging` feature flag

* Some comments regarding the staging api

* Rename dispute selection modules in provisioner
with_staging_api -> prioritized_selection
without_staging_api -> random_selection

* Comments for staging api

* Comments

* Additional logging

* Code review feedback

process_selected_disputes -> into_multi_dispute_statement_set
typo
In trait VoteType: vote_value -> is_valid

* Code review feedback

* Fix metrics

* get_disputes -> disputes

* Get time only once during partitioning

* Fix partitioning

* Comments

* Reduce the number of hardcoded api versions

* Code review feedback

* Unused import

* Comments

* More precise log messages

* Code review feedback

* Code review feedback

* Code review feedback - remove `trait VoteType`

* Code review feedback

* Trace log for DisputeCoordinatorMessage::QueryCandidateVotes counter in vote_selection
2022-09-19 23:06:09 +03:00
Andronik bbb713521e gossip-support: disconnect when we're no longer in other's reserved set (#6024)
* gossip-support: disconnect when we're no longer in the reserved set

* fmt
2022-09-19 19:26:41 +00:00
Oliver Tale-Yazdi 4a3ce875e7 Use correct file header for 'benchmark overhead' (#5984)
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>
Co-authored-by: parity-processbot <>
2022-09-19 13:20:01 +00:00
Roman Useinov 059ad8a388 [Substrate Companion] Part 1: add TargetList for validator ranking (#5930)
* [Substrate Companion] Part 1: add TargetList for validator ranking

* fix fmt

* don't change the pallet name

* eloquent migration

* fmt

* fix build

* update deps

* Cargo.lock conflicts resolved

* update deps

* Revert "update deps"

This reverts commit e0b07565854f9c66e5f30cdfe2c0a8f08457c96e.

* fix deps

Co-authored-by: kianenigma <kian@parity.io>
2022-09-18 17:00:13 +02:00
Davide Galassi da23abe28a Bump blake2 from 0.10.2 to 0.10.4 (#6019) 2022-09-15 17:28:12 +02:00
Andronik afc7dd3735 node/core/pvf: strip some deps (#6016) 2022-09-15 12:25:03 +00:00
dependabot[bot] b0589a2af9 Bump enumn from 0.1.4 to 0.1.5 (#5938)
Bumps [enumn](https://github.com/dtolnay/enumn) from 0.1.4 to 0.1.5.
- [Release notes](https://github.com/dtolnay/enumn/releases)
- [Commits](https://github.com/dtolnay/enumn/compare/0.1.4...0.1.5)

---
updated-dependencies:
- dependency-name: enumn
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-09-15 09:39:10 +03:00
Oliver Tale-Yazdi 74c00bad59 Co #11976: Enable rust features (#5983)
* Enable correct features

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Feature gate function

The expose_db function is currently feature gated with runtime-benchmarks.
After the related Substrate MR, this feature gate will actually *work*
as intended instead of doing nothing.
BUT then we also have to pass through the correct feature, hence this MR.

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* update lockfile for {"substrate"}

* Fix bench features

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* fix more features

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>
Co-authored-by: parity-processbot <>
2022-09-14 17:59:56 +00:00
Nisheeth Barthwal 023ebe778a update memory-lru:0.1.1 (#6012) 2022-09-14 13:06:25 +00:00
Keith Yeung a2c6536f77 Companion for paritytech/substrate#12219 (#5987)
* Companion for paritytech/substrate#12219

* Fixes

* update lockfile for {"substrate"}

* Fixes

* cargo fmt

Co-authored-by: parity-processbot <>
2022-09-13 15:48:17 +00:00
Michal Kucharczyk 85f9ad25fe Remove CanAuthorWith trait (#5986)
* Remove CanAuthorWith trait

CanAuthotWith trait removed. Also all dependencies, parameters, type
paramers were removed. This is related to removal of native runtime.

* update lockfile for {"substrate"}

* Ensure we use unique directories after the recent change to `new_temp_dir`

Co-authored-by: parity-processbot <>
Co-authored-by: Bastian Köcher <info@kchr.de>
2022-09-13 13:38:29 +00:00
Aaro Altonen 3bf1a66541 Update cid to 0.8.6 (#5994)
* Update cid to 0.8.6

* update lockfile for {"substrate"}

Co-authored-by: parity-processbot <>
2022-09-13 08:50:12 +00:00
joe petrowski 41f317715e Update Westend Trusted Teleporters (#5985)
* change para ID of collectives and remove encointer

* fmt
2022-09-13 05:28:15 +00:00
Sergej Sakac 8ea6076fe5 Companion for #11981 (#5915)
* Companion for #11981

* more renaming

* fmt

* fixes

* add generic type

* Companion for #11831

* fix

* revert changes

* Delete rename-outer-enum.diff

* revert

* Update run_benches_for_runtime.sh

* rename type Call & type Event

* passing tests

* fmt

* small fixes

* commit

* fix

* fmt

* commit

* error fixes

* fix

* small fix in test

* Update lib.rs

* Update lib.rs

* Update lib.rs

* Update lib.rs

* Update lib.rs

* Update lib.rs

* Update lib.rs

* remove RuntimeCall from pallet_grandpa

* last fix

* commit

* rename

* merge fix

* update lockfile for {"substrate"}

* cargo +nightly fmt

* fix

Co-authored-by: parity-processbot <>
Co-authored-by: Shawn Tabrizi <shawntabrizi@gmail.com>
2022-09-12 23:03:47 +00:00
Mara Robin B db0fc60344 update weights (sync with v0.9.29) (#5989)
* kusama: update weights

* polkadot: update weights

* westend: update weights

* rococo: update weights

* fixup

* revert block weights
2022-09-12 11:48:27 +00:00
Kian Paimani 69aefab456 remove stale polkadot call filter (#5969)
* Remove stale polkadot call filter

* fix build

* really fix it

* unused import

* Fix

Co-authored-by: parity-processbot <>
2022-09-09 15:24:34 +00:00
Mara Robin B 1acc3fa150 Sync versions with current release (v0.9.29) (#5982)
* Bump transaction_version for westend

* Bump transaction_version for rococo

* Bump transaction_version for kusama

* Bump transaction_version for polkadot

* Bump spec_version to 9290

* Bump crate versions
2022-09-09 11:24:06 +00:00
Adrian Catangiu cf18fed678 zombienet: add BEEFY justifications import test (#5855)
* zombienet: add BEEFY justifications import test

* bump zombienet image version

* zombienet: can't retrieve metrics when node paused

* bump zombienet image version to v1.2.54

Signed-off-by: acatangiu <adrian@parity.io>
2022-09-08 15:17:46 +03:00
Andronik c79dd8751c disputes rewards (#5862)
* refactor backing points to only reward active set

* impl disputes::RewardValidators

* enable rewards on westend, kusama, polkadot

* fmt

* make dispute points same as backing

* disable on polkadot for now
2022-09-08 13:36:01 +02:00
Chris Sosnin ec26fbdb85 pvf-checker: enable subsystem on all chains (#5977)
* Enable pvf checker on all chains

* Disable pvf checker for non-authorities
2022-09-08 13:33:03 +02:00
Ignacio Palacios 7f7f96a208 Update Rococo to mirror Kusama (#5617)
* upgrade to kusama base

* rollback epoch and clean up

* Substitue DOLLARS with UNITS

* money constatns to mirror Kusama

* fixing typo in test

* scheduler+collective+membership+preimage

* treasury+democracy+bounties+child_bounties+society

* tips+claim+identity+elections_phragmen+vesting

* recovery+gilt

* proxy+slot+auction+registar+crowdloan

* babe+epoch_time modificaction

* xcm_config

* xcm_config fix

* constants

* fix conflicts 2

* fmt

* update xcm_config

* revert xcm_config change

* fixing benchmarks

* cargo.lock

* Revert "babe+epoch_time modificaction"

This reverts commit 663cb0292c42c8a084a8c1c36cb966389576989b.

* fix benchamrks 2

* fix benchmarks 3

* typos

* miscelaneous

* fix constants test

* rollback comments

* rollback lease period

* fmt

* add ROC to spellcheck dictionary

* fix cargo.toml + fixes

* remove TODOs

* nit fix

* weights 1.5

* Bumping number of perm/temp slots available

Co-authored-by: al3mart <alejandro@parity.io>
Co-authored-by: alvicsam <alvicsam@gmail.com>
2022-09-08 11:20:34 +00:00
Bastian Köcher 6bb7bcda2a Update Substrate (#5981) 2022-09-08 09:50:04 +00:00