Commit Graph

48 Commits

Author SHA1 Message Date
Andronik f1cab419a3 pov-recovery: try connect to validators (#1711)
* zombienet/pov-recovery: do not setup reserved connection for collators

* connect eve to dave

* REVERTME: diener update --polkadot --branch ao-recovery-try-connect

* REVERTME: cargo update -p sp-io

* REVERTME: cargo update -p sp-io and hope for the best

* pass reserved flags for eve after --

* Revert "REVERTME: cargo update -p sp-io and hope for the best"

This reverts commit 0d66b70e5ccedc7a35bcf1b30a070e68cd6a8ccc.

* Revert "REVERTME: cargo update -p sp-io"

This reverts commit f8d16c375afd41b8e0c84b59fe62019b86ba95b9.

* REVERTME: cargo update -p sp-io

* Revert "REVERTME: cargo update -p sp-io"

This reverts commit d48e1e6aa2134591b285e284077a063356d44eed.

* REVERTME: cargo update -p sp-io

* REVERTME: cargo update -p sp-io

* try some logs and flags

* apply some suggestions from Sebastian

* let Charlie produce blocks

* Revert "REVERTME: cargo update -p sp-io"

This reverts commit 02838a656eadfcbd26520e6b60ee21ffd8b27afd.

* git checkout master Cargo.lock

* Revert "REVERTME: diener update --polkadot --branch ao-recovery-try-connect"

This reverts commit 8ae8d5347b787ce5e08d6fdb5e7f266299fd70dd.

* zombienet/pov-recovery: 4 validators

* REVERTME: diener update --polkadot --branch ao-recovery-try-connect && cargo update -p polkadot-primitives

* Revert "REVERTME: diener update --polkadot --branch ao-recovery-try-connect && cargo update -p polkadot-primitives"

This reverts commit 3cc918220de5bf8ca5368586e55556464d106afd.

* make sure it is not due to backing group connections

* clean up flags

* try no-mdns on collators, limit out-peers on validators

* try no-mdns on validators and bob

* fix bob flag

* try 7 validators (3 chunks needed for recovery)

* reserved-only on validators

* reserved-only on alice and charlie

* explicitly pass log targets

* rm default_args

* parachain=debug and cumulus-pov-recovery=debug

* try another idea

* try 13 validators (4 chunks required)

* bump block height to 20

* Register parachain after 20sec, increase block target to 20

* bump zombienet version

* remove debug

* bump zombienet

* update lockfile for {"polkadot", "substrate"}

Co-authored-by: Sebastian Kunert <skunert49@gmail.com>
Co-authored-by: Javier Viola <javier@parity.io>
Co-authored-by: parity-processbot <>
Co-authored-by: Bastian Köcher <info@kchr.de>
2022-10-19 10:02:29 +00:00
Sebastian Kunert cdcf5ddd9b Enable collation via RPC relay chain node (#1585)
* Add minimal overseer gen with dummy subsystems

* Fix dependencies

* no-compile: only client transaction pool missing

* Remove unused imports

* Continue to hack towards PoC

* Continue

* Make mini node compile

* Compiling version with blockchainevents trait

* Continue

* Check in lockfile

* Block with tokio

* update patches

* Update polkadot patches

* Use polkadot-primitives v2

* Fix build problems

* First working version

* Adjust cargo.lock

* Add integration test

* Make integration test work

* Allow startinc collator without relay-chain args

* Make OverseerRuntimeClient async

* Create separate integration test

* Remove unused ChainSelection code

* Remove unused parameters on new-mini

* Connect collator node in test to relay chain nodes

* Make BlockChainRPCClient obsolete

* Clean up

* Clean up

* Reimplement blockchain-rpc-events

* Revert "Allow startinc collator without relay-chain args"

This reverts commit f22c70e16521f375fe125df5616d48ceea926b1a.

* Add `strict_record_validation` to AuthorityDiscovery

* Move network to cumulus

* Remove BlockchainRPCEvents

* Remove `BlockIdTo` and `BlockchainEvents`

* Make AuthorityDiscovery async

* Use hash in OverseerRuntime

* Adjust naming of runtime client trait

* Implement more rpc-client methods

* Improve error handling for `ApiError`

* Extract authority-discovery creationand cleanup

* RPC -> Rpc

* Extract bitswap

* Adjust to changes on master

* Implement `hash` method

* Introduce DummyChainSync, remove ProofProvider and BlockBackend

* Remove `HeaderMetadata` from blockchain-rpc-client

* Make ChainSync work

* Implement NetworkHeaderBackend

* Cleanup

* Adjustments after master merge

* Remove ImportQueue from network parameters

* Remove cargo patches

* Eliminate warnings

* Revert to HeaderBackend

* Add zombienet test

* Implement `status()` method

* Add more comments, improve readability

* Remove patches from Cargo.toml

* Remove integration test in favor of zombienet

* Remove unused dependencies, rename minimal node crate

* Adjust to latest master changes

* fmt

* Execute zombienet test on gitlab ci

* Reuse network metrics

* Chainsync metrics

* fmt

* Feed RPC node as boot node to the relay chain minimal node

* fmt

* Add bootnodes to zombienet collators

* Allow specification of relay chain args

* Apply review suggestions

* Remove unnecessary casts

* Enable PoV recovery for rpc full nodes

* Revert unwanted changes

* Make overseerHandle non-optional

* Add availability-store subsystem

* Add AuxStore and ChainApiSubsystem

* Add availability distribution subsystem

* Improve pov-recovery logging and add RPC nodes to tests

* fmt

* Make availability config const

* lock

* Enable debug logs for pov-recovery in zombienet

* Add log filters to test binary

* Allow wss

* Address review comments

* Apply reviewer comments

* Adjust to master changes

* Apply reviewer suggestions

* Bump polkadot

* Add builder method for minimal node

* Bump substrate and polkadot

* Clean up overseer building

* Add bootnode to two in pov_recovery test

* Fix missing quote in pov recovery zombienet test

* Improve zombienet pov test

* More debug logs for pov-recovery

* Remove reserved nodes like on original test

* Revert zombienet test to master
2022-10-10 09:06:26 +02:00
Squirrel 2f0760bf99 add current time in milis to the branch name (#1658) (#1693)
Co-authored-by: Egor_P <egor@parity.io>
2022-09-27 15:53:17 +00:00
Aaro Altonen 0893bde675 Companion for paritytech/substrate#12264 (#1661)
* Companion for paritytech/substrate#12264

* Fix more tests

* disable sc-network-transactions to check companion

* Fix node config in tests

* update lockfile for {"substrate", "polkadot"}

Co-authored-by: parity-processbot <>
Co-authored-by: alvicsam <alvicsam@gmail.com>
2022-09-26 13:40:25 +00:00
Squirrel 563c97a548 Other PRs have wrong base and drag additional commits into the genegated PR. (#1672)
Not a good idea as it turns out.
2022-09-23 10:14:52 +00:00
Alexander Samusev 63852d50e7 [ci] Disable auto-fmt and revert cancel-pipeline (#1642)
* [WIP][ci] Disable auto-fmt and revert cancel-pipeline

* fail test-linux-stable

* fix test-linux-stable
2022-09-20 11:27:41 +02:00
Alexander Samusev b8f6a411d7 [ci] build runtime only if runtime files were changed (#1582)
* [WIP][ci] build runtime only if runtime files were changed

* debug

* enable valid job

* enable valid job

* enable everything back

* test build-runtime-assets-statemine

* add need

* build nightly

* test build runtime statemint

* cargo check instead build

* rm test file

* restart pipeline

* add paths to build-runtime-template

* add test file to trigger builds

* move test

* remove test file

* trigger pipeline to calculate times

* modify build-runtime jobs

* add echo

* fix semicolon

* debug

* fix variable

* uncomment all

* add DAG for build-runtime jobs

* restart pipeline
2022-09-19 15:50:19 +02:00
Javier Viola 9db100e228 bump zombienet version, support new weights (#1589) 2022-09-02 16:06:58 +02:00
Alexander Samusev f0fbb51019 [ci] add auto cargo-fmt (#1562)
* [WIP][ci] add auto cargo-fmt

* [ci] Apply cargo-fmt

* use fmt nightly

* [ci] Apply cargo-fmt

* add comment to cargo-fmt and remove fmt gha

Co-authored-by: paritytech-ci <paritytech-ci@parity.io>
2022-08-24 15:54:40 +02:00
Javier Viola 6f59134416 chore: bump zombienet version (#1560) 2022-08-22 16:20:58 +02:00
Alexander Samusev 03157b70e9 [ci] Weights PR for master and client on cumulus (#1553)
* [ci] Weights PR for master and client on cumulus

* add 4th pr creation to benchmarks-statemint

* rename benchmarks-statemint to benchmarks-assets
2022-08-22 13:30:10 +02:00
Javier Viola 807db6ff0d Zombienet add tests (#1321)
* changes to read json spec in test binary

* add zombienet tests

* fmt

* use {{COL_IMAGE}} and clean config

* add comment and use relay image from env

* use test-parachain image from pr

* fix warns

* fix warns

* fmt

* typo

* fix ci to use zombienet image

* fix spawn nodes for test

* reorg test

* add within to test

* remove check for full node collators is up

* add tests for pov, mirate solo to para, sync blocks

* bump zombienet image

* add job dep with artifacts

* add sleep for test

* fix after merge

* fmt

* bump zombienet version

* changes from clap

* use base/shared params

* fmt

* debug ci

* add upgrade test

* update js test for debug

* less debug in test

* print assertion

* fix upgrade test

* Collator key only needed if we run as collator

* [Fix] Benchmark build artifact folder creation (#1518)

* Trivial networking changes for Substrate PR #11940 (#1486)

* Trivial networking changes for Substrate PR https://github.com/paritytech/substrate/pull/11940

* Apply formatting rules

* update lockfile for {"polkadot", "substrate"}

Co-authored-by: parity-processbot <>

* bump zombienet version

* update network def for test

* typo

Co-authored-by: Sebastian Kunert <skunert49@gmail.com>
Co-authored-by: Roman Useinov <roman.useinov@gmail.com>
Co-authored-by: Nazar Mokrynskyi <nazar@mokrynskyi.com>
2022-08-18 17:59:36 +02:00
joe petrowski 7bd426f31e Add Collectives Parachain (#1346)
* add new runtime and remove unnecessary pallets

* make runtime build

* add collectives to collator node

* sketch alliance config in runtime

* Slash handler was supposed to be commented out (for now)

* correct signature

* move to impls

* add alliance to runtime

* rustfmt

* IsReserve, remove Ping, update fn deposit

* add transaction_payment event

* Update parachains/runtimes/collectives/collectives-polkadot/src/lib.rs

Co-authored-by: Squirrel <gilescope@gmail.com>

* fmt

* add genesis config to chain spec

* fix merge

* local and dev configs only (for now)

* remove duplicate imports

* Collectives polkadot runtime to cargo workspace members (#1397)

* Collectives polkadot runtime: use unit type impl for identity verifier (#1398)

* apply fn rename

* fmt

* one less todo

* Less code in magic macros (#1407)

* Less code in magic macros

* cargo fmt

* Bench alliance (#1427)

* add benchmarks

* call one script from the other

* shebang changes so works on nixos too.

* bench in parallel as separate jobs

* hyphens can turn into underscores

* remove workaround to trigger bench

Co-authored-by: alvicsam <alvicsam@gmail.com>
Co-authored-by: paritytech-ci <paritytech-ci@parity.io>

* enable ci jobs

* fix publish bench results jobs

* chainspecs for collectives-westend (#1441)

* initial chainspecs for collections relay chain

* plumb in the collectives-westend chainspec

* add Runtime::CollectivesWestend

* lock

* Collectives: teleport slashed assets  (#1433)

* Collectives: teleport slashed assets

* fmt

* Cargo.lock > polkadot-parachain 0.9.25

* create temp account for imbalance

* treasury acc id from pallet id

* move accounts into constants, use here junction for assets

* assets location is relay chain, accounts as parameters

* fix typos

* fix typo

* Update parachains/runtimes/collectives/collectives-polkadot/src/constants.rs

Co-authored-by: joe petrowski <25483142+joepetrowski@users.noreply.github.com>

* Move alliance proposal provider to impls.rs (#1464)

* Move to impls alliance proposal provider

* rustfmt

* Bumping spec version

(so that we can redeploy with slashing change.)

* cargo lock

* slurp collectives digest to make appear in release notes (#1473)

* add slurp

* Slurp better :)

* Bring some order

Co-authored-by: Chevdor <chevdor@users.noreply.github.com>
Co-authored-by: Wilfried Kopp <wilfried@parity.io>

* reorder barrier

* Update parachains/runtimes/collectives/collectives-polkadot/src/xcm_config.rs

Co-authored-by: Keith Yeung <kungfukeith11@gmail.com>

* address review

* clean construct runtime

* fmt

* looks pretty but brings in too much

Co-authored-by: Squirrel <gilescope@gmail.com>
Co-authored-by: Muharem Ismailov <ismailov.m.h@gmail.com>
Co-authored-by: alvicsam <alvicsam@gmail.com>
Co-authored-by: paritytech-ci <paritytech-ci@parity.io>
Co-authored-by: Chevdor <chevdor@users.noreply.github.com>
Co-authored-by: Wilfried Kopp <wilfried@parity.io>
Co-authored-by: Keith Yeung <kungfukeith11@gmail.com>
2022-08-11 11:11:10 +00:00
Alexander Samusev 7ca3562665 [ci] fix pipeline for polkadot-v branches (#1503)
Co-authored-by: parity-processbot <>
2022-08-11 10:09:07 +02:00
Alexander Samusev 346392e6e1 [ci] improve cancel-pipeline job (#1532)
* [ci] improve cancel-pipeline job

* fix trigger

* fix trigger

* add file to trigger

* test job fail

* fix trigger

* fix indent

* fix before_script

* add comment

* remove debuag fail from test-linux-stable
2022-08-11 08:47:02 +02:00
Roman Useinov 4436f2b1b6 [Fix] Benchmark build artifact folder creation (#1518) 2022-08-09 07:15:26 +00:00
Mak 2d0ac95f22 Integrate auto-updating parachain template on developer-hub (#1479)
* Integrate auto-updating parachain template on developer-hub

* Update .gitlab-ci.yml

Co-authored-by: Alexander Samusev <41779041+alvicsam@users.noreply.github.com>

Co-authored-by: Alexander Samusev <41779041+alvicsam@users.noreply.github.com>
2022-07-29 15:16:12 +03:00
Alexander Samusev 5552584dde [ci] use nextest for tests (#1477)
* [do not merge] ci: try nextest

* uncomment jobs
2022-07-28 10:18:35 +02:00
Alexander Samusev 9e09a36ff5 [ci] Add timeout to benchmark job (#1475) 2022-07-27 15:31:35 +02:00
Alexander Samusev 63494a34d9 [ci] Send bench results to S3 (#1417)
* [ci] Send bench results to S3

* move publish stage
2022-07-01 11:42:35 +02:00
Vlad ba09e40c5d Fix release-parachains-v* pipelines (#1355)
* Fix `release-parachains-v*` pipelines

* Formatting
2022-06-14 12:24:47 +02:00
Alexander Samusev 059d992e03 [ci] Add build docker test-parachain for zombienet (#1327)
* [ci] Add build docker test-parachain for zombienet

* debug ci

* disable cancel pipeline

* fix wrong rename

* enable jobs

* uncomment needs

* fixes
2022-06-02 19:20:22 +02:00
Alexander Samusev 2e514ad005 Publish polkadot-parachain docker images on PRs (#1311)
* [WIP] Dockerize polkadot-parachain

* fix build job

* disable test job for debug

* disable all tests for debug

* add publish docker

* fix docker publish

* uncomment tests; add dag

* fix docker naming

* add DAG to build job

* small fixes

* combine test and build

* fix typo

* divide test and build back

* Update .gitlab-ci.yml

Co-authored-by: Denis Pisarev <denis.pisarev@parity.io>

* rename docker image

* add needs publish-s3

* remove collect artifacts from test

Co-authored-by: Denis Pisarev <denis.pisarev@parity.io>
2022-06-01 15:07:19 +02:00
Squirrel 39f79659a8 Fixup benches after dir re-org (#1300)
* Fixup after dir re-org

* Update scripts/benchmarks-ci.sh

Co-authored-by: Chevdor <chevdor@users.noreply.github.com>

* Update scripts/benchmarks-ci.sh

Co-authored-by: Chevdor <chevdor@users.noreply.github.com>

* Update scripts/benchmarks-ci.sh

Co-authored-by: Chevdor <chevdor@users.noreply.github.com>

* fix typo

Co-authored-by: Chevdor <chevdor@users.noreply.github.com>
2022-06-01 07:40:03 +00:00
Sergejs Kostjucenko 37db8aec2d change ci rule to run benchmarks (#1301) 2022-05-26 16:06:48 +03:00
Squirrel bc0c98884f dir restructure to support more CGP (#1266)
* rerame res to chain-specs

* split polkadot-parachains dir

* rename dir parachains-common to common

Co-authored-by: joe petrowski <25483142+joepetrowski@users.noreply.github.com>
Co-authored-by: Wilfried Kopp <wilfried@parity.io>
Co-authored-by: Chevdor <chevdor@users.noreply.github.com>
2022-05-20 13:43:04 +01:00
Squirrel 1474308bbb rename polkadot-collator to polkadot-parachain (#1241)
* rename polkadot-collator to polkadot-parachain

Not every node has to be a collator.

* Update README.md

Co-authored-by: Chevdor <chevdor@users.noreply.github.com>

* rename docker file

* Update .github/workflows/extrinsic-ordering-check-from-bin.yml

Co-authored-by: Chevdor <chevdor@users.noreply.github.com>

* Versioning scheme that tracks polkadot relay chain

but allows for patch releases by having a 0 at the end.
(`-patch1` patch naming schemes were discussed but they
were judged to cause downstream packagers pain.)

* update name

* update lock file

Co-authored-by: Chevdor <chevdor@users.noreply.github.com>
2022-05-13 13:02:52 +00:00
Alexander Samusev f0b61c91ce [ci] Fix benchmark branch name and typo (#1216) 2022-04-26 11:05:54 +02:00
Alexander Samusev abb574000e [ci] small fixes for benchmark jobs (#1195) 2022-04-22 11:10:47 +02:00
Alexander Samusev 675f3b7879 Fix rules for benchmarks and publish (#1167)
* Fix rules for benchmarks and publish

* fix publish refs

* add comments

* add comment

* Apply suggestions from code review

Co-authored-by: Denis Pisarev <denis.pisarev@parity.io>

Co-authored-by: Denis Pisarev <denis.pisarev@parity.io>
2022-04-12 15:10:24 +02:00
Alexander Samusev f452938296 Add benchmarks to pipeline (#1074)
* [Do not merge] add benchmarks to pipeline

* disable jobs for test

* Revert "[Do not merge] add benchmarks to pipeline"

This reverts commit af3cca09f2bbec7ab75e1e905314356ce4405a6f.

* add weights tag

* add stage

* empty before_script for benches

* run benchmarks on ci6

* disable cargo target dir

* disable pre-cache

* add CARGO_TARGET_DIR var to bench script

* debug

* debug

* fix script path

* divide build and benchmark into 2 jobs

* fix bench build

* small fix

* reduce benchmark output log

* add push github

* add push gh

* add after_script

* typo fix

* typo fix

* fix curl

* fix git config

* add title and body to pr

* final check that everything works

* final check that everything works

* return jobs back

* fix rules

* cancel changes benchmarks.sh

* Apply suggestions from code review

Co-authored-by: Denis Pisarev <denis.pisarev@parity.io>

* rename job

* change benches jobs to run on release-parachains-v*

* remove master refs

Co-authored-by: Denis Pisarev <denis.pisarev@parity.io>
2022-04-12 13:53:02 +02:00
Bastian Köcher 804328c913 Remove old caching stuff from CI (#1154) 2022-04-07 21:15:43 +02:00
Shawn Tabrizi eeca2bb61a Fix Runtime Benchmarks Feature Flag in Parachain Template (#991)
* Update Cargo.toml

* add checks to ci
2022-02-16 13:33:08 +01:00
Bastian Köcher 98f0e87daf CI: Check that rustdocs can be generated (#972) 2022-02-09 13:24:42 +01:00
Bastian Köcher 12fc58d1bb Update Substrate & Polkadot (#930)
* Update Substrate & Polkadot

* Hmm

* Set workspace hint path

* Test

* Use absolute path

* Update again
2022-01-22 20:49:01 +00:00
Bastian Köcher f175a25793 Fix benchmarks and ensure CI tests them (#854)
* Fix benchmarks and ensure CI tests them

* FMT
2021-12-12 23:17:15 +01:00
Kian Paimani 70ea98995a Integrate try-runtime into cumulus (#793)
* almost integrate

* revert branch changes

* remove extra deps

* some review comments'

* Fix a bunch of stuff

* Update parachain-template/node/Cargo.toml

Co-authored-by: Alexander Popiak <alexander.popiak@parity.io>

* Fix

* Fix

* fix benchmark

* fmt

* Remove wrong bench test

Co-authored-by: Alexander Popiak <alexander.popiak@parity.io>
2021-12-02 14:00:54 +01:00
Bastian Köcher 1866657e2c Disable integration tests outside of CI (#565) 2021-08-07 23:03:12 +02:00
Denis Pisarev 5dbe70c4f5 CI: build a test artifact (#527)
* CI: build a test artifact

* CI: try building before testing

* CI: try proper bin name

* CI: preempty cache to benchmark properly

* CI: run build after test

* CI: change target source

* CI: try build before test once again

* CI: chore

* CI: prepopulate target cache

* CI: conditional build; aws sync

* CI: mock building to test publishing

* CI: lacks permissions in the other job

* CI: undebug
2021-07-23 17:06:57 +02:00
Bastian Köcher e5b4e8cae7 Wait for relay chain block import before validatiing a block announcement (#227)
* Start with something

* Whatever

* Update

* MOARE

* Make cumulus-network compile and tests work

* Update more and fixes

* More stuff

* More fixes

* Make collator build

* Make test almost work

* Remove contracts runtime

* More test work

* Make service compile

* Fix test-service

* Fix test client

* More fixes

* Fix collator test

* Fix network tests (again)

* Make everything compile, finally

* Fix tests

* Write test that should fail

* Add `WaitOnRelayChainBlock`

* Update git versions

* Make it all work

* Update logging

* Switch to provided method for pushing an extrinsic

* Try to debug CI

* Aaaa

* Only use Debug

* Updates

* Use native execution to hopefully make CI happy...
2020-11-23 00:21:02 +01:00
Denis Pisarev c66f9755cb change (ci): new CI image; -Dwarnings instead of a job (#110)
Co-authored-by: Bastian Köcher <git@kchr.de>
2020-07-28 15:40:22 +02:00
Cecile Tonglet ab51fe9abe Integration test (#91) 2020-05-18 17:17:34 +02:00
Denis P 1194e68166 CI optomizations 2019-12-06 10:13:21 +01:00
Bastian Köcher ce66294def Update .gitlab-ci.yml 2019-10-31 09:25:50 +01:00
Denis P 60c004bdc8 retry on gitlab system failures 2019-10-30 18:28:55 +01:00
Bastian Köcher c697f25eb6 Use locked 2019-10-08 09:40:35 +02:00
Denis P 26e49930bc add cargo audit 2019-09-25 18:48:55 +02:00
Denis P 3b07551055 a simple CI for the start 2019-09-25 14:38:08 +02:00