Commit Graph

190 Commits

Author SHA1 Message Date
Alexander Samusev 40221806d4 [ci] Improve pipeline stopper (#6300)
* [ci] Improve pipeline stopper

* break test-linux-stable

* fix test-linux-stable
2022-11-16 14:49:17 +01:00
Alexander Samusev da4df1809d [ci] fix buildah image (#6281) 2022-11-14 12:59:56 +01:00
Javier Viola 0373ad0a34 bump zombienet version (#6142)
* bump version

* make test required

* change zombienet version

* change zombienet version

* bump version and typo

* typo and add within
2022-10-13 15:17:50 +00:00
Aaro Altonen 2a9800f20a Companion for paritytech/substrate#12264 (#5973)
* Companion for paritytech/substrate#12198

* Use `ProtocolName` from sc-network-common

* Update node service

* Revert Cargo.lock changes

* Fix node service test

* cargo-fmt

* disable cancel-pipeline-test-linux-stable to check companion

* update lockfile for {"substrate"}

Co-authored-by: alvicsam <alvicsam@gmail.com>
Co-authored-by: parity-processbot <>
2022-09-26 13:15:41 +00:00
Alexander Samusev fc8d1765ef [ci] Split gitlab-ci config to separate files (#6031)
* [WIP][ci] Split gitlab-ci config to separate files

* add stage

* move short benches

* rename stage short_benchmark

* include short-benchmarks

* add check

* add test stage

* quickfix check-no-default-features

* add build stage

* add weights and publish

* rename stage

* rename stage

* fix publish miner image

* fix publish miner image

* add dag

* fix image

* start build-short-benchmark with the pipeline

* some more DAGs

* empty line to short-benchmarks

* add change from master

Co-authored-by: parity-processbot <>
2022-09-26 10:50:25 +02:00
Ankan 8d8616d656 [Companion] Get rid of HistoryDepth storage (#5996)
* remove history depth from storage and add it as config for pallet staking

* add migration to v11 for staking pallet

* revert local substrate dependency patch

* remove history depth from storage and add it as config for pallet staking

* add migration to v11 for staking pallet

* revert local substrate dependency patch

* update substrate dependencies

* update cargo lock

* update to latest substrate

* revert all changes to Cargo.lock

* cargo update -p sp-io

* mark migration job as failable

Co-authored-by: kianenigma <kian@parity.io>
2022-09-21 15:24:14 +00:00
Javier Viola 8d8bd99582 [Zombienet] add upgrade test (#5970)
* add upgrade test

* fix node names

* changes from feedback

* rename bash script

* fix upgrade node test

* upgrade node test, use env

* bump zombienet version and fix upgrade test

* bump zombienet version

* bump zombienet

* fix raw link for binary

* adjust within time
2022-09-20 14:13:55 +02:00
Alexander Samusev b6ed41a464 [ci] Revert cancel-pipeline job (#6028)
* [WIP][ci] Revert cancel-pipeline job

* fail test-linux-stable

* fix test-linux-stable
2022-09-20 11:56:44 +02:00
Javier Viola 126758429b chore: bump zombienet version (#5914) 2022-08-23 20:24:17 +02:00
Alexander Samusev 2e72ae46ec [ci] Add check-runtime-migration job (#5891)
* [WIP] Playground for check-runtime-migration

* add condition

* fix syntax

* enable pipeline

* uncomment needs

* change label name to code label
2022-08-17 12:35:44 +02:00
Alexander Samusev fae75b9382 [ci] Improve cancel-pipeline job (#5874)
* [ci] test-linux-stable and cancel-pipelines improvements

* fail check-try-runtime

* import changes from master

* fix needs

* fix check-try-runtime

* remove cancel pipeline from check-try-runtime

* return before_script to check-try-runtime
2022-08-15 13:59:54 +02:00
Alexander Samusev 596b5df747 [ci] Run check-runtime only for PRs (#5858)
* [ci] Run check-runtime only for PRs

* fix refs

* remove pr ref from check-runtime

* adjust dependent jobs

* fix dependency
2022-08-11 15:23:43 +02:00
Andrei Sandu 4db5bbc49a Zombienet: test disputes with malus garbage candidates (#5857)
* 1/3 validators suggest garbage candidates,
but paras should make progress

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* scale down test a bit

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* Use docker paths and more paras

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* dispute finality lag < 2

* scale down

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* scale down more

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* attempt fix

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* one malus node

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* Update zombienet_tests/functional/0003-parachains-garbage-candidate.toml

Co-authored-by: Andronik <write@reusable.software>

* Update zombienet_tests/functional/0003-parachains-garbage-candidate.toml

Co-authored-by: Andronik <write@reusable.software>

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
Co-authored-by: Andronik <write@reusable.software>
2022-08-11 10:31:01 +00:00
Javier Viola 023c70badd [Zombienet] update the image to the version 1.2.51 globally (#5856)
* rollback global version and use new version for beefy test

* move zombienet to v1.2.51

* use global version in all tests

* add image value to tests
2022-08-04 12:42:04 +00:00
Adrian Catangiu 8d1bba18af zombienet: BEEFY and MMR test (#5840)
Signed-off-by: acatangiu <adrian@parity.io>
2022-08-04 10:27:17 +03:00
Oliver Tale-Yazdi b065b4364c Run benchmarks with --steps=2 (#5853)
The benchmarks have been run internally with at least two values
even when called with --steps=1. substrate/#11890 changed this
to explicitly require at least --steps=2.

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>
2022-08-03 21:00:35 +00:00
Alexandru Vasile d84433bd7f Companion for #11939 (#5846)
* Bump jsonrpsee to v0.15.1

Signed-off-by: Alexandru Vasile <alexandru.vasile@parity.io>

* Update cargo.lock

Signed-off-by: Alexandru Vasile <alexandru.vasile@parity.io>

* Minimal update to Cargo.lock

Signed-off-by: Alexandru Vasile <alexandru.vasile@parity.io>

* update substrate

* update lockfile for {"substrate"}

* update substrate master

* Allow benchmark checks to fail

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

Co-authored-by: Niklas Adolfsson <niklasadolfsson1@gmail.com>
Co-authored-by: parity-processbot <>
Co-authored-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>
2022-08-03 12:23:16 +02:00
Alexander Samusev c65c0d64fc Add release-v* rule to common-refs (#5847) 2022-08-01 15:26:50 +02:00
Alexander Samusev 2c5c37e8b2 [ci] Add timeout to benchmark jobs (#5822) 2022-07-27 15:31:25 +02:00
Alexander Samusev a9e41ed5b5 [ci] Return production image (#5818) 2022-07-27 10:13:36 +02:00
Sebastian Kunert 88d9aca202 Prepare for rust 1.62.1 (#5811)
* Update update-rust-stable script

* Update UI tests for rust-1.62.1

* Use staging CI image

* pin ci image

Co-authored-by: alvicsam <alvicsam@gmail.com>
2022-07-26 14:37:02 +02:00
Alexander Samusev d6334447ae [ci] publish parachain-implementers-guide (#5806)
* [Do not merge] [ci] publish parachain-implementers-guide

* fix .cancel-pipeline

* rename build-implementers-guide

* fix

* debig docs

* fix needs

* debug publish

* change image for impl guide job

* fix mdbook

* add folder

* remove mdbook-graphviz

* fix publish

* fix publish

* debug publish

* remove debug

* fix script order

* return pipeline

* remove test ref from publish
2022-07-22 15:22:15 +02:00
Andrei Sandu d54e20708d Zombienet: paritydb test (#5310)
* Add test

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* gitlab integration

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* tune test

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* Try waiting for nodes to be up before checks

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* Use js check for paritydb folder

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* artifacts true

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* change error message

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* debug

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* try again

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* use log line contains for test

* bump zombienet verision for test

* Is approval checking lag 0 on rocksdb ?

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* Is approval checking lag 1 with paritydb ?

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* update zombienet test for parityDb

* Update zombienet_tests/misc/0001-check_paritydb.sh

Co-authored-by: Chevdor <chevdor@users.noreply.github.com>

Co-authored-by: Javier Viola <javier@parity.io>
Co-authored-by: Chevdor <chevdor@users.noreply.github.com>
2022-07-18 10:55:38 +00:00
Javier Viola 2e42da645f [Zombienet] test deregister validator (#5718)
* Update metric name and doc

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* add test and rename metric to use

* change within time for test

* Update .gitlab-ci.yml

Co-authored-by: Alexander Samusev <41779041+alvicsam@users.noreply.github.com>

* Update .gitlab-ci.yml

Co-authored-by: Alexander Samusev <41779041+alvicsam@users.noreply.github.com>

* Properly format the stash account

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* Update test

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* change metric name

* Bump quote from 1.0.19 to 1.0.20 (#5736)

Bumps [quote](https://github.com/dtolnay/quote) from 1.0.19 to 1.0.20.
- [Release notes](https://github.com/dtolnay/quote/releases)
- [Commits](https://github.com/dtolnay/quote/compare/1.0.19...1.0.20)

---
updated-dependencies:
- dependency-name: quote
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* backport minimum weight to fee to master (#5739)

* propose fix fees

* add tests to kusama runtime as well

* better tests

* last change

* last update

* Fix test

* ignore tests again

* staking-miner: CLI flag delay solution x secs (#5734)

* staking-miner: CLI flag delay solution x secs

* Update utils/staking-miner/src/monitor.rs

* Update utils/staking-miner/src/opts.rs

* more logging

* add more verbose logging

* Update utils/staking-miner/src/opts.rs

Co-authored-by: David <dvdplm@gmail.com>

* Update utils/staking-miner/src/opts.rs

Co-authored-by: David <dvdplm@gmail.com>

* remove redundant check

Co-authored-by: David <dvdplm@gmail.com>

* fix(staking miner): check latest state in solution (#5744)

* bump zombienet version and fix test

* Update zombienet_tests/smoke/0003-deregister-register-validator-smoke.toml

Co-authored-by: Chevdor <chevdor@users.noreply.github.com>

* Update zombienet_tests/smoke/0003-deregister-register-validator.js

Co-authored-by: Chevdor <chevdor@users.noreply.github.com>

Co-authored-by: Andrei Sandu <andrei-mihail@parity.io>
Co-authored-by: Alexander Samusev <41779041+alvicsam@users.noreply.github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kian Paimani <5588131+kianenigma@users.noreply.github.com>
Co-authored-by: Niklas Adolfsson <niklasadolfsson1@gmail.com>
Co-authored-by: David <dvdplm@gmail.com>
Co-authored-by: Andrei Sandu <54316454+sandreim@users.noreply.github.com>
Co-authored-by: Chevdor <chevdor@users.noreply.github.com>
2022-07-05 18:43:01 +00:00
Andronik 8ba03ac6d2 zombienet: try to fix parachains upgrade test (#5724)
* zombienet: try to fix parachains upgrade test

* try a different collator image

* Revert "try a different collator image"

This reverts commit c83b2929f5a703be0979b4429ab01808408b074d.

* try setting cumulusBased

* fix zombienet upgrade test

* change image

* update command for test

* update zombienet image

* bump zombienet version

* bump zn version

* Revert "try setting cumulusBased"

This reverts commit 0312fa0a7a19065e097b186a08757938abd7c130.

* Revert "update command for test"

This reverts commit 81707e30188a1838e952d66deedaecbff6cb2971.

* Revert "change image"

This reverts commit 43a4f4a6a0286f5bf6698a44b82de835a723b531.

* zombienet: change validator image to a PR branch

Co-authored-by: Javier Viola <javier@parity.io>
2022-06-28 09:15:12 +00:00
João Paulo Silva de Souza ba9349240a pass $COMPANION_OVERRIDES to check_dependent_project (#5708) 2022-06-23 09:01:01 +00:00
Alexander Samusev f0b932139e Add publish docker staking-miner (#5710)
* [DO NOT MERGE] Add publish docker staking-miner

* debug docker publish

* remove debug

* small naming fix

* fix comment
2022-06-22 09:40:52 +02:00
Javier Viola d578d176cb Zombienet re-enable upgrade test (#5691)
* re-enable upgrade test

* fix job name

* Update .gitlab-ci.yml

Co-authored-by: Alexander Samusev <41779041+alvicsam@users.noreply.github.com>

* Update .gitlab-ci.yml

Co-authored-by: Alexander Samusev <41779041+alvicsam@users.noreply.github.com>

* Fix test env path

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

Co-authored-by: Andronik <write@reusable.software>
Co-authored-by: Alexander Samusev <41779041+alvicsam@users.noreply.github.com>
Co-authored-by: Andrei Sandu <andrei-mihail@parity.io>
2022-06-21 14:08:21 +00:00
Denis Pisarev bca124a46f CI: temporarily build docs with a nightly compiler (#5508) 2022-05-11 20:23:30 +02:00
Alexander Samusev 2a89e5612b [ci] change polkadot binary extra tag (#5483) 2022-05-09 17:40:18 +02:00
João Paulo Silva de Souza 5246fc0195 customize check-dependent-* for release engineering (#5425) 2022-05-04 16:45:30 +02:00
Sergejs Kostjucenko d54e3f7cb7 remove vault from ci (#5420) 2022-05-03 00:11:15 +03:00
João Paulo Silva de Souza 4a311f1da4 use options for check_dependent_project (#5392)
Co-authored-by: TriplEight <denis.pisarev@parity.io>
2022-04-26 16:58:57 +02:00
Sergejs Kostjucenko 631a5db536 Move scripts used in CI to the new location (#5198)
* Move CI scripts and update references

* Update paths in .gitlab-ci.yml

* Removed outdated entries from CODEOWNERS
2022-04-26 08:39:31 +03:00
João Paulo Silva de Souza 203441981f Use EXTRA_DEPENDENCIES for pipeline-scripts (#5328)
* temporary: check if it works

* EXTRA_DEPENDENCIES for pipeline-scripts

* revert pipeline scripts source
2022-04-21 17:46:14 +02:00
Bastian Köcher 905ec74f6a Prepare for rust 1.60 (#5282)
* Prepare for rust 1.60

* change ci image to staging

* empty commit for pipeline rerun

* ci image production

Co-authored-by: Alexander Samusev <41779041+alvicsam@users.noreply.github.com>
Co-authored-by: alvicsam <alvicsam@gmail.com>
2022-04-11 11:31:39 +02:00
Oliver Tale-Yazdi 08163de073 Co #11164: Sub-commands for benchmark (#5247)
* Restructure benchmark commands

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Add benchmark storage test

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* cargo update -p sp-io

* Revert "cargo update -p sp-io"

This reverts commit c321b570cef806934acfb7e1a18f543a681b9927.

* cargo update -p sp-io

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* update lockfile for {"substrate"}

* remove `useless_attribute`

* Remove rococo-native cfg

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Make cumulus build

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Fix benchmark commands for the CI

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Make cumulus build

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Make cumulus build

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Disable new bench commands for rococo

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Make cumulus build

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

Co-authored-by: Shawn Tabrizi <shawntabrizi@gmail.com>
Co-authored-by: parity-processbot <>
2022-04-07 22:29:16 +00:00
Sergejs Kostjucenko be085c253d CI Fix paths to vault secrets (#5272)
* Fix paths to vault secrets

* Fix paths
2022-04-07 12:24:29 +03:00
Javier Viola cd4f9abf6f bump zombienet version (#5225)
* bump zombienet version

* update path for zombienet scripts

* bump version and move from  extra_args to args

Co-authored-by: Andrei Sandu <andrei-mihail@parity.io>
2022-04-04 12:07:50 +00:00
Mara Robin B 11c897eaca [ci] add update_rococo_weights job (#5239) 2022-04-02 22:57:00 +02:00
Oliver Tale-Yazdi 41d8c97113 CI: Require kusama benchmark to pass (#5228)
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>
2022-04-01 09:46:27 +02:00
Oliver Tale-Yazdi 9fdc059363 [ci] Require short-benches check to pass (#5207)
* [ci] Require short-benches check to pass

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

* Allow the kusama benchmarks to fail

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>
2022-03-29 11:02:30 +02:00
Alexander Samusev aa89374d4a [ci] Run short benchmarks only in PR pipelines (#5200) 2022-03-24 17:51:36 +01:00
Alexander Samusev dea0cc42c7 [ci] Add short benchmarks to the pipeline (#5188)
* [ci] Add short benchmarks to the pipeline

* fix bench

* divide build and bench

* debug

* debug

* remove build from bench script

* run benches on ci runners

* return full pipeline

* fix pipeline

* Update scripts/run_short_benches_for_runtime.sh

Co-authored-by: Mara Robin B. <mara@broda.me>

* change short benchmark script

* allow short bench fail

Co-authored-by: Mara Robin B. <mara@broda.me>
Co-authored-by: parity-processbot <>
2022-03-24 13:52:32 +01:00
Mara Robin B 2c8ea1e0e4 [ci] scripts: don't rebuild for every pallet benchmark (#5126)
* scripts: don't rebuild for every pallet benchmark

* ci: remove orphan variable

* [ci] run_benches_for_runtime.sh: explicit relative path names

* [ci] scripts: handle failing benchmarks
2022-03-15 15:59:33 +01:00
Mara Robin B f67517f3b3 ci: use production profile for all benchmarks (follow-up for #5100) (#5102) 2022-03-14 13:44:24 +01:00
Mara Robin B 68209b7a5f ci: use production profile for benchmarks (#5100) 2022-03-14 12:22:55 +01:00
Andrei Sandu 3e357ec0a8 Zombienet: add cpu/mem resource requests (#5080)
* Ensure request/limits for CPU and memory for nodes

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* docker.io/paritytech/zombienet:v1.2.19

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* Deny failure

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>

* add retry back

Signed-off-by: Andrei Sandu <andrei-mihail@parity.io>
2022-03-14 10:47:37 +00:00
Alexander Samusev 3a11be1683 [ci] cancel pipeline if test-linux-stable fail (#5066)
* [Do not merge] cancel pipeline if test-linux-stable fail

* empty commit for pipeline rerun

* fix test-linux-stable

* fail test-linux-stable

* empty commit for pipeline rerun

* fix test-linux-stable

* Update .gitlab-ci.yml

Co-authored-by: Denis Pisarev <denis.pisarev@parity.io>

* small fixes

* add needs

Co-authored-by: Denis Pisarev <denis.pisarev@parity.io>
2022-03-10 18:20:33 +01:00
Alexander Samusev 53f5919cb7 [ci] fix test-node-metrics dependency (#5041) 2022-03-07 10:50:18 +01:00