João Paulo Silva de Souza
4a311f1da4
use options for check_dependent_project ( #5392 )
...
Co-authored-by: TriplEight <denis.pisarev@parity.io >
2022-04-26 16:58:57 +02:00
Sergejs Kostjucenko
631a5db536
Move scripts used in CI to the new location ( #5198 )
...
* Move CI scripts and update references
* Update paths in .gitlab-ci.yml
* Removed outdated entries from CODEOWNERS
2022-04-26 08:39:31 +03:00
João Paulo Silva de Souza
203441981f
Use EXTRA_DEPENDENCIES for pipeline-scripts ( #5328 )
...
* temporary: check if it works
* EXTRA_DEPENDENCIES for pipeline-scripts
* revert pipeline scripts source
2022-04-21 17:46:14 +02:00
Bastian Köcher
905ec74f6a
Prepare for rust 1.60 ( #5282 )
...
* Prepare for rust 1.60
* change ci image to staging
* empty commit for pipeline rerun
* ci image production
Co-authored-by: Alexander Samusev <41779041+alvicsam@users.noreply.github.com >
Co-authored-by: alvicsam <alvicsam@gmail.com >
2022-04-11 11:31:39 +02:00
Oliver Tale-Yazdi
08163de073
Co #11164 : Sub-commands for benchmark ( #5247 )
...
* Restructure benchmark commands
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* Add benchmark storage test
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* cargo update -p sp-io
* Revert "cargo update -p sp-io"
This reverts commit c321b570cef806934acfb7e1a18f543a681b9927.
* cargo update -p sp-io
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* update lockfile for {"substrate"}
* remove `useless_attribute`
* Remove rococo-native cfg
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* Make cumulus build
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* Fix benchmark commands for the CI
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* Make cumulus build
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* Make cumulus build
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* Disable new bench commands for rococo
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* Make cumulus build
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
Co-authored-by: Shawn Tabrizi <shawntabrizi@gmail.com >
Co-authored-by: parity-processbot <>
2022-04-07 22:29:16 +00:00
Sergejs Kostjucenko
be085c253d
CI Fix paths to vault secrets ( #5272 )
...
* Fix paths to vault secrets
* Fix paths
2022-04-07 12:24:29 +03:00
Javier Viola
cd4f9abf6f
bump zombienet version ( #5225 )
...
* bump zombienet version
* update path for zombienet scripts
* bump version and move from extra_args to args
Co-authored-by: Andrei Sandu <andrei-mihail@parity.io >
2022-04-04 12:07:50 +00:00
Mara Robin B
11c897eaca
[ci] add update_rococo_weights job ( #5239 )
2022-04-02 22:57:00 +02:00
Oliver Tale-Yazdi
41d8c97113
CI: Require kusama benchmark to pass ( #5228 )
...
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
2022-04-01 09:46:27 +02:00
Oliver Tale-Yazdi
9fdc059363
[ci] Require short-benches check to pass ( #5207 )
...
* [ci] Require short-benches check to pass
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* Allow the kusama benchmarks to fail
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
2022-03-29 11:02:30 +02:00
Alexander Samusev
aa89374d4a
[ci] Run short benchmarks only in PR pipelines ( #5200 )
2022-03-24 17:51:36 +01:00
Alexander Samusev
dea0cc42c7
[ci] Add short benchmarks to the pipeline ( #5188 )
...
* [ci] Add short benchmarks to the pipeline
* fix bench
* divide build and bench
* debug
* debug
* remove build from bench script
* run benches on ci runners
* return full pipeline
* fix pipeline
* Update scripts/run_short_benches_for_runtime.sh
Co-authored-by: Mara Robin B. <mara@broda.me >
* change short benchmark script
* allow short bench fail
Co-authored-by: Mara Robin B. <mara@broda.me >
Co-authored-by: parity-processbot <>
2022-03-24 13:52:32 +01:00
Mara Robin B
2c8ea1e0e4
[ci] scripts: don't rebuild for every pallet benchmark ( #5126 )
...
* scripts: don't rebuild for every pallet benchmark
* ci: remove orphan variable
* [ci] run_benches_for_runtime.sh: explicit relative path names
* [ci] scripts: handle failing benchmarks
2022-03-15 15:59:33 +01:00
Mara Robin B
f67517f3b3
ci: use production profile for all benchmarks (follow-up for #5100 ) ( #5102 )
2022-03-14 13:44:24 +01:00
Mara Robin B
68209b7a5f
ci: use production profile for benchmarks ( #5100 )
2022-03-14 12:22:55 +01:00
Andrei Sandu
3e357ec0a8
Zombienet: add cpu/mem resource requests ( #5080 )
...
* Ensure request/limits for CPU and memory for nodes
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* docker.io/paritytech/zombienet:v1.2.19
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Deny failure
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* add retry back
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
2022-03-14 10:47:37 +00:00
Alexander Samusev
3a11be1683
[ci] cancel pipeline if test-linux-stable fail ( #5066 )
...
* [Do not merge] cancel pipeline if test-linux-stable fail
* empty commit for pipeline rerun
* fix test-linux-stable
* fail test-linux-stable
* empty commit for pipeline rerun
* fix test-linux-stable
* Update .gitlab-ci.yml
Co-authored-by: Denis Pisarev <denis.pisarev@parity.io >
* small fixes
* add needs
Co-authored-by: Denis Pisarev <denis.pisarev@parity.io >
2022-03-10 18:20:33 +01:00
Alexander Samusev
53f5919cb7
[ci] fix test-node-metrics dependency ( #5041 )
2022-03-07 10:50:18 +01:00
Alexander Samusev
9eebcb8870
[ci] Create synth-wave docker image on tag ( #4990 )
...
* [ci] Create synth-wave docker image on tag
* fix zombienet dependency
* fix image naming
* CI: fix merge
Co-authored-by: Denis Pisarev <17856421+TriplEight@users.noreply.github.com >
Co-authored-by: TriplEight <denis@parity.io >
2022-03-03 17:36:41 +01:00
Alexander Samusev
13fb87c8f3
[ci] Optimizing pipeline ( #5001 )
...
* [DO NOT MERGE] Optimizing pipeline
* add stages
* remove lock for tests
* return locked
* empty commit for pipeline rerun
* add comment about DAG
* Update .gitlab-ci.yml
Co-authored-by: Denis Pisarev <17856421+TriplEight@users.noreply.github.com >
* Update .gitlab-ci.yml
Co-authored-by: Denis Pisarev <17856421+TriplEight@users.noreply.github.com >
* Update .gitlab-ci.yml
Co-authored-by: Denis Pisarev <17856421+TriplEight@users.noreply.github.com >
* Update .gitlab-ci.yml
Co-authored-by: Denis Pisarev <17856421+TriplEight@users.noreply.github.com >
* Update .gitlab-ci.yml
Co-authored-by: Denis Pisarev <17856421+TriplEight@users.noreply.github.com >
* Update .gitlab-ci.yml
Co-authored-by: Denis Pisarev <17856421+TriplEight@users.noreply.github.com >
* Update .gitlab-ci.yml
Co-authored-by: Denis Pisarev <17856421+TriplEight@users.noreply.github.com >
* Update .gitlab-ci.yml
Co-authored-by: Denis Pisarev <17856421+TriplEight@users.noreply.github.com >
* Update .gitlab-ci.yml
Co-authored-by: Denis Pisarev <17856421+TriplEight@users.noreply.github.com >
Co-authored-by: Denis Pisarev <17856421+TriplEight@users.noreply.github.com >
2022-03-03 16:26:54 +01:00
Andrei Sandu
0fa91e7043
Zombienet: add new test collator and integration test ( #4797 )
...
* WIP: Wasm compilation perf
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Fix
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Undying collator WIP
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Fix build
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* more fixes
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* update test with undying
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Correctly compute post hash
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* update helper
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* squash bugs
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Add --pov-size cli parameter
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* refactor
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* fix strings
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Add pov-size param to export genesis state
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Fix graveyard size
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* docs + fmt
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Fix PVF bug and switch to u8 graves
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Update tests
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Build/publish undying collator as colander img
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* add undying-collator to colander image
* Fix transaction overflow
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* warn fix
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* add parachain id for export genesis cli
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* fix
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* fix the build
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* scale test up
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* default parachain id
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Add PVF complexity param
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Hash on each iteration
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Update pvf metric histogram buckets
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Ladi attempt to fix tests
* Fix test
* Fix typos
* Fix pvf typo
* CI integration
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* cargo lock missing
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* fix clap merge damage
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* add zombienet image back
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Use collator image from env
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* bump zombienet version
* update test to check pvf prep/exec
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* delete file
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* use default bootnode in upgrade test
* FIx tests
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* add some stress - pvf exec times up to 2s
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* fix name
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Dial down pvf execution time < 2s
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* 1100
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* bump
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* try again
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Add connectivity check
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Fixes and refactor folder struct
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* change toml name to match
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* bump zombienet
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* impl Feedback for Review 😎
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* spell check
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Zombienet: add disputes test (#4859 )
* Zombienet disputes test
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* CI: add zombienet-parachain-disputes
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Bump zombienet
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* reduce duration
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Update zombienet_tests/functional/0002-parachains-disputes.feature
fix test
* Update zombienet_tests/functional/0002-parachains-disputes.feature
fix fix
* more logs and set collator image
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* spellcheck
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* fix cargo lock damage
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* merge fixes
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* bump zombienet image
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* cargo lock
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* debugging CI run - scale down test
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* fix cargo merge damage
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* default command fix
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
* Revert "debugging CI run - scale down test"
This reverts commit eec2ba7e65ede3f929e2f0a8fe44930df2119450.
* more review feedback
Signed-off-by: Andrei Sandu <andrei-mihail@parity.io >
Co-authored-by: Javier Viola <javier@parity.io >
Co-authored-by: Lldenaurois <Ljdenaurois@gmail.com >
2022-02-28 10:27:01 +00:00
Bernhard Schuster
85fa087405
do not allow zombienet tests to fail ( #4989 )
2022-02-25 16:04:13 +00:00
radupopa2010
bf1a805c9e
feat: decrese the validity for biggest artifacts ( #4970 )
2022-02-22 15:25:08 +01:00
Bernhard Schuster
1ba4af9f15
add pyroscope ( #4871 )
...
* pyroscope
* fixup
* add pyroscope target
* fixins
* spellcheck
* rename 'pyroscoped' feature to 'pyroscope'
* build testnet binary with pyroscope feature
* Update Cargo.toml
Co-authored-by: Andronik <write@reusable.software >
* make args a string, resolve using std::net
* fixup
* remove --features pyroscope for testnet builds
Until the panics are fixed in upstream, this is sane.
* chore: bump pyroscope to 0.3.1
Fixes an underflow panic.
* Revert "remove --features pyroscope for testnet builds
"
This reverts commit 57dbdc7aa5f6427aeb1e3dfdfc97071c3a74851e.
* fix: Make sample rate a prime
Co-authored-by: Pierre Besson <pierre.besson@parity.io >
Co-authored-by: Andronik <write@reusable.software >
2022-02-22 13:16:49 +00:00
Bastian Köcher
c40c4bcbe9
Companion CI: Make sure to pass the update crates properly ( #4928 )
2022-02-16 12:02:04 +01:00
Javier Viola
b2b723a3db
remove upgrade test ( #4873 )
2022-02-08 16:57:26 +00:00
Alexander Samusev
8ee165c2c1
[ci] Fix scheduled pipeline ( #4855 )
...
* [ci] Fix scheduled pipeline
* empty commit for pipeline rerun
2022-02-07 11:48:56 +01:00
Alexander Samusev
12f3e943b1
[ci] revert #4779 ( #4843 )
2022-02-03 16:24:45 +01:00
radupopa2010
f69ca55712
feat(cicd): expire artifacts after 7 days ( #4833 )
...
We received several alerts about disk space in gitlab server.
Even if we have 1TiB allocated, disk space is consumed very fast.
We need to address this problem by expiring artifacts after 7 days.
2022-02-02 13:56:41 +01:00
Alexander Samusev
d9ab8ff576
[ci] Fix docker credentials ( #4826 )
2022-02-01 16:11:55 +01:00
Alexander Samusev
89c86d6300
[ci] remove publish-s3-release ( #4779 )
2022-01-25 12:06:04 +01:00
Alexander Samusev
6b7e40cd6c
[ci] pipeline chores ( #4775 )
...
* [ci] WIP: pipeline chores
* fix vault
* fix secrets
2022-01-24 18:18:53 +01:00
Javier Viola
883b490cae
[Zombienet] add dummy upgrade test ( #4660 )
2022-01-20 10:02:50 +01:00
Bastian Köcher
550e81b63f
Check that try-runtime compiles in CI ( #4736 )
...
It also moves some simple scripts directly into the .gitlab.yaml file.
2022-01-18 16:17:07 +01:00
Denis Pisarev
3ce6f9212c
CI: remove rococo from CI ( #4666 )
...
* CI: remove rococo from CI
* CI: typo
* CI: another typo
Co-authored-by: CI system <>
2022-01-10 18:28:06 +01:00
Andronik
c805500dfb
zombinet: bump collator image ( #4668 )
2022-01-07 09:04:20 +01:00
Alexander Samusev
041543882b
[ci] .gitlab-ci.yml chores ( #4663 )
...
* rename malus.Dockerfile
* ci chores
* fix pipeline
2022-01-06 12:25:24 +01:00
Andronik
a44349f652
custom cargo profiles for production ( #4627 )
...
* add custom profiles and specify MSVR as 1.57
* fix host-perf-check command
* use testnet profile for CI images
* do not do lto for testnet profile
* fix artifact path
* test with testnet profile to reuse build artifacts
* Revert "fix host-perf-check command"
This reverts commit f1d15492204b8251685a97636cbb5a5f394f21da.
* bump zombienet version
Co-authored-by: Javier Viola <javier@parity.io >
2021-12-29 14:10:40 +00:00
Andronik Ordian
d077ac2c5e
zombienet: fixed adder-collator image for the smoke test ( #4600 )
...
* zombinet: fixed adder-collator image for the smoke test
* update COL_IMAGE
* bump zombienet version
* try a different version
Co-authored-by: Javier Viola <javier@parity.io >
2021-12-27 13:29:37 +01:00
João Paulo Silva de Souza
b3e36538cd
make check-dependent-* only be executed in PRs ( #4588 )
...
Make check-dependent-* jobs only be executed in PRs instead of both PRs and
master.
Reason 1: The companion is not merged at the same time as the parent PR
([1](https://github.com/paritytech/parity-processbot/issues/347#issuecomment-994729950 )),
therefore the pipeline will fail on master since the companion PR is not yet
merged in the other repository. This scenario is demonstrated by the pipeline
of
https://github.com/paritytech/substrate/commit/82cc3746450ae9722a249f4ddf83b8de59ba6e0d .
Reason 2: The job can still fail on master due to a new commit on the companion
PR's repository which was merged after `bot merge` happened, as demonstrated by
the following scheme:
1. Parent PR is merged
2. Companion PR is updated and set to merge in the future
3. In the meantime a new commit is merged into the companion PR repository's
master branch
4. The `check-dependent-*` job runs on master but, due to the new commit, it
fails for unrelated reasons
While "Reason 2" can be used as an argument against this PR, in that it would
be useful to know if the integration is failing on master, "Reason 1" should be
taken care of due to this inherent flaw of the current companion build system
design.
2021-12-27 10:21:39 +01:00
Javier Viola
78c3284ce7
[Zombienet] fix test creds ( #4562 )
...
* remove custom kube file in creds
* typo in image name echo
2021-12-18 20:56:02 +01:00
Javier Viola
686d82a437
use v1.0.2 of zombienet ( #4553 )
2021-12-18 14:12:54 +01:00
Bernhard Schuster
2457c26a08
enable disputes for known chains, except for polkadot ( #4464 )
...
* enable disputes, for all known chains but polkadot
* chore: fmt
* don't propagate disputes either
* review
* remove disputes feature
* remove superfluous line
* Update node/service/src/lib.rs
Co-authored-by: Andronik Ordian <write@reusable.software >
* fixup
* allow being a dummy
* rialto
* add an enum, to make things work better
* overseer
* fix test
* comments
* move condition out
* excess arg
Co-authored-by: Andronik Ordian <write@reusable.software >
2021-12-17 17:50:48 +00:00
Chris Sosnin
8b1514862d
Dispute coordinator: look for included candidates in non-finalized chain ( #4508 )
...
* Fetch ancestors of the activated leaf
* Replace param type
* Increase step size
* Request block numbers for ancestors
* Store activated leaves in lru cache
* Fix doc-comment
* Rework LRU usage
* Typos & formatting
* Handle errors better
* Introduce a size limit for the ancestry
* Return fatal error when fetching finalized block
* Update tests
* Add tests for ordering provider
* Better naming
* fix zombienet test, new version
* zombienet add debug
* debug zombienet
Co-authored-by: Javier Viola <javier@parity.io >
2021-12-17 12:07:28 +01:00
Javier Viola
2c0d7730d7
Support new version of zombienet ( #4528 )
...
* test new version of zombienet
* use default chain spec command
* use commit ref to get test files
* change test spec for zombienet new versionzombienet_tests/parachains/0001-parachains-smoke-test.toml
* changes for new version of zombienet
* use paritytech zombienet version
2021-12-16 18:23:21 +01:00
Pierre Besson
6f2f9fe381
rename polkasync gitlab job to deploy-parity-testnet ( #4461 )
2021-12-16 12:43:58 +01:00
Pierre Krieger
77d70ac0d3
Companion PR for removing Prometheus metrics prefix ( #3623 )
...
* Companion PR for removing Prometheus metrics prefix
* Was missing some metrics
* Fix missing renames
* Fix test
* Fixes
* Update test
* Update Substrate
* Second time
* remove prefix from intergration test for zombienet
* update zombienet image
* Update Substrate
Co-authored-by: Bastian Köcher <info@kchr.de >
Co-authored-by: Javier Viola <pepoviola@gmail.com >
2021-12-10 15:24:54 +01:00
Chevdor
b081149939
Fix path of the polkadot sha256 ( #4458 )
2021-12-03 16:59:44 +01:00
Bastian Köcher
cb8cb7a12c
Fix cumulus companion CI job ( #4451 )
...
* Fix cumulus companion CI job
* Pass by env variable
* Switch to the latest release
* Update .gitlab-ci.yml
Co-authored-by: Denis Pisarev <17856421+TriplEight@users.noreply.github.com >
Co-authored-by: Denis Pisarev <17856421+TriplEight@users.noreply.github.com >
2021-12-03 14:14:50 +01:00
Alexander Samusev
2744faf6f0
[ci] Add ssh token for publishing gh-pages ( #4347 )
...
* [ci] Added ssh token for publishing gh-pages
* returned github_token
* fix ssh commands for publish-rustdoc
* fix ssh command for publish-docs
* Fix publish-rustdoc, remove clear /tmp
2021-11-25 10:18:38 +01:00