Commit Graph

169 Commits

Author SHA1 Message Date
Pierre Krieger 5b387fd13f Enable debug assertions on burn-in PRs (#2826) 2021-04-06 16:56:46 +02:00
Robert Klotzner 467f9bb51d Enable debug assert for real. (#2716) 2021-03-25 23:30:49 +01:00
Robert Klotzner 485e406058 Enable debug assertions on rococo. (#2708) 2021-03-25 15:45:31 +01:00
Denis Pisarev db3cdca001 CI: fix env file location (#2657)
* CI: fix env file location

* Increase payable nominators per validator (#2637)

* inc

* cargo run --release --features=runtime-benchmarks -- benchmark --chain=polkadot-dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/

* cargo run --release --features=runtime-benchmarks -- benchmark --chain=kusama-dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/kusama/src/weights/

* cargo run --release --features=runtime-benchmarks -- benchmark --chain=westend-dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/westend/src/weights/

* Add test

Co-authored-by: Parity Benchmarking Bot <admin@parity.io>

* Add debug messaes to the bridge actions (#2668)

* more approval voting instrumentation (#2663)

* more approval voting instrumentation

* fix `unapproved_candidates`

* Update node/core/approval-voting/src/lib.rs

Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>

* Add Parachain Onboarding to Rococo (#2660)

* Add Parachain Onboarding Pallets to Rococo

* remove propose_parachain

* add back para sudo wrapper

* Revert "remove propose_parachain"

This reverts commit 38b7c33c817964c9f8ad48531a72aede83670291.

* turn propose_parachains into validator_manager

* Update runtime/rococo/src/lib.rs

Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>

* update origin

Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>

* Improve logging (#2669)

* Improve logging

* Review feedback

* Fix some warning and some further logging changes

* Fix up CI for new labels (#2673)

* Fix up CI/CD for the new labels.

* Fix labels

* [CI] Require D*-audit labels for any runtime changes (#2617)

* update generate_release_text.rb

* add checks for audit labels for runtime changes

* fix check_labels.sh

* use has_runtime_changes in check_runtime.sh

* add D1-trivial label

* fix check_labels.sh

* Tweak Rococo Settings For Onboarding Testing (#2671)

* Tweak Rococo Settings

* rococo: use CurrentBlockRandomness wrapper in auctions

Co-authored-by: André Silva <andrerfosilva@gmail.com>
Co-authored-by: Bastian Köcher <info@kchr.de>

* Fix check-labels.yml for forked repos (#2677)

* fix check-labels.yml for forked repos

* update labels

* CI: pass VERSION variable to SimNet

* CI: chore

* CI: fix env file location

* CI: pass VERSION variable to SimNet

* CI: chore

Co-authored-by: Kian Paimani <5588131+kianenigma@users.noreply.github.com>
Co-authored-by: Parity Benchmarking Bot <admin@parity.io>
Co-authored-by: Pierre Krieger <pierre.krieger1708@gmail.com>
Co-authored-by: Robert Habermeier <rphmeier@gmail.com>
Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>
Co-authored-by: Shawn Tabrizi <shawntabrizi@gmail.com>
Co-authored-by: Gavin Wood <gavin@parity.io>
Co-authored-by: Martin Pugh <pugh@s3kr.it>
Co-authored-by: André Silva <andrerfosilva@gmail.com>
Co-authored-by: Bastian Köcher <info@kchr.de>
2021-03-23 20:49:41 +01:00
Denis Pisarev b67c36d411 CI: build an image and trigger simnet (#2643)
* CI: build an image and trigger simnet

* CI: think of a funny name

* CI: fix the artifact

* CI: address the bug with .env

* CI: some explanation
2021-03-22 11:01:06 +01:00
Robert Klotzner 78ac4b7add Whole subsystem test for new availability-distribution (#2552)
* WIP: Whole subsystem test.

* New tests compile.

* Avoid needless runtime queries for no validator nodes.

* Make tx and rx publicly accessible in virtual overseer.

This simplifies mocking in some cases, as tx can be cloned, but rx can
not.

* Whole subsystem test working.

* Update node/network/availability-distribution/src/session_cache.rs

Co-authored-by: Andronik Ordian <write@reusable.software>

* Update node/network/availability-distribution/src/session_cache.rs

Co-authored-by: Andronik Ordian <write@reusable.software>

* Document better what `None` return value means.

* Get rid of BitVec dependency.

* Update Cargo.lock

* Hopefully fixed implementers guide build.

Co-authored-by: Andronik Ordian <write@reusable.software>
2021-03-03 16:23:15 +01:00
Martin Pugh 62c5896592 [CI] Fix check-tx-version Gitlab job (#2449)
* set -e for tx job

* dont set -e while we investigate

* fetch latest release polkadot

* add jq to node:15 image

* Add logic for timing out if nodes never start listening

* remove trap
2021-02-17 16:25:44 +01:00
Martin Pugh 013b271359 [CI] Move check_labels to github actions (#2415)
* move lib.sh to common dir

* make check-labels a github action

* check out the repo

* fix secrets

* add labelled PR type

* remove check-labels job from gitlab

* trigger on unlabelling also
2021-02-10 17:50:49 +00:00
Denis Pisarev 87922b254a Publish rococo on every push to rococo-v1 branch (#2388)
* CI: change manual triggering to auto based on rules [skip ci]

* CI: remove debug comments [skip ci]

* CI: chore

* CI: chore

* CI: cargo update -p sp_io
2021-02-07 09:12:15 -06:00
Denis Pisarev d850284841 CI: workaraound for variable not passed to after_script (#2256) 2021-01-12 18:17:00 +01:00
Denis Pisarev bfac3b882e CI: add rococo build and conteinerization (#2217)
* CI: add rococo build and conteinerization

* CI: overhaul rules

* CI: two new conditional jobs to build rococo, CI overhaul, npm security fix

* CI: remove web-wasm publishing
2021-01-12 15:19:59 +01:00
Denis Pisarev 6bc1ec90d4 CI: remove squash and fix buildah push (#2212) 2021-01-06 18:51:25 +01:00
Denis Pisarev 05e9f13782 CI: buildah to build images (#2125)
* CI: buildah to build images

* CI: secure login
2020-12-17 10:46:42 +01:00
Martin Pugh 0ab81c907f Add CI job to verify extrinsic ordering (#1950)
* WIP: add initial check_extrinsics_ordering.sh script

* iterate through runtimes, add gitlab job

* move job to publish

* temp force build-linux-release to run

* update check_extrinsics_ordering.sh

* maybe we have to fetch release

* use node docker image

* revert before opening pr: force bad extrinsic ordering

* revert commits to prepare for PR

* move job to build stage, use bin from test-linux-release

* remove FIXME

* fix PR nags
2020-11-16 14:41:57 +01:00
s3krit 032c68850d [CI] Docker image updates (#1799) 2020-10-19 15:44:14 +02:00
Denis Pisarev d089baf2d4 WIP: remove deprecated only/except clauses, build is now manual on PRs (#1769)
* change (CI): soon to be deprecated only changed to rules, build is now manual on PRs

* change (CI): add workflow to avoid doubled pipelines, remove second job

* debug (CI): unblock pipeline from waiting a manual action
2020-09-30 22:17:00 +02:00
ddorgan 0931d0aafa Add manual action to build PR binary (#1470)
* Allow manual action for building a PR binary

* Allow test-refs for PR manual build

* Test PR build in github actions

* Use steps in build

* Removing build via github actions
2020-08-27 10:45:06 +02:00
Cecile Tonglet 497772da18 Ignore checks for companion PRs (#1455) 2020-08-06 06:52:03 +02:00
s3krit 05675df4ed [CI] Publish draft release redux (#1493)
* Add publish-draft-release Github action
* Remove publish_draft_release.sh gitlab job
2020-07-30 14:02:51 +02:00
Benjamin Kampmann 1b8211dd4f CI Regression Test for determinism of our wasm runtimes (#1372)
* deterministic build check runtime

* fix yaml

* Apply suggestions from code review

Co-authored-by: s3krit <pugh@s3kr.it>

* Update cargo.lock

Co-authored-by: s3krit <pugh@s3kr.it>
2020-07-20 10:56:28 +02:00
gabriel klawitter 2316da0523 ci: fix subdirectory upload to s3 (#1398) 2020-07-14 16:38:49 +05:30
Robert Habermeier 42bd096413 I am dumb and can't spell (#1366)
* rename implementor's guide to implementer's guide

* fix typos in more places
2020-07-07 10:10:36 -04:00
Sergei Shulepov 90a1ba1e90 Fix glossary link (snowballed) (#1297)
* Add mdbook-linkcheck

* Convert todo to not a link

* Fix external glossary link

* Fix various broken links

* Mass replace: s/.html/.md/

* My sloppy attempt to add a gitlab CI check
2020-06-20 14:23:28 -04:00
Denis Pisarev 7fd36394b6 change (ci): remove CARGO_HOME caching as it's still broken (#1291) 2020-06-19 18:51:31 +02:00
s3krit c3ed40fbe6 [CI] Add criticality of release to release notes (#1259)
* Enforces presence of C-labels to designate the importance of a release
* Iterates over them on a release, takes the highest present and includes it in the release notes
* Lists the change(s) that caused the release to be that priority
2020-06-17 14:10:13 +02:00
Martin Pugh b5aecb8a3d update label names for check_labels job 2020-06-16 15:38:43 +02:00
Denis Pisarev a364c4880d CI images were moved (#1194)
* change (ci): ci images were moved

* change (ci): rename substrate-ci-linux
2020-06-10 09:29:56 +02:00
s3krit 9bbcc3d89f [CI] Fix release notification message, and add rustc version to release notes (#1191)
* Release announcements: s/kusama/polkadot/

* Additional debug info for gitlab publish script

* add rustc version check job

* fully comment out tag-checking

* s/podman/docker/g

* Switch to rust-builder image and install jq

* remove temporary TODOs
2020-06-09 11:12:34 +02:00
s3krit a184320503 [CI] Move check-labels to .post stage (#1114) 2020-05-20 12:26:10 +02:00
s3krit 5d58f7a43a [CI] Expose WASM binaries on publish (#1093)
* add build-wasm-release CI job

* temporarily run build-wasm-release everywhere

* temporary job to inspect artifacts dir

* fix test job

* fix test job again

* remove temporary job

* remove FIXME for when to run jobs

* remove pointless echo

* Change cargo build for wasm-pack

* Checksum polkadot_cli files

* make separate wasm dir for artifacts

* fix nits
2020-05-15 16:29:48 +02:00
Denis Pisarev 11cd00567a change (ci): fail test on warnings (#1102) 2020-05-15 16:29:11 +02:00
s3krit b2655b5220 [CI] add check_tags CI job (#1072)
* add check_tags CI job

* fix typo in gitlab-ci.yml

* add more useful CI output

* Make presence of github token optional
2020-05-08 17:31:23 +02:00
Shawn Tabrizi b15cfb736d Add runtime benchmarking suite to all runtimes (#1034)
* Add benchmarking suite to all runtimes

* Add `runtime-benchmarks` feature to `test-linux-stable`

* Update Cargo.lock

* Update Cargo.lock

* Update Cargo.lock

* "user" instead of "caller"

* undo these changes
2020-04-27 16:19:46 +02:00
gabriel klawitter 65c5a1b5ac ci: deploy: remove test branch (#975) 2020-04-06 11:48:02 +02:00
gabriel klawitter 189c542655 ci: kusama-nightly-staging: removal of substrate's polkadot-master branch (#962)
* ci: kusama-nightly-staging: remove builds for the branches and trigger deployment directly

* ci: kusama-nightly-staging: remove ii and fix
2020-04-03 20:48:49 +02:00
Shawn Tabrizi d52c3a45a7 Add CI check for runtme-benchmarks (#936) 2020-03-25 11:27:29 +01:00
Ashley fb442c9112 Update and fix wasm code again, add cli check to .gitlab-ci.yml (#917)
* Add cli to wasm tests, update and bring closer to the substrate browser code

* Remove ws.js

* Update cli/src/browser.rs

Co-Authored-By: Pierre Krieger <pierre.krieger1708@gmail.com>

* Update browser.rs

Co-authored-by: Gavin Wood <gavin@parity.io>
Co-authored-by: Pierre Krieger <pierre.krieger1708@gmail.com>
2020-03-21 16:13:59 +01:00
s3krit 73ab649437 CI: Move publish_draft_release job to test stage, and substrate changelog subsections (#908)
* Move publish_draft_release to test stage

Also remove the alert_pending_release job since it's no longer needed

* delete alert_pending_release.sh

* Add splitting substrate changes into subsections
2020-03-21 13:39:52 +01:00
gabriel klawitter b49bf9d5b0 ci: increase artifact retention period (#869)
* ci: increase artifact retention period
2020-03-05 14:12:00 +01:00
s3krit e4cc7c5812 Add publish_draft_release.sh (#752)
* Add publish_draft_release.sh

This new CI script will generate a list of differences between
this tagged version and the previous tagged version (including
substrate changes), and create a draft release on Github. Once
this is done, the draft release will be posted in Matrix (the
channel is determined by a Gitlab CI environment variable).

* Add highlighting gav for draft release
2020-01-10 20:29:42 +01:00
s3krit 2d5a1c953a allow release alerts to fail (#725) 2020-01-06 19:40:58 +01:00
Arkadiy Paronyan a00d74d825 Support both polkadot and kusama runtimes (#704)
* Allow both polkadot and kusama runtimes

* Allow both polkadot and kusama runtimes

* Make `collator` build

* Removed kusama runtime

* Introduced common runtime

* Updated for latest substrate

* Updated CI targets

* Updated CI version check

* Removed unused dependency

* Pulled latests substrate

* Pulled latest substrate

* Fixed version

* Apply suggestions from code review

Co-Authored-By: Bastian Köcher <bkchr@users.noreply.github.com>

* NEW_HEADS_IDENTIFIER moved to primitives

* Updated CI check script

* Fixed script

* Set epoch duration for polkadot

* ci: check_runtime for both runtimes

Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>
Co-authored-by: gabriel klawitter <gabreal@users.noreply.github.com>
2020-01-03 18:31:39 +00:00
gabriel klawitter 11b1bf230e ci: fix release tagging after tags are added on the master branch (#714)
* ci: fix release tagging after tags are added on the master branch

* ci: latest tag applied to latest tag
2020-01-03 18:30:53 +00:00
gabriel klawitter bb9c92204b ci: increase git cloning depth to 100 (#707) 2019-12-24 16:13:26 +01:00
s3krit 68132e3fd3 Add matrix release alert script and gitlab job (#688)
* Add matrix release alert script and gitlab job

* Update .gitlab-ci.yml

Co-Authored-By: Kirill Pimenov <kirill@parity.io>
2019-12-13 16:08:32 +01:00
Fedor Sakharov 99d164b5e7 Erasure encoding availability (#345)
* Erasure encoding availability initial commit

 * Modifications to availability store to keep chunks as well as
   reconstructed blocks and extrinsics.
 * Gossip messages containig signed erasure chunks.
 * Requesting eraure chunks with polkadot-specific messages.
 * Validation of erasure chunk messages.

* Apply suggestions from code review

Co-Authored-By: Luke Schoen <ltfschoen@users.noreply.github.com>

* Fix build after a merge

* Gossip erasure chunk messages under their own topic

* erasure_chunks should use the appropriate topic

* Updates Cargo.lock

* Fixes after merge

* Removes a couple of leftover pieces of code

* Fixes simple stuff from review

* Updates erasure and storage for more flexible logic

* Changes validation and candidate receipt production.

* Adds add_erasure_chunks method

* Fixes most of the nits

* Better validate_collation and validate_receipt functions

* Fixes the tests

* Apply suggestions from code review

Co-Authored-By: Robert Habermeier <rphmeier@gmail.com>

* Removes unwrap() calls

* Removes ErasureChunks primitive

* Removes redundant fields from ErasureChunk struct

* AvailabilityStore should store CandidateReceipt

* Changes the way chunk messages are imported and validated.

 * Availability store now stores a validator_index and n_validators for
 each relay_parent.
 * Availability store now also stores candidate receipts.
 * Removes importing chunks in the table and moves it into network
 gossip validation.
 * Validation of erasure messages id done against receipts that are
 stored in the availability store.

* Correctly compute topics for erasure messages

* Removes an unused parameter

* Refactors availability db querying into a helper

* Adds the apis described in the writeup

* Adds a runtime api to extract erasure roots form raw extrinsics.

* Adds a barebone BlockImport impl for avalability store

* Adds the implementation of the availability worker

* Fix build after the merge with master.

* Make availability store API async

* Bring back the default wasmtime feature

* Lines width

* Bump runtime version

* Formatting and dead code elimination

* some style nits (#1)

* More nits and api cleanup

* Disable wasm CI for availability-store

* Another nit

* Formatting
2019-12-03 15:49:07 +01:00
Denis Pisarev 675ca2e258 interruptible test and build jobs (#642) 2019-12-02 17:20:03 +01:00
Pierre Krieger ed7ee57290 Add WASM CI checks and make availability-store compile for WASM (#626)
* Make availability-store compile for WASM

* Use --manifest-path instead
2019-11-29 16:12:16 +01:00
gabriel klawitter 663ff3db91 ci: add runtime version check (#555) 2019-11-09 10:46:36 +01:00
Denis Pisarev 676f1562b9 retry on gitlab system failures (#521)
* retry on gitlab system failures

* max is just 2
2019-10-31 11:12:23 +01:00