Commit Graph

64 Commits

Author SHA1 Message Date
Robert Klotzner 78ac4b7add Whole subsystem test for new availability-distribution (#2552)
* WIP: Whole subsystem test.

* New tests compile.

* Avoid needless runtime queries for no validator nodes.

* Make tx and rx publicly accessible in virtual overseer.

This simplifies mocking in some cases, as tx can be cloned, but rx can
not.

* Whole subsystem test working.

* Update node/network/availability-distribution/src/session_cache.rs

Co-authored-by: Andronik Ordian <write@reusable.software>

* Update node/network/availability-distribution/src/session_cache.rs

Co-authored-by: Andronik Ordian <write@reusable.software>

* Document better what `None` return value means.

* Get rid of BitVec dependency.

* Update Cargo.lock

* Hopefully fixed implementers guide build.

Co-authored-by: Andronik Ordian <write@reusable.software>
2021-03-03 16:23:15 +01:00
Martin Pugh 62c5896592 [CI] Fix check-tx-version Gitlab job (#2449)
* set -e for tx job

* dont set -e while we investigate

* fetch latest release polkadot

* add jq to node:15 image

* Add logic for timing out if nodes never start listening

* remove trap
2021-02-17 16:25:44 +01:00
Martin Pugh 013b271359 [CI] Move check_labels to github actions (#2415)
* move lib.sh to common dir

* make check-labels a github action

* check out the repo

* fix secrets

* add labelled PR type

* remove check-labels job from gitlab

* trigger on unlabelling also
2021-02-10 17:50:49 +00:00
Denis Pisarev 87922b254a Publish rococo on every push to rococo-v1 branch (#2388)
* CI: change manual triggering to auto based on rules [skip ci]

* CI: remove debug comments [skip ci]

* CI: chore

* CI: chore

* CI: cargo update -p sp_io
2021-02-07 09:12:15 -06:00
Denis Pisarev d850284841 CI: workaraound for variable not passed to after_script (#2256) 2021-01-12 18:17:00 +01:00
Denis Pisarev bfac3b882e CI: add rococo build and conteinerization (#2217)
* CI: add rococo build and conteinerization

* CI: overhaul rules

* CI: two new conditional jobs to build rococo, CI overhaul, npm security fix

* CI: remove web-wasm publishing
2021-01-12 15:19:59 +01:00
Denis Pisarev 6bc1ec90d4 CI: remove squash and fix buildah push (#2212) 2021-01-06 18:51:25 +01:00
Denis Pisarev 05e9f13782 CI: buildah to build images (#2125)
* CI: buildah to build images

* CI: secure login
2020-12-17 10:46:42 +01:00
Martin Pugh 0ab81c907f Add CI job to verify extrinsic ordering (#1950)
* WIP: add initial check_extrinsics_ordering.sh script

* iterate through runtimes, add gitlab job

* move job to publish

* temp force build-linux-release to run

* update check_extrinsics_ordering.sh

* maybe we have to fetch release

* use node docker image

* revert before opening pr: force bad extrinsic ordering

* revert commits to prepare for PR

* move job to build stage, use bin from test-linux-release

* remove FIXME

* fix PR nags
2020-11-16 14:41:57 +01:00
s3krit 032c68850d [CI] Docker image updates (#1799) 2020-10-19 15:44:14 +02:00
Denis Pisarev d089baf2d4 WIP: remove deprecated only/except clauses, build is now manual on PRs (#1769)
* change (CI): soon to be deprecated only changed to rules, build is now manual on PRs

* change (CI): add workflow to avoid doubled pipelines, remove second job

* debug (CI): unblock pipeline from waiting a manual action
2020-09-30 22:17:00 +02:00
ddorgan 0931d0aafa Add manual action to build PR binary (#1470)
* Allow manual action for building a PR binary

* Allow test-refs for PR manual build

* Test PR build in github actions

* Use steps in build

* Removing build via github actions
2020-08-27 10:45:06 +02:00
Cecile Tonglet 497772da18 Ignore checks for companion PRs (#1455) 2020-08-06 06:52:03 +02:00
s3krit 05675df4ed [CI] Publish draft release redux (#1493)
* Add publish-draft-release Github action
* Remove publish_draft_release.sh gitlab job
2020-07-30 14:02:51 +02:00
Benjamin Kampmann 1b8211dd4f CI Regression Test for determinism of our wasm runtimes (#1372)
* deterministic build check runtime

* fix yaml

* Apply suggestions from code review

Co-authored-by: s3krit <pugh@s3kr.it>

* Update cargo.lock

Co-authored-by: s3krit <pugh@s3kr.it>
2020-07-20 10:56:28 +02:00
gabriel klawitter 2316da0523 ci: fix subdirectory upload to s3 (#1398) 2020-07-14 16:38:49 +05:30
Robert Habermeier 42bd096413 I am dumb and can't spell (#1366)
* rename implementor's guide to implementer's guide

* fix typos in more places
2020-07-07 10:10:36 -04:00
Sergei Shulepov 90a1ba1e90 Fix glossary link (snowballed) (#1297)
* Add mdbook-linkcheck

* Convert todo to not a link

* Fix external glossary link

* Fix various broken links

* Mass replace: s/.html/.md/

* My sloppy attempt to add a gitlab CI check
2020-06-20 14:23:28 -04:00
Denis Pisarev 7fd36394b6 change (ci): remove CARGO_HOME caching as it's still broken (#1291) 2020-06-19 18:51:31 +02:00
s3krit c3ed40fbe6 [CI] Add criticality of release to release notes (#1259)
* Enforces presence of C-labels to designate the importance of a release
* Iterates over them on a release, takes the highest present and includes it in the release notes
* Lists the change(s) that caused the release to be that priority
2020-06-17 14:10:13 +02:00
Martin Pugh b5aecb8a3d update label names for check_labels job 2020-06-16 15:38:43 +02:00
Denis Pisarev a364c4880d CI images were moved (#1194)
* change (ci): ci images were moved

* change (ci): rename substrate-ci-linux
2020-06-10 09:29:56 +02:00
s3krit 9bbcc3d89f [CI] Fix release notification message, and add rustc version to release notes (#1191)
* Release announcements: s/kusama/polkadot/

* Additional debug info for gitlab publish script

* add rustc version check job

* fully comment out tag-checking

* s/podman/docker/g

* Switch to rust-builder image and install jq

* remove temporary TODOs
2020-06-09 11:12:34 +02:00
s3krit a184320503 [CI] Move check-labels to .post stage (#1114) 2020-05-20 12:26:10 +02:00
s3krit 5d58f7a43a [CI] Expose WASM binaries on publish (#1093)
* add build-wasm-release CI job

* temporarily run build-wasm-release everywhere

* temporary job to inspect artifacts dir

* fix test job

* fix test job again

* remove temporary job

* remove FIXME for when to run jobs

* remove pointless echo

* Change cargo build for wasm-pack

* Checksum polkadot_cli files

* make separate wasm dir for artifacts

* fix nits
2020-05-15 16:29:48 +02:00
Denis Pisarev 11cd00567a change (ci): fail test on warnings (#1102) 2020-05-15 16:29:11 +02:00
s3krit b2655b5220 [CI] add check_tags CI job (#1072)
* add check_tags CI job

* fix typo in gitlab-ci.yml

* add more useful CI output

* Make presence of github token optional
2020-05-08 17:31:23 +02:00
Shawn Tabrizi b15cfb736d Add runtime benchmarking suite to all runtimes (#1034)
* Add benchmarking suite to all runtimes

* Add `runtime-benchmarks` feature to `test-linux-stable`

* Update Cargo.lock

* Update Cargo.lock

* Update Cargo.lock

* "user" instead of "caller"

* undo these changes
2020-04-27 16:19:46 +02:00
gabriel klawitter 65c5a1b5ac ci: deploy: remove test branch (#975) 2020-04-06 11:48:02 +02:00
gabriel klawitter 189c542655 ci: kusama-nightly-staging: removal of substrate's polkadot-master branch (#962)
* ci: kusama-nightly-staging: remove builds for the branches and trigger deployment directly

* ci: kusama-nightly-staging: remove ii and fix
2020-04-03 20:48:49 +02:00
Shawn Tabrizi d52c3a45a7 Add CI check for runtme-benchmarks (#936) 2020-03-25 11:27:29 +01:00
Ashley fb442c9112 Update and fix wasm code again, add cli check to .gitlab-ci.yml (#917)
* Add cli to wasm tests, update and bring closer to the substrate browser code

* Remove ws.js

* Update cli/src/browser.rs

Co-Authored-By: Pierre Krieger <pierre.krieger1708@gmail.com>

* Update browser.rs

Co-authored-by: Gavin Wood <gavin@parity.io>
Co-authored-by: Pierre Krieger <pierre.krieger1708@gmail.com>
2020-03-21 16:13:59 +01:00
s3krit 73ab649437 CI: Move publish_draft_release job to test stage, and substrate changelog subsections (#908)
* Move publish_draft_release to test stage

Also remove the alert_pending_release job since it's no longer needed

* delete alert_pending_release.sh

* Add splitting substrate changes into subsections
2020-03-21 13:39:52 +01:00
gabriel klawitter b49bf9d5b0 ci: increase artifact retention period (#869)
* ci: increase artifact retention period
2020-03-05 14:12:00 +01:00
s3krit e4cc7c5812 Add publish_draft_release.sh (#752)
* Add publish_draft_release.sh

This new CI script will generate a list of differences between
this tagged version and the previous tagged version (including
substrate changes), and create a draft release on Github. Once
this is done, the draft release will be posted in Matrix (the
channel is determined by a Gitlab CI environment variable).

* Add highlighting gav for draft release
2020-01-10 20:29:42 +01:00
s3krit 2d5a1c953a allow release alerts to fail (#725) 2020-01-06 19:40:58 +01:00
Arkadiy Paronyan a00d74d825 Support both polkadot and kusama runtimes (#704)
* Allow both polkadot and kusama runtimes

* Allow both polkadot and kusama runtimes

* Make `collator` build

* Removed kusama runtime

* Introduced common runtime

* Updated for latest substrate

* Updated CI targets

* Updated CI version check

* Removed unused dependency

* Pulled latests substrate

* Pulled latest substrate

* Fixed version

* Apply suggestions from code review

Co-Authored-By: Bastian Köcher <bkchr@users.noreply.github.com>

* NEW_HEADS_IDENTIFIER moved to primitives

* Updated CI check script

* Fixed script

* Set epoch duration for polkadot

* ci: check_runtime for both runtimes

Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>
Co-authored-by: gabriel klawitter <gabreal@users.noreply.github.com>
2020-01-03 18:31:39 +00:00
gabriel klawitter 11b1bf230e ci: fix release tagging after tags are added on the master branch (#714)
* ci: fix release tagging after tags are added on the master branch

* ci: latest tag applied to latest tag
2020-01-03 18:30:53 +00:00
gabriel klawitter bb9c92204b ci: increase git cloning depth to 100 (#707) 2019-12-24 16:13:26 +01:00
s3krit 68132e3fd3 Add matrix release alert script and gitlab job (#688)
* Add matrix release alert script and gitlab job

* Update .gitlab-ci.yml

Co-Authored-By: Kirill Pimenov <kirill@parity.io>
2019-12-13 16:08:32 +01:00
Fedor Sakharov 99d164b5e7 Erasure encoding availability (#345)
* Erasure encoding availability initial commit

 * Modifications to availability store to keep chunks as well as
   reconstructed blocks and extrinsics.
 * Gossip messages containig signed erasure chunks.
 * Requesting eraure chunks with polkadot-specific messages.
 * Validation of erasure chunk messages.

* Apply suggestions from code review

Co-Authored-By: Luke Schoen <ltfschoen@users.noreply.github.com>

* Fix build after a merge

* Gossip erasure chunk messages under their own topic

* erasure_chunks should use the appropriate topic

* Updates Cargo.lock

* Fixes after merge

* Removes a couple of leftover pieces of code

* Fixes simple stuff from review

* Updates erasure and storage for more flexible logic

* Changes validation and candidate receipt production.

* Adds add_erasure_chunks method

* Fixes most of the nits

* Better validate_collation and validate_receipt functions

* Fixes the tests

* Apply suggestions from code review

Co-Authored-By: Robert Habermeier <rphmeier@gmail.com>

* Removes unwrap() calls

* Removes ErasureChunks primitive

* Removes redundant fields from ErasureChunk struct

* AvailabilityStore should store CandidateReceipt

* Changes the way chunk messages are imported and validated.

 * Availability store now stores a validator_index and n_validators for
 each relay_parent.
 * Availability store now also stores candidate receipts.
 * Removes importing chunks in the table and moves it into network
 gossip validation.
 * Validation of erasure messages id done against receipts that are
 stored in the availability store.

* Correctly compute topics for erasure messages

* Removes an unused parameter

* Refactors availability db querying into a helper

* Adds the apis described in the writeup

* Adds a runtime api to extract erasure roots form raw extrinsics.

* Adds a barebone BlockImport impl for avalability store

* Adds the implementation of the availability worker

* Fix build after the merge with master.

* Make availability store API async

* Bring back the default wasmtime feature

* Lines width

* Bump runtime version

* Formatting and dead code elimination

* some style nits (#1)

* More nits and api cleanup

* Disable wasm CI for availability-store

* Another nit

* Formatting
2019-12-03 15:49:07 +01:00
Denis Pisarev 675ca2e258 interruptible test and build jobs (#642) 2019-12-02 17:20:03 +01:00
Pierre Krieger ed7ee57290 Add WASM CI checks and make availability-store compile for WASM (#626)
* Make availability-store compile for WASM

* Use --manifest-path instead
2019-11-29 16:12:16 +01:00
gabriel klawitter 663ff3db91 ci: add runtime version check (#555) 2019-11-09 10:46:36 +01:00
Denis Pisarev 676f1562b9 retry on gitlab system failures (#521)
* retry on gitlab system failures

* max is just 2
2019-10-31 11:12:23 +01:00
gabriel klawitter 203cd74466 ci: fix publishing of ci builds (#488) 2019-10-22 11:44:05 +02:00
gabriel klawitter b890df6cde change versioning and tagging of releases (#476)
* change versioning and tagging of releases
2019-10-16 16:03:28 +02:00
gabriel klawitter dfa4e2128b update branch name in Cargo.lock (#473) 2019-10-10 17:37:34 +02:00
gabriel klawitter cccfdee49b ci: build-linux-release fix missing bracket (#434) 2019-09-12 14:48:39 +02:00
gabriel klawitter 524890c335 ci: build kusama-nightly-staging and trigger deployment (#430)
* trigger pipeline in github-api for polkasync

* update polkadot branch name for replacement

* deployment: update project
2019-09-12 14:12:25 +02:00