Commit Graph

263 Commits

Author SHA1 Message Date
Vlad b9a635941e Speed up rusty-cachier-notify job (#11841)
* Speed up `rusty-cachier-notify` job

* Don't forget to setup `rusty-cachier` first
2022-07-15 10:58:53 +03:00
Alexander Samusev 5a8e5bd97c [ci] fix job cancel-pipeline (#11844)
* [ci] fix cancel-pipeline job

* test fail

* remove debug
2022-07-15 09:42:40 +02:00
Vlad 7d8477b48d rusty-cachier pipeline impovements and fixes (#11572) 2022-06-01 19:48:53 +03:00
Vlad adf0773f9d Fix CI after rusty-cachier introduction (#11556)
* Fix CI after `rusty-cachier` introduction

* Replace anchor with `extends`
2022-05-31 19:07:49 +02:00
Vlad f0401c56ae Add rusty-cachier notify job (#11554)
* Add `rusty-cachier notify` job

* Add comments
2022-05-31 18:46:38 +02:00
Vlad c91c1c793e Introduce rusty-cachier (#11462)
* Introduce `rusty-cachier`

* Return LF at the end of file

* Use `entrypoint` to `unshare(1)` into a new mount namespace

* Use `rusty-cachier`-provided absolute path for `CARGO_TARGET_DIR` everywhere

* Debug single `build-rustdoc` job

* CI: debug

* CI: debug

* CI: debug

* `unshare(1)` is no longer needed

* CI: remove debug

* Revert "Debug single `build-rustdoc` job"

* Formatiing

* Update scripts/ci/gitlab/pipeline/build.yml

Co-authored-by: Denis Pisarev <denis.pisarev@parity.io>
2022-05-31 17:10:04 +02:00
Alexander Samusev ce77cb1735 [ci] Adjust job order in pipeline test stage with Gitlab DAG (#11442)
* [Do Not Merge] Test gitlab DAG in pipeline

* add jobs for pipeline cancel

* add check-tracing to cancel-pipeline
2022-05-18 13:14:25 +02:00
Alexander Samusev 52d9bf24cc [ci] Divide .gitlab-ci.yml into several files (#11333)
* rebase

* update Cargo.lock

* revert Cargo.lock

* fix Cargo.lock from 11384
2022-05-11 11:01:02 +02:00
Alexander Samusev 52c4871897 [ci] fix cargo-check-nixos for nightly pipeline (#11358) 2022-05-05 11:50:14 +02:00
João Paulo Silva de Souza 2dbdafb437 customize check-dependent-* for release engineering (#11311) 2022-05-04 16:45:23 +02:00
Squirrel 3ecb5306eb Updating shell.nix nightly (#11266)
* The 2022-02-10 nightly can't build some deps

There's a sig that returns `impl IntoIterator<Item = (&'static str, OsString)>` and an Option is being retured but it's incorrectly not allowing a `?` in the method.

* removing duplicate test

* [ci] add job cargo-check-nixos

* add dummy variables nix check

* fix check-dependent jobs

* fix check-dependent-project template

Co-authored-by: alvicsam <alvicsam@gmail.com>
2022-04-27 17:19:07 +00:00
João Paulo Silva de Souza d6a66fd831 use options for check_dependent_project (#11284)
Co-authored-by: TriplEight <denis.pisarev@parity.io>
2022-04-26 16:59:13 +02:00
Sergejs Kostjucenko 9cdde52cac Change ci vars to use group one's (#11281) 2022-04-26 12:28:18 +03:00
Bastian Köcher 914db49d04 cumulus-companion: Fix CI when there is no Polkadot companion (#11280)
This tries to fix the CI if there is no polkadot companion. Currently we don't update Polkadot
master in Cumulus, which means we may use some old commit that isn't compiling with the latest
Substrate master anymore. This can happen if there was a pr that had a companion in Polkadot, but no
companion was required for Cumulus. Then Cumulus will still point to some old Polkadot commit that
isn't compiling anymore with the latest Substrate commit. So, we need to tell the script to use the
latest master of Polkadot. If there is a companion for Polkadot, it would simply override the extra
dependency patch later on.
2022-04-25 17:07:09 +02:00
Alexander Samusev 8a49af27ad [ci] fix publish-docker-substrate job (#11218) 2022-04-13 14:22:25 +02:00
Bastian Köcher f517e57f67 Prepare for rust stable 1.60 (#11138)
* Prepare for rust stable 1.59

Besides preparing the UI tests this also adds a new script update-rust-stable.sh script for
simplifying the update of a rust stable version. This script will run all UI tests for the new
rust stable version and updating the expected output.

* Ensure we run the UI tests in CI

* use staging ci image

* More test updates

* Unignore test (#11097)

* empty commit for pipeline rerun

* empty commit for pipeline rerun

* Try to make clippy happy

* More clippy fixes

* FMT

* ci image production

Co-authored-by: alvicsam <alvicsam@gmail.com>
Co-authored-by: Alexander Samusev <41779041+alvicsam@users.noreply.github.com>
2022-04-11 11:21:54 +02:00
Alexander Samusev fc4bd3c4fd [ci] Remove vault (#11179)
* [ci] Remove vault

* remove anchors
2022-04-06 18:20:15 +02:00
Sergejs Kostjucenko 46891e849f Move scripts used in CI to the new location (#11008)
Move scripts used in CI to the new location - **./scripts/ci/**

* Move github scripts

* Move more files

* Move ci scripts and fix dependencies

* Update docs/node-template-release.md

Co-authored-by: João Paulo Silva de Souza <77391175+joao-paulo-parity@users.noreply.github.com>

* Remove Cargo.lock

* Apply suggestions from code review

Co-authored-by: Denis Pisarev <denis.pisarev@parity.io>

* Make more paths uniform

Co-authored-by: João Paulo Silva de Souza <77391175+joao-paulo-parity@users.noreply.github.com>
Co-authored-by: Denis Pisarev <denis.pisarev@parity.io>
2022-03-14 10:42:34 +02:00
Alexander Samusev 4519145df5 [ci] fix publish-rustdocs (#10858) 2022-02-15 13:29:26 +01:00
Alexander Samusev 514b920dd6 [ci] pipeline chores (#10734)
* [ci] pipeline chores
2022-01-26 18:03:37 +01:00
Jimmy Chu 8c6301a6e6 Changing the node package to be under @substrate namespace (#10722)
Signed-off-by: Jimmy Chu <jimmychu0807@gmail.com>
2022-01-24 12:11:26 +01:00
Jimmy Chu 39d5c357af Script for publishing rustdocs at gh-pages (#10604)
* wip

Signed-off-by: Jimmy Chu <jimmychu0807@gmail.com>

* Added the rustdocs-release script

Signed-off-by: Jimmy Chu <jimmychu0807@gmail.com>

* updated gitlab-ci script

Signed-off-by: Jimmy Chu <jimmychu0807@gmail.com>

* Updated to set NIGHTLY to false by default

Signed-off-by: Jimmy Chu <jimmychu0807@gmail.com>

* Added documentation

Signed-off-by: Jimmy Chu <jimmychu0807@gmail.com>
2022-01-21 18:32:45 +01:00
Guillaume Thiolliere 137628b4d7 Add feature: no-metadata-doc which removes doc from metadata and full-metadata which build metadata with all doc (#10493)
* add features to remove or add doc

* fmt

* add test for event/error/call

* fmt
2022-01-17 22:21:19 +01:00
Alexander Samusev 3a88215fca [ci] pipeline chores (#10624)
* [Do not merge] pipeline chores

* disable condition publish-rustdoc

* revert rules

* remove PIPELINE_SCRIPTS_TAG
2022-01-12 09:33:25 +01:00
Vladimir Istyufeev bdd7a44bec Remove the bench-test-full-crypto-feature GHA & GitLab jobs (#10628)
* Remove the `bench-test-full-crypto-feature` job

* Remove the relevant GHA job
2022-01-11 11:29:35 +01:00
Squirrel 3dd32d5255 Make clippy _a little_ more annoying (#10570)
* Clippy: +complexity

* Update client/cli/src/arg_enums.rs

Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>

* Update bin/node/inspect/src/lib.rs

Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>

* Update primitives/keystore/src/testing.rs

Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>

* Update frame/elections/src/lib.rs

Co-authored-by: Keith Yeung <kungfukeith11@gmail.com>

* Update primitives/npos-elections/fuzzer/src/reduce.rs

Co-authored-by: Keith Yeung <kungfukeith11@gmail.com>

* Incorporating feedback

* No need for Ok

* Additional

* Needed slice

* Wigy's suggestions on less derefs

* fix count

* reverting changes brought in by option_map_unit_fn

* add --all-targets

Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>
Co-authored-by: Keith Yeung <kungfukeith11@gmail.com>
2022-01-05 14:35:30 +00:00
João Paulo Silva de Souza 670d2b082f make check-dependent-* only be executed in PRs (#10545)
Make check-dependent-* jobs only be executed in PRs instead of both PRs and master.

Reason 1: The companion is not merged at the same time as the parent PR
([1](https://github.com/paritytech/parity-processbot/issues/347#issuecomment-994729950)), therefore
the pipeline will fail on master since the companion PR is not yet merged in the other repository.
This scenario is demonstrated by the pipeline of https://github.com/paritytech/substrate/commit/3d8ce67383bfc588d67772db5739fc55936908d2.

Reason 2: The job can still fail on master due to a new commit on the companion PR's repository which was merged after `bot merge` happened, as demonstrated by the following scheme:

1. Parent PR is merged
2. Companion PR is updated and set to merge in the future
3. In the meantime a new commit is merged into the companion PR repository's master branch
4. The `check-dependent-*` job runs on master but, due to the new commit, it fails for unrelated reasons

While "Reason 2" can be used as an argument against this PR, in that it would be useful to know if the integration is failing on master, "Reason 1" should be taken care of due to this inherent flaw of the current companion build system design.
2021-12-27 10:21:33 +01:00
Guillaume Thiolliere cf1eb73046 Deny warning when building doc (#10387)
* deny warning

* add new job

* fix doc

* fmt
2021-12-15 20:28:18 +01:00
Bastian Köcher bc0ecf8d40 Remove cargo unleash CI job (#10482)
* Remove cargo unleash CI job

The CI job is currently breaking, because we released some crates. We also don't need the job
currently because releases are not done. So, the job currently just annoys people and eats CPU time.
This brings us to the conclusion that this job is currently not required and can be readded at a
later point when we are sure that we need it.

* Hopefully fix UI test

* Another try

* Remove `reserved_keyword` ui
2021-12-14 23:44:04 +01:00
Bastian Köcher 04c5e3aa59 Remove simnet from CI (#10456) 2021-12-09 20:43:46 +01:00
Bastian Köcher 4e3f34822c Fix cumulus companion checks (#10412)
* Fix cumulus companion checks

* Add missing tag

* Fix

* Update .gitlab-ci.yml

Co-authored-by: Denis Pisarev <17856421+TriplEight@users.noreply.github.com>

Co-authored-by: Shawn Tabrizi <shawntabrizi@gmail.com>
Co-authored-by: Denis Pisarev <17856421+TriplEight@users.noreply.github.com>
2021-12-03 16:11:06 +01:00
Alexander Samusev 48b03c3732 [ci] Fix publish-rustdoc (#10364) 2021-11-24 16:00:03 +01:00
Vladimir Istyufeev bf1b93c9bd Introduce temporary GitLab & GHA benchmarking jobs (#10311)
* Introduce temporary bench job

* Add runner label

* CI: bench GHA

* CI: bench GHA

* CI: docs

* CI: more docs

* CI: run on master only

Co-authored-by: Denis P <denis.pisarev@parity.io>
2021-11-24 12:10:40 +01:00
Alexander Samusev e92a7402ef [ci] Fix publish-rustdoc job (#10363) 2021-11-24 10:42:44 +01:00
Alexander Samusev 67cd32f736 [ci] Add ssh token for publishing gh-pages (#10338)
* [ci] Added ssh token for publishing gh-pages

* changed ssh commands for gh-pages

* return github_token back to vault secrets

* check simnet-tests-quick without vault secrets

* remove vault secrets from simnet jobs
2021-11-23 17:04:06 +01:00
Benjamin Kampmann 2168a6d0c9 Intend to reactivate cargo-unleash check (#10167)
* Intend to reactivate cargo-unleash check

It appears the bug it was deactivated for has been resolved a while ago. Trying to reactivate the checks.

* adding missing cargo.toml metadata for BEEFY crates

* fix wrong version reference

* matching up versions

* disable faulty cache

* switching more versions to prerelease

* Revert "disable faulty cache"

This reverts commit 411a12ae444a9695a8bfea4458a868438d870b06.

* bump minor of sc-allocator to fix already-published-issue

* fixup another pre-released dependency problem

* temp switch to latest unleash

* fixing dependency version and features

* prometheus endpoint has also been changed

* fixing proposer metrics versioning

* fixing hex feature for beefy

* fix generate-bags feature selection

* fixup Cargo.lock

* upgrade prometheus dependencies

* missed one

* switch to latest release
2021-11-10 17:30:24 +01:00
Denis Pisarev 169f8caf7d CI: build docs with deps (#9884) 2021-11-10 11:39:30 +01:00
Jimmy Chu db59cfcf14 Move all example pallets under examples folder. (#10215)
* Put all examples under one folder

Signed-off-by: Jimmy Chu <jimmychu0807@gmail.com>

* Updated Cargo.toml

Signed-off-by: Jimmy Chu <jimmychu0807@gmail.com>

* updated for ci script

Signed-off-by: Jimmy Chu <jimmychu0807@gmail.com>

* update

Signed-off-by: Jimmy Chu <jimmychu0807@gmail.com>

* Added notes that example pallets are not meant to be used in production.

Signed-off-by: Jimmy Chu <jimmychu0807@gmail.com>

* updated

Signed-off-by: Jimmy Chu <jimmychu0807@gmail.com>
2021-11-10 08:11:28 +00:00
Dan Shields 9fb9d7b8f0 rm broken rustdoc-header.html (#10091) 2021-11-04 19:54:31 +01:00
Vladimir Istyufeev ad308386d8 Introduce linux-docker-benches (#10085)
* Introduce `linux-docker-benches`

* Add additional info to `node-bench-regression-guard` job's run
2021-10-22 21:54:12 +00:00
João Paulo Silva de Souza 6334692e9c remove logging from the check-dependent-* job (#10076)
such command should belong to the script rather than the job
2021-10-21 14:03:50 +01:00
Vladimir Istyufeev c8126908d4 Temporarily disable node-bench-regression-guard (#10075) 2021-10-21 12:44:46 +00:00
João Paulo Silva de Souza ff77872c9f remove hardcoded pipeline scripts tag (#10061)
the tag will be moved to Gitlab CI/CD variables
2021-10-19 19:05:05 +02:00
Alexander Samusev d7e07d4fb9 CI: remove node-template from build-linux-substrate-simnet job (#10034)
* ci: remove node-template from build-linux-substrate-simnet

* build-linux-substrate job impovements

* small fix
2021-10-18 09:12:22 +02:00
João Paulo Silva de Souza e5ca94527f use pipeline-scripts for dependent projects script (#9749) 2021-10-14 14:29:50 +02:00
Alexander Samusev 19a656e156 Add quick simnet tests to .gitlab-ci.yml (#9959)
* remove spaces

* add simnet quick test

* debug simnet test

* add jobs for quick simnet tests

* fix typo

* test simnet-quick

* remove debug

* fix ci

* change tag for simnet tests

* Add new line to readme
2021-10-11 15:46:31 +02:00
Squirrel c9410186f1 add clippy to CI (#9694)
* Focus on correctness lints. This relies on a compiler patch that landed 8th July 2021.
If people are using an earlier version of the compiler everything will still work unless they try and run clippy.

Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>
Co-authored-by: Denis Pisarev <denis.pisarev@parity.io>
2021-10-03 17:09:26 +01:00
Denis Pisarev 9d8875258e CI: undebug CI image (#9857)
* CI: undebug CI image

* Update .gitlab-ci.yml

Co-authored-by: Andronik Ordian <write@reusable.software>
2021-09-24 16:50:32 +02:00
Bastian Köcher 62187b5916 Prepare UI tests for rust 1.55 (#9637)
* Prepare UI tests for rust 1.54

* Delete wrong_page.stderr

* CI: run with a staging CI image

* Revert "CI: run with a staging CI image"

This reverts commit 66f5b00d14b50fd9d8fbf773f7e884f380697591.

* CI: debug, again

* LOG_TARGET is only used in std

* Remove unnecessary unsafe

* Fixes

* Use correct rustc locally

* FMT

* Compile with benchmarking

* Review feedback

* Some ui tests

* I know...

* Fix wasm tests

Co-authored-by: Denis P <denis.pisarev@parity.io>
Co-authored-by: thiolliere <gui.thiolliere@gmail.com>
2021-09-24 10:42:08 +00:00
Jimmy Chu de05155543 Fix gitlab command (#9843) 2021-09-24 07:34:37 +08:00