cb192d1071
Check for bundled forklift ( #4055 )
...
Added check if forklift already exists in ci image as forklift binary is
now bundled with the ci-unified.
This is a temporary check for the transition period
2024-04-09 23:49:39 +04:00
ebdca15c19
Convince GitLab not to crop collapsed multiline strings ( #3971 )
...
Use of `- >` instead of `- |` workarounds GitLab quirk when it crops
collapsed multiline `script:` section commands in its CI job logs.
This PR also fixes `- |` based `script:` steps to behave properly after
`- >` conversion.
Resolves https://github.com/paritytech/ci_cd/issues/972 .
2024-04-04 08:22:18 +00:00
25af0adf78
[ci] Collect subsystem-benchmarks results and add graphs for them ( #3853 )
...
PR adds CI jobs that collect subsystem-benchmarks results and publishes
them to gh-pages.
cc https://github.com/paritytech/ci_cd/issues/934
cc @AndreiEres
2024-03-27 11:50:03 +00:00
edd95b3749
Add forklift to remaining jobs ( #3236 )
...
Add [forklift
caching](https://gitlab.parity.io/parity/infrastructure/ci_cd/forklift/forklift )
to remainig jobs
by .sh and .py scripts:
- cargo-check-each-crate x6 (`.gitlab/check-each-crate.py`)
- build-linux-stable (`polkadot/scripts/build-only-wasm.sh`)
by before_script:
- build-linux-substrate
- build-subkey-linux (with `.build-subkey` job)
- cargo-check-benches x2
**To disable feature set FORKLIFT_BYPASS variable to true in [project
settings in
gitlab](https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/settings/ci_cd )**
(forklift now handles FORKLIFT_BYPASS by itself)
2024-02-09 12:40:19 +00:00
e757f81110
Use external reference for the CI image as before ( #3153 )
...
Usual chore after bumping Rust toolchain version.
2024-01-31 14:03:19 +04:00
5b7f24fca1
[ci] Update rust in ci image (1.75 and 2024-01-22) ( #3016 )
...
cc https://github.com/paritytech/ci_cd/issues/926
---------
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
Co-authored-by: command-bot <>
Co-authored-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
Co-authored-by: Bastian Köcher <git@kchr.de >
Co-authored-by: Liam Aharon <liam.aharon@hotmail.com >
Co-authored-by: Dónal Murray <donal.murray@parity.io >
Co-authored-by: Vladimir Istyufeev <vladimir@parity.io >
2024-01-30 23:17:44 +00:00
c415f8f0bd
Remove forklift clean call from CI ( #3125 )
...
In CI jobs I see calls to `forklift clean`, which apparently does not
exist.
From CI logs:
```
1m$ forklift clean[0;m
Cargo cache management utility
Usage:
forklift [command]
Available Commands:
completion Generate the autocompletion script for the specified shell
help Help about any command
serve Run forklift coordinator server for current location
start Start detached forklift coordinator server for current location
stop Stop forklift coordinator server for current location
Flags:
-c, --compression string Compression algorithm to use
Available: none, xz (default "zstd")
-h, --help help for forklift
-p, --param stringToString map of additional parameters
ex: -p S3_BUCKET_NAME=my_bucket (default [])
-s, --storage string Storage driver
Available: s3, fs (default "s3")
-v, --verbose string Available: panic, fatal, error, warn, warning, info, debug, trace (default "info")
--version version for forklift
Use "forklift [command] --help" for more information about a command.
```
2024-01-30 09:50:53 +00:00
2bdf5dca67
[ci] Remove unused jobs ( #2502 )
...
<del>PR custom review is deprecated. Now `review-bot` performs these
functions.</del>
PR removes unused ci jobs and adjusts zombienet jobs for merge queues
cc @Bullrich
2024-01-11 11:30:17 +00:00
69e2ae6df0
[ci] Revert reference to ci image ( #2890 )
2024-01-09 16:01:26 +01:00
06fa111f58
Contracts: Bump polkavm ( #2884 )
...
bump polkavm-x deps to 0.4.0
2024-01-09 12:43:53 +01:00
8f6b6322c2
[ci] Return CI_IMAGE variable ( #2647 )
...
close https://github.com/paritytech/ci_cd/issues/900
2023-12-07 13:19:07 +02:00
cd63276d31
[ci] Update rust to 1.74 ( #2545 )
...
cc https://github.com/paritytech/ci_cd/issues/900
---------
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
Co-authored-by: Dónal Murray <donal.murray@parity.io >
Co-authored-by: Bastian Köcher <info@kchr.de >
Co-authored-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
Co-authored-by: command-bot <>
2023-12-07 09:57:43 +01:00
e6b9da132d
Cargo caching with forklift ( #2466 )
...
This PR adds cargo caching feature with custom ['forklift'
tool](https://gitlab.parity.io/parity/infrastructure/ci_cd/forklift/forklift )
Forklift acts as RUSTC_WRAPPER, intercepts rustc calls and stores
produced artifacts in S3 bucket (see [forklift
readme](https://gitlab.parity.io/parity/infrastructure/ci_cd/forklift/forklift/-/blob/main/README.MD?ref_type=heads )
for detailed description)
All settings are made in [`.forklift` job's
before_script](https://github.com/paritytech/polkadot-sdk/blob/es/forklift-test/.gitlab-ci.yml#L119 )
and affect all jobs that extend `.docker-env` job
To disable feature set `FORKLIFT_BYPASS` variable to true in [project
settings in
gitlab](https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/settings/ci_cd )
2023-12-04 20:07:22 +04:00
fd1ed403c9
Remove the timestamp handler ( #2506 )
2023-11-27 15:50:38 +02:00
a9ba1e540f
Revert docker images tag naming to <prnum-shortsha> ( #2434 )
...
Docker images from paritypr are also used in testnets. PR reverts docker
tags naming to a more convenient.
cc @PierreBesson
2023-11-22 10:29:56 +01:00
126f64a91e
bump zombienet version v1.3.82 ( #2396 )
...
Includes:
- bump `pjs` modules versions
- re-enable test disable in
https://github.com/paritytech/polkadot-sdk/pull/2294
---------
Co-authored-by: Bastian Köcher <info@kchr.de >
2023-11-21 11:38:04 +01:00
20723ea80e
bump zombienet version v1.3.80 ( #2376 )
...
New release includes logic to move all jobs to `spot instances`.
Thx!
2023-11-17 08:21:42 -03:00
5b0622bc4d
[CI] Prepare CI for Merge Queues ( #2308 )
...
PR prepares CI to the GitHub Merge Queues. All github actions that were
running in PR adjusted so they can run in the merge queues. Zombienet
jobs will do nothing during PRs but they will run during merge queues.
Jobs that will be skipped during PR:
- all zombienet jobs
- all publish docker jobs
Jobs that will be skipped during merge queue:
- check-labels
- check-prdoc
- pr-custom-review
- review trigger
cc https://github.com/paritytech/ci_cd/issues/862
2023-11-15 14:28:32 +01:00
8ba7a6aba8
chain-spec: getting ready for native-runtime-free world (#1256 )
...
This PR prepares chains specs for _native-runtime-free_ world.
This PR has following changes:
- `substrate`:
- adds support for:
- JSON based `GenesisConfig` to `ChainSpec` allowing interaction with
runtime `GenesisBuilder` API.
- interacting with arbitrary runtime wasm blob to[
`chain-spec-builder`](https://github.com/paritytech/substrate/blob/3ef576eaeb3f42610e85daecc464961cf1295570/bin/utils/chain-spec-builder/src/lib.rs#L46 )
command line util,
- removes
[`code`](https://github.com/paritytech/substrate/blob/3ef576eaeb3f42610e85daecc464961cf1295570/frame/system/src/lib.rs#L660 )
from `system_pallet`
- adds `code` to the `ChainSpec`
- deprecates
[`ChainSpec::from_genesis`](https://github.com/paritytech/substrate/blob/3ef576eaeb3f42610e85daecc464961cf1295570/client/chain-spec/src/chain_spec.rs#L263 ),
but also changes the signature of this method extending it with `code`
argument.
[`ChainSpec::builder()`](https://github.com/paritytech/substrate/blob/20bee680ed098be7239cf7a6b804cd4de267983e/client/chain-spec/src/chain_spec.rs#L507 )
should be used instead.
- `polkadot`:
- all references to `RuntimeGenesisConfig` in `node/service` are
removed,
- all
`(kusama|polkadot|versi|rococo|wococo)_(staging|dev)_genesis_config`
functions now return the JSON patch for default runtime `GenesisConfig`,
- `ChainSpecBuilder` is used, `ChainSpec::from_genesis` is removed,
- `cumulus`:
- `ChainSpecBuilder` is used, `ChainSpec::from_genesis` is removed,
- _JSON_ patch configuration used instead of `RuntimeGenesisConfig
struct` in all chain specs.
---------
Co-authored-by: command-bot <>
Co-authored-by: Javier Viola <javier@parity.io >
Co-authored-by: Davide Galassi <davxy@datawok.net >
Co-authored-by: Francisco Aguirre <franciscoaguirreperez@gmail.com >
Co-authored-by: Kevin Krone <kevin@parity.io >
Co-authored-by: Bastian Köcher <git@kchr.de >
2023-11-05 15:19:23 +01:00
8507f45cef
[ci] Revert CI_IMAGE variable ( #2120 )
...
CI image has been updated in the shared snippet, reverting the variable
back.
2023-11-01 16:06:25 +01:00
f50054cffb
[ci] Update rust nightly in ci image ( #2115 )
...
Run CI using new image with nightly 2023-11-01
cc https://github.com/paritytech/polkadot-sdk/issues/2113
cc https://github.com/paritytech/ci_cd/issues/896
2023-11-01 14:37:09 +01:00
ada1ac3dcd
[DNM] bump zombienet version ( #2083 )
...
This version includes:
- Move `spot` usage in CI to 50%
- Fix `PodMonitor`, metrics will be relayed to grafana
2023-10-31 13:33:01 -03:00
3706a75f37
bump zombienet version ( #1931 )
...
Includes:
- PoC for new `spot instance` infra for jobs.
- Fixes in test-runner/cli
2023-10-19 08:22:40 -03:00
b5aee6e23f
ci: set CI_IMAGE back to (now updated) .ci-unified ( #1854 )
2023-10-11 21:20:46 +02:00
447e753323
ci: bump ci image to rust 1.73.0 ( #1830 )
...
Co-authored-by: command-bot <>
2023-10-11 19:49:59 +02:00
5a6912606a
chore: bump zombienter version ( #1806 )
...
Bump zombiente version. This version includes the fixes needed for
`mixnet`.
Thx!
2023-10-07 18:14:21 +02:00
93bb4926b3
bump zombienet version ( #1655 )
...
Includes:
- fix for https://github.com/paritytech/zombienet/issues/1360 (root
cause of https://github.com/paritytech/polkadot-sdk/issues/1647 )
- Improve default concurrency to spawn nodes.
Also, fix `var` name in CI file.
cc @skunert
2023-09-21 12:20:22 -03:00
f204e3264f
Oleg/ci cd/add new tag ( #1427 )
...
Update CI tag for docker vm runners
---------
Co-authored-by: alvicsam <alvicsam@gmail.com >
2023-09-12 19:44:47 +01:00
a414ea7515
[ci] Move additional tests back to test-linux-stable ( #1466 )
...
* [ci] Move additional tests back to test-linux-stable
* run slow tests with all tests
* check if test upgrade_version_checks_should_work works
* rm comment
2023-09-11 13:44:42 +02:00
09503b1d2d
[ci] Return publish-rustdoc ( #1402 )
...
* [WIP][ci] Return publish-rustdoc
* rm files
* fix ref
* add build doc
* add comment
* move test-deterministic-wasm to test stage
* rm test-deterministic-wasm from root
* test publish
* enable pipeline
* add test_deterministic_wasm.sh for resolving conflicts
* rm unused bash script
2023-09-07 13:39:53 +03:00
a47943983f
zombienet: use another collator image for the slashing test ( #1386 )
...
* zombienet: use test-parachain image for the slashing test
* use the right image
* try polkadot-parachain image
* try naming collator alice 🙈
* add needed job for the pipeline
* fix user id in polkadot-parachain-debug image
* small tweaks to the test
* another small tweak
* yet another small tweak
* bump zombienet version
---------
Co-authored-by: Javier Viola <javier@parity.io >
2023-09-06 20:39:42 +02:00
aabed6757e
[ci] add more jobs for pipeline cancel, cleanup ( #1314 )
2023-08-31 12:36:38 +03:00
d81c8cbaa7
[ci] Fix buildah and reorder test-doc dag ( #1275 )
2023-08-30 09:37:13 +02:00
3f0d28c836
bump zombienet to latest version ( #1231 )
...
* bump zombienet to latest version
* add env var
* fix upgrade node text, env var for downloading artifacts
2023-08-29 16:25:04 +02:00
b13a3187f2
[ci] Add DAG ( #1244 )
...
* [ci] Add DAG
* add dag
* add more dag and disable deny
* test cancel pipeline
* fix clippy
2023-08-29 17:00:17 +03:00
6e394f84f8
[ci] Add missing components to CI ( #1201 )
...
* [ci] Add missing components to CI
* add timestamp
* add pipeline-stopper-artifacts to jobs
* break clippy
* mv definition
* fix clippy
* comment timestamp, rm verbose
* commen cancel
* rm --verbose from build jobs
* disable rusty-cachier before_script
* enable timestamp back
* rollback .gitignore
* rollback .gitignore
* rollback .gitignore
2023-08-28 21:33:16 +03:00
e49493442a
Add CI for monorepo ( #1145 )
...
* Add CI for monorepo
* fix frame tests
* Format features
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* add note for skipping tests and disable test-linux-stable-all
* Fix tests and compile issues (#1152 )
* Fix feature dependant import
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* Bump test timeout
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* Remove feature gate
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* Add resolver 2
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* Remove old lockfile
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* Format features
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
---------
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* Fix check-dependency-rules
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* rm test-runtime
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* Actually fix script
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
* enable cargo-check-each-crate-macos
* Run check-each-crate on 6 machines (#1163 )
---------
Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
Co-authored-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io >
2023-08-25 16:35:22 +02:00
Evgeny Snitko