mirror of
https://github.com/pezkuwichain/pezkuwi-subxt.git
synced 2026-04-26 20:27:58 +00:00
29c0c6a4a8
* Add tokio * No need to map CallError to CallError * jsonrpsee proc macros (#9673) * port error types to `JsonRpseeError` * migrate chain module to proc macro api * make it compile with proc macros * update branch * update branch * update to jsonrpsee master * port system rpc * port state rpc * port childstate & offchain * frame system rpc * frame transaction payment * bring back CORS hack to work with polkadot UI * port babe rpc * port manual seal rpc * port frame mmr rpc * port frame contracts rpc * port finality grandpa rpc * port sync state rpc * resolve a few TODO + no jsonrpc deps * Update bin/node/rpc-client/src/main.rs * Update bin/node/rpc-client/src/main.rs * Update bin/node/rpc-client/src/main.rs * Update bin/node/rpc-client/src/main.rs * Port over system_ rpc tests * Make it compile * Use prost 0.8 * Use prost 0.8 * Make it compile * Ignore more failing tests * Comment out WIP tests * fix nit in frame system api * Update lockfile * No more juggling tokio versions * No more wait_for_stop ? * Remove browser-testing * Arguments must be arrays * Use same argument names * Resolve todo: no wait_for_stop for WS server Add todo: is parse_rpc_result used? Cleanup imports * fmt * log * One test passes * update jsonrpsee * update jsonrpsee * cleanup rpc-servers crate * jsonrpsee: add host and origin filtering (#9787) * add access control in the jsonrpsee servers * use master * fix nits * rpc runtime_version safe * fix nits * fix grumbles * remove unused files * resolve some todos * jsonrpsee more cleanup (#9803) * more cleanup * resolve TODOs * fix some unwraps * remove type hints * update jsonrpsee * downgrade zeroize * pin jsonrpsee rev * remove unwrap nit * Comment out more tests that aren't ported * Comment out more tests * Fix tests after merge * Subscription test * Invalid nonce test * Pending exts * WIP removeExtrinsic test * Test remove_extrinsic * Make state test: should_return_storage work * Uncomment/fix the other non-subscription related state tests * test: author_insertKey * test: author_rotateKeys * Get rest of state tests passing * asyncify a little more * Add todo to note #msg change * Crashing test for has_session_keys * Fix error conversion to avoid stack overflows Port author_hasSessionKeys test fmt * test author_hasKey * Add two missing tests Add a check on the return type Add todos for James's concerns * RPC tests for state, author and system (#9859) * Fix test runner * Impl Default for SubscriptionTaskExecutor * Keep the minimul amount of code needed to compile tests * Re-instate `RpcSession` (for now) * cleanup * Port over RPC tests * Add tokio * No need to map CallError to CallError * Port over system_ rpc tests * Make it compile * Use prost 0.8 * Use prost 0.8 * Make it compile * Ignore more failing tests * Comment out WIP tests * Update lockfile * No more juggling tokio versions * No more wait_for_stop ? * Remove browser-testing * Arguments must be arrays * Use same argument names * Resolve todo: no wait_for_stop for WS server Add todo: is parse_rpc_result used? Cleanup imports * fmt * log * One test passes * Comment out more tests that aren't ported * Comment out more tests * Fix tests after merge * Subscription test * Invalid nonce test * Pending exts * WIP removeExtrinsic test * Test remove_extrinsic * Make state test: should_return_storage work * Uncomment/fix the other non-subscription related state tests * test: author_insertKey * test: author_rotateKeys * Get rest of state tests passing * asyncify a little more * Add todo to note #msg change * Crashing test for has_session_keys * Fix error conversion to avoid stack overflows Port author_hasSessionKeys test fmt * test author_hasKey * Add two missing tests Add a check on the return type Add todos for James's concerns * offchain rpc tests * Address todos * fmt Co-authored-by: James Wilson <james@jsdw.me> * fix drop in state test * update jsonrpsee * fix ignored system test * fix chain tests * remove some boiler plate * Port BEEFY RPC (#9883) * Merge master * Port beefy RPC (ty @niklas!) * trivial changes left over from merge * Remove unused code * Update jsonrpsee * fix build * make tests compile again * beefy update jsonrpsee * fix: respect rpc methods policy * update cargo.lock * update jsonrpsee * update jsonrpsee * downgrade error logs * update jsonrpsee * Fix typo * remove unused file * Better name * Port Babe RPC tests * Put docs back * Resolve todo * Port tests for System RPCs * Resolve todo * fix build * Updated jsonrpsee to current master * fix: port finality grandpa rpc tests * Move .into() outside of the match * more review grumbles * jsonrpsee: add `rpc handlers` back (#10245) * add back RpcHandlers * cargo fmt * fix docs * fix grumble: remove needless alloc * resolve TODO * fmt * Fix typo * grumble: Use constants based on BASE_ERROR * grumble: DRY whitelisted listening addresses grumble: s/JSONRPC/JSON-RPC/ * cleanup * grumbles: Making readers aware of the possibility of gaps * review grumbles * grumbles * remove notes from niklasad1 * Update `jsonrpsee` * fix: jsonrpsee features * jsonrpsee: fallback to random port in case the specified port failed (#10304) * jsonrpsee: fallback to random port * better comment * Update client/rpc-servers/src/lib.rs Co-authored-by: Maciej Hirsz <1096222+maciejhirsz@users.noreply.github.com> * Update client/rpc-servers/src/lib.rs Co-authored-by: Maciej Hirsz <1096222+maciejhirsz@users.noreply.github.com> * address grumbles * cargo fmt * addrs already slice Co-authored-by: Maciej Hirsz <1096222+maciejhirsz@users.noreply.github.com> * Update jsonrpsee to 092081a0a2b8904c6ebd2cd99e16c7bc13ffc3ae * lockfile * update jsonrpsee * fix warning * Don't fetch jsonrpsee from crates * make tests compile again * fix rpc tests * remove unused deps * update tokio * fix rpc tests again * fix: test runner `HttpServerBuilder::builder` fails unless it's called within tokio runtime * cargo fmt * grumbles: fix subscription aliases * make clippy happy * update remaining subscriptions alias * cleanup * cleanup * fix chain subscription: less boiler plate (#10285) * fix chain subscription: less boiler plate * fix bad merge * cargo fmt * Switch to jsonrpsee 0.5 * fix build * add missing features * fix nit: remove needless Box::pin * Integrate jsonrpsee metrics (#10395) * draft metrics impl * Use latest api * Add missing file * Http server metrics * cleanup * bump jsonrpsee * Remove `ServerMetrics` and use a single middleware for both connection counting (aka sessions) and call metrics. * fix build * remove needless Arc::clone * Update to jsonrpsee 0.6 * lolz * fix metrics * Revert "lolz" This reverts commit eed6c6a56e78d8e307b4950f4c52a1c3a2322ba1. * fix: in-memory rpc support subscriptions * commit Cargo.lock * Update tests to 0.7 * fix TODOs * ws server: generate subscriptionIDs as Strings Some libraries seems to expect the subscription IDs to be Strings, let's not break this in this PR. * Increase timeout * Port over tests * cleanup * Using error codes from the spec * fix clippy * cargo fmt * update jsonrpsee * fix nits * fix: rpc_query * enable custom subid gen through spawn_tasks * remove unsed deps * unify tokio deps * Revert "enable custom subid gen through spawn_tasks" This reverts commit 5c5eb70328fe39d154fdb55c56e637b4548cf470. * fix bad merge of `test-utils` * fix more nits * downgrade wasm-instrument to 0.1.0 * [jsonrpsee]: enable custom RPC subscription ID generatation (#10731) * enable custom subid gen through spawn_tasks * fix nits * Update client/service/src/builder.rs Co-authored-by: David <dvdplm@gmail.com> * add Poc; needs jsonrpsee pr * update jsonrpsee * add re-exports * add docs Co-authored-by: David <dvdplm@gmail.com> * cargo fmt * fmt * port RPC-API dev * Remove unused file * fix nit: remove async trait * fix doc links * fix merge nit: remove jsonrpc deps * kill namespace on rpc apis * companion for jsonrpsee v0.10 (#11158) * companion for jsonrpsee v0.10 * update versions v0.10.0 * add some fixes * spelling * fix spaces Co-authored-by: Niklas Adolfsson <niklasadolfsson1@gmail.com> * send error before subs are closed * fix unsubscribe method names: chain * fix tests * jsonrpc server: print binded local address * grumbles: kill SubscriptionTaskExecutor * Update client/sync-state-rpc/src/lib.rs Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com> * Update client/rpc/src/chain/chain_full.rs Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com> * Update client/rpc/src/chain/chain_full.rs Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com> * sync-state-rpc: kill anyhow * no more anyhow * remove todo * jsonrpsee: fix bad params in subscriptions. (#11251) * update jsonrpsee * fix error responses * revert error codes * dont do weird stuff in drop impl * rpc servers: remove needless clone * Remove silly constants * chore: update jsonrpsee v0.12 * commit Cargo.lock * deps: downgrade git2 * feat: CLI flag max subscriptions per connection * metrics: use old logging format * fix: read WS address from substrate output (#11379) Co-authored-by: Niklas Adolfsson <niklasadolfsson1@gmail.com> Co-authored-by: James Wilson <james@jsdw.me> Co-authored-by: Maciej Hirsz <hello@maciej.codes> Co-authored-by: Maciej Hirsz <1096222+maciejhirsz@users.noreply.github.com> Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>
175 lines
5.1 KiB
Rust
175 lines
5.1 KiB
Rust
// This file is part of Substrate.
|
|
|
|
// Copyright (C) 2020-2022 Parity Technologies (UK) Ltd.
|
|
// SPDX-License-Identifier: GPL-3.0-or-later WITH Classpath-exception-2.0
|
|
|
|
// This program is free software: you can redistribute it and/or modify
|
|
// it under the terms of the GNU General Public License as published by
|
|
// the Free Software Foundation, either version 3 of the License, or
|
|
// (at your option) any later version.
|
|
|
|
// This program is distributed in the hope that it will be useful,
|
|
// but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
// MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
|
|
// GNU General Public License for more details.
|
|
|
|
// You should have received a copy of the GNU General Public License
|
|
// along with this program. If not, see <https://www.gnu.org/licenses/>.
|
|
|
|
#![cfg(unix)]
|
|
|
|
use assert_cmd::cargo::cargo_bin;
|
|
use nix::{
|
|
sys::signal::{kill, Signal::SIGINT},
|
|
unistd::Pid,
|
|
};
|
|
use node_primitives::Block;
|
|
use remote_externalities::rpc_api;
|
|
use std::{
|
|
io::{BufRead, BufReader, Read},
|
|
ops::{Deref, DerefMut},
|
|
path::Path,
|
|
process::{self, Child, Command, ExitStatus},
|
|
time::Duration,
|
|
};
|
|
use tokio::time::timeout;
|
|
|
|
/// Wait for the given `child` the given number of `secs`.
|
|
///
|
|
/// Returns the `Some(exit status)` or `None` if the process did not finish in the given time.
|
|
pub fn wait_for(child: &mut Child, secs: u64) -> Result<ExitStatus, ()> {
|
|
let result = wait_timeout::ChildExt::wait_timeout(child, Duration::from_secs(5.min(secs)))
|
|
.map_err(|_| ())?;
|
|
if let Some(exit_status) = result {
|
|
Ok(exit_status)
|
|
} else {
|
|
if secs > 5 {
|
|
eprintln!("Child process taking over 5 seconds to exit gracefully");
|
|
let result = wait_timeout::ChildExt::wait_timeout(child, Duration::from_secs(secs - 5))
|
|
.map_err(|_| ())?;
|
|
if let Some(exit_status) = result {
|
|
return Ok(exit_status)
|
|
}
|
|
}
|
|
eprintln!("Took too long to exit (> {} seconds). Killing...", secs);
|
|
let _ = child.kill();
|
|
child.wait().unwrap();
|
|
Err(())
|
|
}
|
|
}
|
|
|
|
/// Wait for at least n blocks to be finalized within a specified time.
|
|
pub async fn wait_n_finalized_blocks(
|
|
n: usize,
|
|
timeout_secs: u64,
|
|
url: &str,
|
|
) -> Result<(), tokio::time::error::Elapsed> {
|
|
timeout(Duration::from_secs(timeout_secs), wait_n_finalized_blocks_from(n, url)).await
|
|
}
|
|
|
|
/// Wait for at least n blocks to be finalized from a specified node
|
|
pub async fn wait_n_finalized_blocks_from(n: usize, url: &str) {
|
|
let mut built_blocks = std::collections::HashSet::new();
|
|
let mut interval = tokio::time::interval(Duration::from_secs(2));
|
|
|
|
loop {
|
|
if let Ok(block) = rpc_api::get_finalized_head::<Block, _>(url.to_string()).await {
|
|
built_blocks.insert(block);
|
|
if built_blocks.len() > n {
|
|
break
|
|
}
|
|
};
|
|
interval.tick().await;
|
|
}
|
|
}
|
|
|
|
/// Run the node for a while (3 blocks)
|
|
pub async fn run_node_for_a_while(base_path: &Path, args: &[&str]) {
|
|
let mut cmd = Command::new(cargo_bin("substrate"))
|
|
.stdout(process::Stdio::piped())
|
|
.stderr(process::Stdio::piped())
|
|
.args(args)
|
|
.arg("-d")
|
|
.arg(base_path)
|
|
.spawn()
|
|
.unwrap();
|
|
|
|
let stderr = cmd.stderr.take().unwrap();
|
|
|
|
let mut child = KillChildOnDrop(cmd);
|
|
|
|
let (ws_url, _) = find_ws_url_from_output(stderr);
|
|
|
|
// Let it produce some blocks.
|
|
let _ = wait_n_finalized_blocks(3, 30, &ws_url).await;
|
|
|
|
assert!(child.try_wait().unwrap().is_none(), "the process should still be running");
|
|
|
|
// Stop the process
|
|
kill(Pid::from_raw(child.id().try_into().unwrap()), SIGINT).unwrap();
|
|
assert!(wait_for(&mut child, 40).map(|x| x.success()).unwrap());
|
|
}
|
|
|
|
/// Run the node asserting that it fails with an error
|
|
pub fn run_node_assert_fail(base_path: &Path, args: &[&str]) {
|
|
let mut cmd = Command::new(cargo_bin("substrate"));
|
|
|
|
let mut child = KillChildOnDrop(cmd.args(args).arg("-d").arg(base_path).spawn().unwrap());
|
|
|
|
// Let it produce some blocks, but it should die within 10 seconds.
|
|
assert_ne!(
|
|
wait_timeout::ChildExt::wait_timeout(&mut *child, Duration::from_secs(10)).unwrap(),
|
|
None,
|
|
"the process should not be running anymore"
|
|
);
|
|
}
|
|
|
|
pub struct KillChildOnDrop(pub Child);
|
|
|
|
impl Drop for KillChildOnDrop {
|
|
fn drop(&mut self) {
|
|
let _ = self.0.kill();
|
|
}
|
|
}
|
|
|
|
impl Deref for KillChildOnDrop {
|
|
type Target = Child;
|
|
|
|
fn deref(&self) -> &Self::Target {
|
|
&self.0
|
|
}
|
|
}
|
|
|
|
impl DerefMut for KillChildOnDrop {
|
|
fn deref_mut(&mut self) -> &mut Self::Target {
|
|
&mut self.0
|
|
}
|
|
}
|
|
|
|
/// Read the WS address from the output.
|
|
///
|
|
/// This is hack to get the actual binded sockaddr because
|
|
/// substrate assigns a random port if the specified port was already binded.
|
|
pub fn find_ws_url_from_output(read: impl Read + Send) -> (String, String) {
|
|
let mut data = String::new();
|
|
|
|
let ws_url = BufReader::new(read)
|
|
.lines()
|
|
.find_map(|line| {
|
|
let line =
|
|
line.expect("failed to obtain next line from stdout for WS address discovery");
|
|
data.push_str(&line);
|
|
|
|
// does the line contain our port (we expect this specific output from substrate).
|
|
let sock_addr = match line.split_once("Running JSON-RPC WS server: addr=") {
|
|
None => return None,
|
|
Some((_, after)) => after.split_once(",").unwrap().0,
|
|
};
|
|
|
|
Some(format!("ws://{}", sock_addr))
|
|
})
|
|
.expect("We should get a WebSocket address");
|
|
|
|
(ws_url, data)
|
|
}
|