mirror of
https://github.com/pezkuwichain/pezkuwi-subxt.git
synced 2026-05-30 03:31:05 +00:00
bae12f41b8
* Bump structopt from 0.3.23 to 0.3.25 Bumps [structopt](https://github.com/TeXitoi/structopt) from 0.3.23 to 0.3.25. - [Release notes](https://github.com/TeXitoi/structopt/releases) - [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md) - [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.23...v0.3.25) --- updated-dependencies: - dependency-name: structopt dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * cargo fmt Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Keith Yeung <kungfukeith11@gmail.com>
2074 lines
74 KiB
Rust
2074 lines
74 KiB
Rust
// This file is part of Substrate.
|
|
|
|
// Copyright (C) 2021 Parity Technologies (UK) Ltd.
|
|
// SPDX-License-Identifier: Apache-2.0
|
|
|
|
// Licensed under the Apache License, Version 2.0 (the "License");
|
|
// you may not use this file except in compliance with the License.
|
|
// You may obtain a copy of the License at
|
|
//
|
|
// http://www.apache.org/licenses/LICENSE-2.0
|
|
//
|
|
// Unless required by applicable law or agreed to in writing, software
|
|
// distributed under the License is distributed on an "AS IS" BASIS,
|
|
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
// See the License for the specific language governing permissions and
|
|
// limitations under the License.
|
|
|
|
//! # Multi phase, offchain election provider pallet.
|
|
//!
|
|
//! Currently, this election-provider has two distinct phases (see [`Phase`]), **signed** and
|
|
//! **unsigned**.
|
|
//!
|
|
//! ## Phases
|
|
//!
|
|
//! The timeline of pallet is as follows. At each block,
|
|
//! [`frame_election_provider_support::ElectionDataProvider::next_election_prediction`] is used to
|
|
//! estimate the time remaining to the next call to
|
|
//! [`frame_election_provider_support::ElectionProvider::elect`]. Based on this, a phase is chosen.
|
|
//! The timeline is as follows.
|
|
//!
|
|
//! ```ignore
|
|
//! elect()
|
|
//! + <--T::SignedPhase--> + <--T::UnsignedPhase--> +
|
|
//! +-------------------------------------------------------------------+
|
|
//! Phase::Off + Phase::Signed + Phase::Unsigned +
|
|
//! ```
|
|
//!
|
|
//! Note that the unsigned phase starts [`pallet::Config::UnsignedPhase`] blocks before the
|
|
//! `next_election_prediction`, but only ends when a call to [`ElectionProvider::elect`] happens. If
|
|
//! no `elect` happens, the signed phase is extended.
|
|
//!
|
|
//! > Given this, it is rather important for the user of this pallet to ensure it always terminates
|
|
//! election via `elect` before requesting a new one.
|
|
//!
|
|
//! Each of the phases can be disabled by essentially setting their length to zero. If both phases
|
|
//! have length zero, then the pallet essentially runs only the fallback strategy, denoted by
|
|
//! [`Config::Fallback`].
|
|
//!
|
|
//! ### Signed Phase
|
|
//!
|
|
//! In the signed phase, solutions (of type [`RawSolution`]) are submitted and queued on chain. A
|
|
//! deposit is reserved, based on the size of the solution, for the cost of keeping this solution
|
|
//! on-chain for a number of blocks, and the potential weight of the solution upon being checked. A
|
|
//! maximum of `pallet::Config::MaxSignedSubmissions` solutions are stored. The queue is always
|
|
//! sorted based on score (worse to best).
|
|
//!
|
|
//! Upon arrival of a new solution:
|
|
//!
|
|
//! 1. If the queue is not full, it is stored in the appropriate sorted index.
|
|
//! 2. If the queue is full but the submitted solution is better than one of the queued ones, the
|
|
//! worse solution is discarded, the bond of the outgoing solution is returned, and the new
|
|
//! solution is stored in the correct index.
|
|
//! 3. If the queue is full and the solution is not an improvement compared to any of the queued
|
|
//! ones, it is instantly rejected and no additional bond is reserved.
|
|
//!
|
|
//! A signed solution cannot be reversed, taken back, updated, or retracted. In other words, the
|
|
//! origin can not bail out in any way, if their solution is queued.
|
|
//!
|
|
//! Upon the end of the signed phase, the solutions are examined from best to worse (i.e. `pop()`ed
|
|
//! until drained). Each solution undergoes an expensive `Pallet::feasibility_check`, which ensures
|
|
//! the score claimed by this score was correct, and it is valid based on the election data (i.e.
|
|
//! votes and candidates). At each step, if the current best solution passes the feasibility check,
|
|
//! it is considered to be the best one. The sender of the origin is rewarded, and the rest of the
|
|
//! queued solutions get their deposit back and are discarded, without being checked.
|
|
//!
|
|
//! The following example covers all of the cases at the end of the signed phase:
|
|
//!
|
|
//! ```ignore
|
|
//! Queue
|
|
//! +-------------------------------+
|
|
//! |Solution(score=20, valid=false)| +--> Slashed
|
|
//! +-------------------------------+
|
|
//! |Solution(score=15, valid=true )| +--> Rewarded, Saved
|
|
//! +-------------------------------+
|
|
//! |Solution(score=10, valid=true )| +--> Discarded
|
|
//! +-------------------------------+
|
|
//! |Solution(score=05, valid=false)| +--> Discarded
|
|
//! +-------------------------------+
|
|
//! | None |
|
|
//! +-------------------------------+
|
|
//! ```
|
|
//!
|
|
//! Note that both of the bottom solutions end up being discarded and get their deposit back,
|
|
//! despite one of them being *invalid*.
|
|
//!
|
|
//! ## Unsigned Phase
|
|
//!
|
|
//! The unsigned phase will always follow the signed phase, with the specified duration. In this
|
|
//! phase, only validator nodes can submit solutions. A validator node who has offchain workers
|
|
//! enabled will start to mine a solution in this phase and submits it back to the chain as an
|
|
//! unsigned transaction, thus the name _unsigned_ phase. This unsigned transaction can never be
|
|
//! valid if propagated, and it acts similar to an inherent.
|
|
//!
|
|
//! Validators will only submit solutions if the one that they have computed is sufficiently better
|
|
//! than the best queued one (see [`pallet::Config::SolutionImprovementThreshold`]) and will limit
|
|
//! the weigh of the solution to [`pallet::Config::MinerMaxWeight`].
|
|
//!
|
|
//! The unsigned phase can be made passive depending on how the previous signed phase went, by
|
|
//! setting the first inner value of [`Phase`] to `false`. For now, the signed phase is always
|
|
//! active.
|
|
//!
|
|
//! ### Fallback
|
|
//!
|
|
//! If we reach the end of both phases (i.e. call to [`ElectionProvider::elect`] happens) and no
|
|
//! good solution is queued, then the fallback strategy [`pallet::Config::Fallback`] is used to
|
|
//! determine what needs to be done. The on-chain election is slow, and contains no balancing or
|
|
//! reduction post-processing. [`NoFallback`] does nothing and enables [`Phase::Emergency`], which
|
|
//! is a more *fail-safe* approach.
|
|
//!
|
|
//! ### Emergency Phase
|
|
//!
|
|
//! If, for any of the below reasons:
|
|
//!
|
|
//! 1. No **signed** or **unsigned** solution submitted, and no successful [`Config::Fallback`] is
|
|
//! provided
|
|
//! 2. Any other unforeseen internal error
|
|
//!
|
|
//! A call to `T::ElectionProvider::elect` is made, and `Ok(_)` cannot be returned, then the pallet
|
|
//! proceeds to the [`Phase::Emergency`]. During this phase, any solution can be submitted from
|
|
//! [`Config::ForceOrigin`], without any checking, via [`Pallet::set_emergency_election_result`]
|
|
//! transaction. Hence, `[`Config::ForceOrigin`]` should only be set to a trusted origin, such as
|
|
//! the council or root. Once submitted, the forced solution is kept in [`QueuedSolution`] until the
|
|
//! next call to `T::ElectionProvider::elect`, where it is returned and [`Phase`] goes back to
|
|
//! `Off`.
|
|
//!
|
|
//! This implies that the user of this pallet (i.e. a staking pallet) should re-try calling
|
|
//! `T::ElectionProvider::elect` in case of error, until `OK(_)` is returned.
|
|
//!
|
|
//! To generate an emergency solution, one must only provide one argument: [`Supports`]. This is
|
|
//! essentially a collection of elected winners for the election, and voters who support them. The
|
|
//! supports can be generated by any means. In the simplest case, it could be manual. For example,
|
|
//! in the case of massive network failure or misbehaviour, [`Config::ForceOrigin`] might decide to
|
|
//! select only a small number of emergency winners (which would greatly restrict the next validator
|
|
//! set, if this pallet is used with `pallet-staking`). If the failure is for other technical
|
|
//! reasons, then a simple and safe way to generate supports is using the staking-miner binary
|
|
//! provided in the Polkadot repository. This binary has a subcommand named `emergency-solution`
|
|
//! which is capable of connecting to a live network, and generating appropriate `supports` using a
|
|
//! standard algorithm, and outputting the `supports` in hex format, ready for submission. Note that
|
|
//! while this binary lives in the Polkadot repository, this particular subcommand of it can work
|
|
//! against any substrate based-chain.
|
|
//!
|
|
//! See the `staking-miner` documentation in the Polkadot repository for more information.
|
|
//!
|
|
//! ## Feasible Solution (correct solution)
|
|
//!
|
|
//! All submissions must undergo a feasibility check. Signed solutions are checked on by one at the
|
|
//! end of the signed phase, and the unsigned solutions are checked on the spot. A feasible solution
|
|
//! is as follows:
|
|
//!
|
|
//! 0. **all** of the used indices must be correct.
|
|
//! 1. present *exactly* correct number of winners.
|
|
//! 2. any assignment is checked to match with [`RoundSnapshot::voters`].
|
|
//! 3. the claimed score is valid, based on the fixed point arithmetic accuracy.
|
|
//!
|
|
//! ## Accuracy
|
|
//!
|
|
//! The accuracy of the election is configured via [`SolutionAccuracyOf`] which is the accuracy that
|
|
//! the submitted solutions must adhere to.
|
|
//!
|
|
//! Note that the accuracy is of great importance. The offchain solution should be as small as
|
|
//! possible, reducing solutions size/weight.
|
|
//!
|
|
//! ## Error types
|
|
//!
|
|
//! This pallet provides a verbose error system to ease future debugging and debugging. The overall
|
|
//! hierarchy of errors is as follows:
|
|
//!
|
|
//! 1. [`pallet::Error`]: These are the errors that can be returned in the dispatchables of the
|
|
//! pallet, either signed or unsigned. Since decomposition with nested enums is not possible
|
|
//! here, they are prefixed with the logical sub-system to which they belong.
|
|
//! 2. [`ElectionError`]: These are the errors that can be generated while the pallet is doing
|
|
//! something in automatic scenarios, such as `offchain_worker` or `on_initialize`. These errors
|
|
//! are helpful for logging and are thus nested as:
|
|
//! - [`ElectionError::Miner`]: wraps a [`unsigned::MinerError`].
|
|
//! - [`ElectionError::Feasibility`]: wraps a [`FeasibilityError`].
|
|
//! - [`ElectionError::OnChainFallback`]: wraps a
|
|
//! [`frame_election_provider_support::onchain::Error`].
|
|
//!
|
|
//! Note that there could be an overlap between these sub-errors. For example, A
|
|
//! `SnapshotUnavailable` can happen in both miner and feasibility check phase.
|
|
//!
|
|
//! ## Future Plans
|
|
//!
|
|
//! **Emergency-phase recovery script**: This script should be taken out of staking-miner in
|
|
//! polkadot and ideally live in `substrate/utils/frame/elections`.
|
|
//!
|
|
//! **Challenge Phase**. We plan on adding a third phase to the pallet, called the challenge phase.
|
|
//! This is a phase in which no further solutions are processed, and the current best solution might
|
|
//! be challenged by anyone (signed or unsigned). The main plan here is to enforce the solution to
|
|
//! be PJR. Checking PJR on-chain is quite expensive, yet proving that a solution is **not** PJR is
|
|
//! rather cheap. If a queued solution is successfully proven bad:
|
|
//!
|
|
//! 1. We must surely slash whoever submitted that solution (might be a challenge for unsigned
|
|
//! solutions).
|
|
//! 2. We will fallback to the emergency strategy (likely extending the current era).
|
|
//!
|
|
//! **Bailing out**. The functionality of bailing out of a queued solution is nice. A miner can
|
|
//! submit a solution as soon as they _think_ it is high probability feasible, and do the checks
|
|
//! afterwards, and remove their solution (for a small cost of probably just transaction fees, or a
|
|
//! portion of the bond).
|
|
//!
|
|
//! **Conditionally open unsigned phase**: Currently, the unsigned phase is always opened. This is
|
|
//! useful because an honest validator will run substrate OCW code, which should be good enough to
|
|
//! trump a mediocre or malicious signed submission (assuming in the absence of honest signed bots).
|
|
//! If there are signed submissions, they can be checked against an absolute measure (e.g. PJR),
|
|
//! then we can only open the unsigned phase in extreme conditions (i.e. "no good signed solution
|
|
//! received") to spare some work for the active validators.
|
|
//!
|
|
//! **Allow smaller solutions and build up**: For now we only allow solutions that are exactly
|
|
//! [`DesiredTargets`], no more, no less. Over time, we can change this to a [min, max] where any
|
|
//! solution within this range is acceptable, where bigger solutions are prioritized.
|
|
//!
|
|
//! **Score based on (byte) size**: We should always prioritize small solutions over bigger ones, if
|
|
//! there is a tie. Even more harsh should be to enforce the bound of the `reduce` algorithm.
|
|
//!
|
|
//! **Take into account the encode/decode weight in benchmarks.** Currently, we only take into
|
|
//! account the weight of encode/decode in the `submit_unsigned` given its priority. Nonetheless,
|
|
//! all operations on the solution and the snapshot are worthy of taking this into account.
|
|
|
|
#![cfg_attr(not(feature = "std"), no_std)]
|
|
|
|
use codec::{Decode, Encode};
|
|
use frame_election_provider_support::{ElectionDataProvider, ElectionProvider};
|
|
use frame_support::{
|
|
dispatch::DispatchResultWithPostInfo,
|
|
ensure,
|
|
traits::{Currency, Get, OnUnbalanced, ReservableCurrency},
|
|
weights::{DispatchClass, Weight},
|
|
};
|
|
use frame_system::{ensure_none, offchain::SendTransactionTypes};
|
|
use scale_info::TypeInfo;
|
|
use sp_arithmetic::{
|
|
traits::{CheckedAdd, Saturating, Zero},
|
|
UpperOf,
|
|
};
|
|
use sp_npos_elections::{
|
|
assignment_ratio_to_staked_normalized, ElectionScore, EvaluateSupport, NposSolution, Supports,
|
|
VoteWeight,
|
|
};
|
|
use sp_runtime::{
|
|
traits::Bounded,
|
|
transaction_validity::{
|
|
InvalidTransaction, TransactionPriority, TransactionSource, TransactionValidity,
|
|
TransactionValidityError, ValidTransaction,
|
|
},
|
|
DispatchError, PerThing, Perbill, RuntimeDebug, SaturatedConversion,
|
|
};
|
|
use sp_std::prelude::*;
|
|
|
|
#[cfg(feature = "runtime-benchmarks")]
|
|
mod benchmarking;
|
|
#[cfg(test)]
|
|
mod mock;
|
|
#[macro_use]
|
|
pub mod helpers;
|
|
|
|
const LOG_TARGET: &'static str = "runtime::election-provider";
|
|
|
|
pub mod signed;
|
|
pub mod unsigned;
|
|
pub mod weights;
|
|
pub use weights::WeightInfo;
|
|
|
|
pub use signed::{
|
|
BalanceOf, NegativeImbalanceOf, PositiveImbalanceOf, SignedSubmission, SignedSubmissionOf,
|
|
SignedSubmissions, SubmissionIndicesOf,
|
|
};
|
|
|
|
/// The solution type used by this crate.
|
|
pub type SolutionOf<T> = <T as Config>::Solution;
|
|
|
|
/// The voter index. Derived from [`SolutionOf`].
|
|
pub type SolutionVoterIndexOf<T> = <SolutionOf<T> as NposSolution>::VoterIndex;
|
|
/// The target index. Derived from [`SolutionOf`].
|
|
pub type SolutionTargetIndexOf<T> = <SolutionOf<T> as NposSolution>::TargetIndex;
|
|
/// The accuracy of the election, when submitted from offchain. Derived from [`SolutionOf`].
|
|
pub type SolutionAccuracyOf<T> = <SolutionOf<T> as NposSolution>::Accuracy;
|
|
/// The fallback election type.
|
|
pub type FallbackErrorOf<T> = <<T as crate::Config>::Fallback as ElectionProvider<
|
|
<T as frame_system::Config>::AccountId,
|
|
<T as frame_system::Config>::BlockNumber,
|
|
>>::Error;
|
|
|
|
/// Configuration for the benchmarks of the pallet.
|
|
pub trait BenchmarkingConfig {
|
|
/// Range of voters.
|
|
const VOTERS: [u32; 2];
|
|
/// Range of targets.
|
|
const TARGETS: [u32; 2];
|
|
/// Range of active voters.
|
|
const ACTIVE_VOTERS: [u32; 2];
|
|
/// Range of desired targets.
|
|
const DESIRED_TARGETS: [u32; 2];
|
|
/// Maximum number of voters expected. This is used only for memory-benchmarking of snapshot.
|
|
const SNAPSHOT_MAXIMUM_VOTERS: u32;
|
|
/// Maximum number of voters expected. This is used only for memory-benchmarking of miner.
|
|
const MINER_MAXIMUM_VOTERS: u32;
|
|
/// Maximum number of targets expected. This is used only for memory-benchmarking.
|
|
const MAXIMUM_TARGETS: u32;
|
|
}
|
|
|
|
impl BenchmarkingConfig for () {
|
|
const VOTERS: [u32; 2] = [4000, 6000];
|
|
const TARGETS: [u32; 2] = [1000, 1600];
|
|
const ACTIVE_VOTERS: [u32; 2] = [1000, 3000];
|
|
const DESIRED_TARGETS: [u32; 2] = [400, 800];
|
|
const SNAPSHOT_MAXIMUM_VOTERS: u32 = 10_000;
|
|
const MINER_MAXIMUM_VOTERS: u32 = 10_000;
|
|
const MAXIMUM_TARGETS: u32 = 2_000;
|
|
}
|
|
|
|
/// A fallback implementation that transitions the pallet to the emergency phase.
|
|
pub struct NoFallback<T>(sp_std::marker::PhantomData<T>);
|
|
|
|
impl<T: Config> ElectionProvider<T::AccountId, T::BlockNumber> for NoFallback<T> {
|
|
type DataProvider = T::DataProvider;
|
|
type Error = &'static str;
|
|
|
|
fn elect() -> Result<Supports<T::AccountId>, Self::Error> {
|
|
// Do nothing, this will enable the emergency phase.
|
|
Err("NoFallback.")
|
|
}
|
|
}
|
|
|
|
/// Current phase of the pallet.
|
|
#[derive(PartialEq, Eq, Clone, Copy, Encode, Decode, Debug, TypeInfo)]
|
|
pub enum Phase<Bn> {
|
|
/// Nothing, the election is not happening.
|
|
Off,
|
|
/// Signed phase is open.
|
|
Signed,
|
|
/// Unsigned phase. First element is whether it is active or not, second the starting block
|
|
/// number.
|
|
///
|
|
/// We do not yet check whether the unsigned phase is active or passive. The intent is for the
|
|
/// blockchain to be able to declare: "I believe that there exists an adequate signed
|
|
/// solution," advising validators not to bother running the unsigned offchain worker.
|
|
///
|
|
/// As validator nodes are free to edit their OCW code, they could simply ignore this advisory
|
|
/// and always compute their own solution. However, by default, when the unsigned phase is
|
|
/// passive, the offchain workers will not bother running.
|
|
Unsigned((bool, Bn)),
|
|
/// The emergency phase. This is enabled upon a failing call to `T::ElectionProvider::elect`.
|
|
/// After that, the only way to leave this phase is through a successful
|
|
/// `T::ElectionProvider::elect`.
|
|
Emergency,
|
|
}
|
|
|
|
impl<Bn> Default for Phase<Bn> {
|
|
fn default() -> Self {
|
|
Phase::Off
|
|
}
|
|
}
|
|
|
|
impl<Bn: PartialEq + Eq> Phase<Bn> {
|
|
/// Whether the phase is emergency or not.
|
|
pub fn is_emergency(&self) -> bool {
|
|
matches!(self, Phase::Emergency)
|
|
}
|
|
|
|
/// Whether the phase is signed or not.
|
|
pub fn is_signed(&self) -> bool {
|
|
matches!(self, Phase::Signed)
|
|
}
|
|
|
|
/// Whether the phase is unsigned or not.
|
|
pub fn is_unsigned(&self) -> bool {
|
|
matches!(self, Phase::Unsigned(_))
|
|
}
|
|
|
|
/// Whether the phase is unsigned and open or not, with specific start.
|
|
pub fn is_unsigned_open_at(&self, at: Bn) -> bool {
|
|
matches!(self, Phase::Unsigned((true, real)) if *real == at)
|
|
}
|
|
|
|
/// Whether the phase is unsigned and open or not.
|
|
pub fn is_unsigned_open(&self) -> bool {
|
|
matches!(self, Phase::Unsigned((true, _)))
|
|
}
|
|
|
|
/// Whether the phase is off or not.
|
|
pub fn is_off(&self) -> bool {
|
|
matches!(self, Phase::Off)
|
|
}
|
|
}
|
|
|
|
/// The type of `Computation` that provided this election data.
|
|
#[derive(PartialEq, Eq, Clone, Copy, Encode, Decode, Debug, TypeInfo)]
|
|
pub enum ElectionCompute {
|
|
/// Election was computed on-chain.
|
|
OnChain,
|
|
/// Election was computed with a signed submission.
|
|
Signed,
|
|
/// Election was computed with an unsigned submission.
|
|
Unsigned,
|
|
/// Election was computed using the fallback
|
|
Fallback,
|
|
/// Election was computed with emergency status.
|
|
Emergency,
|
|
}
|
|
|
|
impl Default for ElectionCompute {
|
|
fn default() -> Self {
|
|
ElectionCompute::OnChain
|
|
}
|
|
}
|
|
|
|
/// A raw, unchecked solution.
|
|
///
|
|
/// This is what will get submitted to the chain.
|
|
///
|
|
/// Such a solution should never become effective in anyway before being checked by the
|
|
/// `Pallet::feasibility_check`.
|
|
#[derive(PartialEq, Eq, Clone, Encode, Decode, RuntimeDebug, PartialOrd, Ord, TypeInfo)]
|
|
pub struct RawSolution<S> {
|
|
/// the solution itself.
|
|
pub solution: S,
|
|
/// The _claimed_ score of the solution.
|
|
pub score: ElectionScore,
|
|
/// The round at which this solution should be submitted.
|
|
pub round: u32,
|
|
}
|
|
|
|
impl<C: Default> Default for RawSolution<C> {
|
|
fn default() -> Self {
|
|
// Round 0 is always invalid, only set this to 1.
|
|
Self { round: 1, solution: Default::default(), score: Default::default() }
|
|
}
|
|
}
|
|
|
|
/// A checked solution, ready to be enacted.
|
|
#[derive(PartialEq, Eq, Clone, Encode, Decode, RuntimeDebug, Default, TypeInfo)]
|
|
pub struct ReadySolution<A> {
|
|
/// The final supports of the solution.
|
|
///
|
|
/// This is target-major vector, storing each winners, total backing, and each individual
|
|
/// backer.
|
|
pub supports: Supports<A>,
|
|
/// The score of the solution.
|
|
///
|
|
/// This is needed to potentially challenge the solution.
|
|
pub score: ElectionScore,
|
|
/// How this election was computed.
|
|
pub compute: ElectionCompute,
|
|
}
|
|
|
|
/// A snapshot of all the data that is needed for en entire round. They are provided by
|
|
/// [`ElectionDataProvider`] and are kept around until the round is finished.
|
|
///
|
|
/// These are stored together because they are often accessed together.
|
|
#[derive(PartialEq, Eq, Clone, Encode, Decode, RuntimeDebug, Default, TypeInfo)]
|
|
pub struct RoundSnapshot<A> {
|
|
/// All of the voters.
|
|
pub voters: Vec<(A, VoteWeight, Vec<A>)>,
|
|
/// All of the targets.
|
|
pub targets: Vec<A>,
|
|
}
|
|
|
|
/// Encodes the length of a solution or a snapshot.
|
|
///
|
|
/// This is stored automatically on-chain, and it contains the **size of the entire snapshot**.
|
|
/// This is also used in dispatchables as weight witness data and should **only contain the size of
|
|
/// the presented solution**, not the entire snapshot.
|
|
#[derive(PartialEq, Eq, Clone, Copy, Encode, Decode, Debug, Default, TypeInfo)]
|
|
pub struct SolutionOrSnapshotSize {
|
|
/// The length of voters.
|
|
#[codec(compact)]
|
|
pub voters: u32,
|
|
/// The length of targets.
|
|
#[codec(compact)]
|
|
pub targets: u32,
|
|
}
|
|
|
|
/// Internal errors of the pallet.
|
|
///
|
|
/// Note that this is different from [`pallet::Error`].
|
|
#[derive(frame_support::DebugNoBound)]
|
|
#[cfg_attr(feature = "runtime-benchmarks", derive(strum_macros::IntoStaticStr))]
|
|
pub enum ElectionError<T: Config> {
|
|
/// An error happened in the feasibility check sub-system.
|
|
Feasibility(FeasibilityError),
|
|
/// An error in the miner (offchain) sub-system.
|
|
Miner(unsigned::MinerError<T>),
|
|
/// An error happened in the data provider.
|
|
DataProvider(&'static str),
|
|
/// An error nested in the fallback.
|
|
Fallback(FallbackErrorOf<T>),
|
|
}
|
|
|
|
// NOTE: we have to do this manually because of the additional where clause needed on
|
|
// `FallbackErrorOf<T>`.
|
|
#[cfg(test)]
|
|
impl<T: Config> PartialEq for ElectionError<T>
|
|
where
|
|
FallbackErrorOf<T>: PartialEq,
|
|
{
|
|
fn eq(&self, other: &Self) -> bool {
|
|
use ElectionError::*;
|
|
match (self, other) {
|
|
(&Feasibility(ref x), &Feasibility(ref y)) if x == y => true,
|
|
(&Miner(ref x), &Miner(ref y)) if x == y => true,
|
|
(&DataProvider(ref x), &DataProvider(ref y)) if x == y => true,
|
|
(&Fallback(ref x), &Fallback(ref y)) if x == y => true,
|
|
_ => false,
|
|
}
|
|
}
|
|
}
|
|
|
|
impl<T: Config> From<FeasibilityError> for ElectionError<T> {
|
|
fn from(e: FeasibilityError) -> Self {
|
|
ElectionError::Feasibility(e)
|
|
}
|
|
}
|
|
|
|
impl<T: Config> From<unsigned::MinerError<T>> for ElectionError<T> {
|
|
fn from(e: unsigned::MinerError<T>) -> Self {
|
|
ElectionError::Miner(e)
|
|
}
|
|
}
|
|
|
|
/// Errors that can happen in the feasibility check.
|
|
#[derive(Debug, Eq, PartialEq)]
|
|
#[cfg_attr(feature = "runtime-benchmarks", derive(strum_macros::IntoStaticStr))]
|
|
pub enum FeasibilityError {
|
|
/// Wrong number of winners presented.
|
|
WrongWinnerCount,
|
|
/// The snapshot is not available.
|
|
///
|
|
/// Kinda defensive: The pallet should technically never attempt to do a feasibility check when
|
|
/// no snapshot is present.
|
|
SnapshotUnavailable,
|
|
/// Internal error from the election crate.
|
|
NposElection(sp_npos_elections::Error),
|
|
/// A vote is invalid.
|
|
InvalidVote,
|
|
/// A voter is invalid.
|
|
InvalidVoter,
|
|
/// The given score was invalid.
|
|
InvalidScore,
|
|
/// The provided round is incorrect.
|
|
InvalidRound,
|
|
/// Comparison against `MinimumUntrustedScore` failed.
|
|
UntrustedScoreTooLow,
|
|
}
|
|
|
|
impl From<sp_npos_elections::Error> for FeasibilityError {
|
|
fn from(e: sp_npos_elections::Error) -> Self {
|
|
FeasibilityError::NposElection(e)
|
|
}
|
|
}
|
|
|
|
pub use pallet::*;
|
|
#[frame_support::pallet]
|
|
pub mod pallet {
|
|
use super::*;
|
|
use frame_election_provider_support::NposSolver;
|
|
use frame_support::{pallet_prelude::*, traits::EstimateCallFee};
|
|
use frame_system::pallet_prelude::*;
|
|
|
|
#[pallet::config]
|
|
pub trait Config: frame_system::Config + SendTransactionTypes<Call<Self>> {
|
|
type Event: From<Event<Self>>
|
|
+ IsType<<Self as frame_system::Config>::Event>
|
|
+ TryInto<Event<Self>>;
|
|
|
|
/// Currency type.
|
|
type Currency: ReservableCurrency<Self::AccountId> + Currency<Self::AccountId>;
|
|
|
|
/// Something that can predict the fee of a call. Used to sensibly distribute rewards.
|
|
type EstimateCallFee: EstimateCallFee<Call<Self>, BalanceOf<Self>>;
|
|
|
|
/// Duration of the unsigned phase.
|
|
#[pallet::constant]
|
|
type UnsignedPhase: Get<Self::BlockNumber>;
|
|
/// Duration of the signed phase.
|
|
#[pallet::constant]
|
|
type SignedPhase: Get<Self::BlockNumber>;
|
|
|
|
/// The minimum amount of improvement to the solution score that defines a solution as
|
|
/// "better" (in any phase).
|
|
#[pallet::constant]
|
|
type SolutionImprovementThreshold: Get<Perbill>;
|
|
|
|
/// The repeat threshold of the offchain worker.
|
|
///
|
|
/// For example, if it is 5, that means that at least 5 blocks will elapse between attempts
|
|
/// to submit the worker's solution.
|
|
#[pallet::constant]
|
|
type OffchainRepeat: Get<Self::BlockNumber>;
|
|
|
|
/// The priority of the unsigned transaction submitted in the unsigned-phase
|
|
#[pallet::constant]
|
|
type MinerTxPriority: Get<TransactionPriority>;
|
|
|
|
/// Maximum weight that the miner should consume.
|
|
///
|
|
/// The miner will ensure that the total weight of the unsigned solution will not exceed
|
|
/// this value, based on [`WeightInfo::submit_unsigned`].
|
|
#[pallet::constant]
|
|
type MinerMaxWeight: Get<Weight>;
|
|
|
|
/// Maximum number of signed submissions that can be queued.
|
|
///
|
|
/// It is best to avoid adjusting this during an election, as it impacts downstream data
|
|
/// structures. In particular, `SignedSubmissionIndices<T>` is bounded on this value. If you
|
|
/// update this value during an election, you _must_ ensure that
|
|
/// `SignedSubmissionIndices.len()` is less than or equal to the new value. Otherwise,
|
|
/// attempts to submit new solutions may cause a runtime panic.
|
|
#[pallet::constant]
|
|
type SignedMaxSubmissions: Get<u32>;
|
|
|
|
/// Maximum weight of a signed solution.
|
|
///
|
|
/// This should probably be similar to [`Config::MinerMaxWeight`].
|
|
#[pallet::constant]
|
|
type SignedMaxWeight: Get<Weight>;
|
|
|
|
/// Base reward for a signed solution
|
|
#[pallet::constant]
|
|
type SignedRewardBase: Get<BalanceOf<Self>>;
|
|
|
|
/// Base deposit for a signed solution.
|
|
#[pallet::constant]
|
|
type SignedDepositBase: Get<BalanceOf<Self>>;
|
|
|
|
/// Per-byte deposit for a signed solution.
|
|
#[pallet::constant]
|
|
type SignedDepositByte: Get<BalanceOf<Self>>;
|
|
|
|
/// Per-weight deposit for a signed solution.
|
|
#[pallet::constant]
|
|
type SignedDepositWeight: Get<BalanceOf<Self>>;
|
|
|
|
/// The maximum number of voters to put in the snapshot. At the moment, snapshots are only
|
|
/// over a single block, but once multi-block elections are introduced they will take place
|
|
/// over multiple blocks.
|
|
///
|
|
/// Also, note the data type: If the voters are represented by a `u32` in `type
|
|
/// CompactSolution`, the same `u32` is used here to ensure bounds are respected.
|
|
#[pallet::constant]
|
|
type VoterSnapshotPerBlock: Get<SolutionVoterIndexOf<Self>>;
|
|
|
|
/// Handler for the slashed deposits.
|
|
type SlashHandler: OnUnbalanced<NegativeImbalanceOf<Self>>;
|
|
|
|
/// Handler for the rewards.
|
|
type RewardHandler: OnUnbalanced<PositiveImbalanceOf<Self>>;
|
|
|
|
/// Maximum length (bytes) that the mined solution should consume.
|
|
///
|
|
/// The miner will ensure that the total length of the unsigned solution will not exceed
|
|
/// this value.
|
|
#[pallet::constant]
|
|
type MinerMaxLength: Get<u32>;
|
|
|
|
/// Something that will provide the election data.
|
|
type DataProvider: ElectionDataProvider<Self::AccountId, Self::BlockNumber>;
|
|
|
|
/// The solution type.
|
|
type Solution: codec::Codec
|
|
+ Default
|
|
+ PartialEq
|
|
+ Eq
|
|
+ Clone
|
|
+ sp_std::fmt::Debug
|
|
+ Ord
|
|
+ NposSolution
|
|
+ TypeInfo;
|
|
|
|
/// Configuration for the fallback
|
|
type Fallback: ElectionProvider<
|
|
Self::AccountId,
|
|
Self::BlockNumber,
|
|
DataProvider = Self::DataProvider,
|
|
>;
|
|
|
|
/// OCW election solution miner algorithm implementation.
|
|
type Solver: NposSolver<AccountId = Self::AccountId>;
|
|
|
|
/// Origin that can control this pallet. Note that any action taken by this origin (such)
|
|
/// as providing an emergency solution is not checked. Thus, it must be a trusted origin.
|
|
type ForceOrigin: EnsureOrigin<Self::Origin>;
|
|
|
|
/// The configuration of benchmarking.
|
|
type BenchmarkingConfig: BenchmarkingConfig;
|
|
|
|
/// The weight of the pallet.
|
|
type WeightInfo: WeightInfo;
|
|
}
|
|
|
|
#[pallet::hooks]
|
|
impl<T: Config> Hooks<BlockNumberFor<T>> for Pallet<T> {
|
|
fn on_initialize(now: T::BlockNumber) -> Weight {
|
|
let next_election = T::DataProvider::next_election_prediction(now).max(now);
|
|
|
|
let signed_deadline = T::SignedPhase::get() + T::UnsignedPhase::get();
|
|
let unsigned_deadline = T::UnsignedPhase::get();
|
|
|
|
let remaining = next_election - now;
|
|
let current_phase = Self::current_phase();
|
|
|
|
log!(
|
|
trace,
|
|
"current phase {:?}, next election {:?}, metadata: {:?}",
|
|
current_phase,
|
|
next_election,
|
|
Self::snapshot_metadata()
|
|
);
|
|
match current_phase {
|
|
Phase::Off if remaining <= signed_deadline && remaining > unsigned_deadline => {
|
|
// NOTE: if signed-phase length is zero, second part of the if-condition fails.
|
|
match Self::create_snapshot() {
|
|
Ok(_) => {
|
|
Self::on_initialize_open_signed();
|
|
T::WeightInfo::on_initialize_open_signed()
|
|
},
|
|
Err(why) => {
|
|
// Not much we can do about this at this point.
|
|
log!(warn, "failed to open signed phase due to {:?}", why);
|
|
T::WeightInfo::on_initialize_nothing()
|
|
},
|
|
}
|
|
},
|
|
Phase::Signed | Phase::Off
|
|
if remaining <= unsigned_deadline && remaining > Zero::zero() =>
|
|
{
|
|
// our needs vary according to whether or not the unsigned phase follows a
|
|
// signed phase
|
|
let (need_snapshot, enabled) = if current_phase == Phase::Signed {
|
|
// there was previously a signed phase: close the signed phase, no need for
|
|
// snapshot.
|
|
//
|
|
// Notes:
|
|
//
|
|
// - `Self::finalize_signed_phase()` also appears in `fn do_elect`. This
|
|
// is a guard against the case that `elect` is called prematurely. This
|
|
// adds a small amount of overhead, but that is unfortunately
|
|
// unavoidable.
|
|
let _ = Self::finalize_signed_phase();
|
|
// In the future we can consider disabling the unsigned phase if the signed
|
|
// phase completes successfully, but for now we're enabling it
|
|
// unconditionally as a defensive measure.
|
|
(false, true)
|
|
} else {
|
|
// No signed phase: create a new snapshot, definitely `enable` the unsigned
|
|
// phase.
|
|
(true, true)
|
|
};
|
|
|
|
if need_snapshot {
|
|
match Self::create_snapshot() {
|
|
Ok(_) => {
|
|
Self::on_initialize_open_unsigned(enabled, now);
|
|
T::WeightInfo::on_initialize_open_unsigned()
|
|
},
|
|
Err(why) => {
|
|
log!(warn, "failed to open unsigned phase due to {:?}", why);
|
|
T::WeightInfo::on_initialize_nothing()
|
|
},
|
|
}
|
|
} else {
|
|
Self::on_initialize_open_unsigned(enabled, now);
|
|
T::WeightInfo::on_initialize_open_unsigned()
|
|
}
|
|
},
|
|
_ => T::WeightInfo::on_initialize_nothing(),
|
|
}
|
|
}
|
|
|
|
fn offchain_worker(now: T::BlockNumber) {
|
|
use sp_runtime::offchain::storage_lock::{BlockAndTime, StorageLock};
|
|
|
|
// Create a lock with the maximum deadline of number of blocks in the unsigned phase.
|
|
// This should only come useful in an **abrupt** termination of execution, otherwise the
|
|
// guard will be dropped upon successful execution.
|
|
let mut lock =
|
|
StorageLock::<BlockAndTime<frame_system::Pallet<T>>>::with_block_deadline(
|
|
unsigned::OFFCHAIN_LOCK,
|
|
T::UnsignedPhase::get().saturated_into(),
|
|
);
|
|
|
|
match lock.try_lock() {
|
|
Ok(_guard) => {
|
|
Self::do_synchronized_offchain_worker(now);
|
|
},
|
|
Err(deadline) => {
|
|
log!(debug, "offchain worker lock not released, deadline is {:?}", deadline);
|
|
},
|
|
};
|
|
}
|
|
|
|
fn integrity_test() {
|
|
use sp_std::mem::size_of;
|
|
// The index type of both voters and targets need to be smaller than that of usize (very
|
|
// unlikely to be the case, but anyhow).
|
|
assert!(size_of::<SolutionVoterIndexOf<T>>() <= size_of::<usize>());
|
|
assert!(size_of::<SolutionTargetIndexOf<T>>() <= size_of::<usize>());
|
|
|
|
// ----------------------------
|
|
// Based on the requirements of [`sp_npos_elections::Assignment::try_normalize`].
|
|
let max_vote: usize = <SolutionOf<T> as NposSolution>::LIMIT;
|
|
|
|
// 2. Maximum sum of [SolutionAccuracy; 16] must fit into `UpperOf<OffchainAccuracy>`.
|
|
let maximum_chain_accuracy: Vec<UpperOf<SolutionAccuracyOf<T>>> = (0..max_vote)
|
|
.map(|_| {
|
|
<UpperOf<SolutionAccuracyOf<T>>>::from(
|
|
<SolutionAccuracyOf<T>>::one().deconstruct(),
|
|
)
|
|
})
|
|
.collect();
|
|
let _: UpperOf<SolutionAccuracyOf<T>> = maximum_chain_accuracy
|
|
.iter()
|
|
.fold(Zero::zero(), |acc, x| acc.checked_add(x).unwrap());
|
|
|
|
// We only accept data provider who's maximum votes per voter matches our
|
|
// `T::Solution`'s `LIMIT`.
|
|
//
|
|
// NOTE that this pallet does not really need to enforce this in runtime. The
|
|
// solution cannot represent any voters more than `LIMIT` anyhow.
|
|
assert_eq!(
|
|
<T::DataProvider as ElectionDataProvider<T::AccountId, T::BlockNumber>>::MAXIMUM_VOTES_PER_VOTER,
|
|
<SolutionOf<T> as NposSolution>::LIMIT as u32,
|
|
);
|
|
}
|
|
}
|
|
|
|
#[pallet::call]
|
|
impl<T: Config> Pallet<T> {
|
|
/// Submit a solution for the unsigned phase.
|
|
///
|
|
/// The dispatch origin fo this call must be __none__.
|
|
///
|
|
/// This submission is checked on the fly. Moreover, this unsigned solution is only
|
|
/// validated when submitted to the pool from the **local** node. Effectively, this means
|
|
/// that only active validators can submit this transaction when authoring a block (similar
|
|
/// to an inherent).
|
|
///
|
|
/// To prevent any incorrect solution (and thus wasted time/weight), this transaction will
|
|
/// panic if the solution submitted by the validator is invalid in any way, effectively
|
|
/// putting their authoring reward at risk.
|
|
///
|
|
/// No deposit or reward is associated with this submission.
|
|
#[pallet::weight((
|
|
T::WeightInfo::submit_unsigned(
|
|
witness.voters,
|
|
witness.targets,
|
|
raw_solution.solution.voter_count() as u32,
|
|
raw_solution.solution.unique_targets().len() as u32
|
|
),
|
|
DispatchClass::Operational,
|
|
))]
|
|
pub fn submit_unsigned(
|
|
origin: OriginFor<T>,
|
|
raw_solution: Box<RawSolution<SolutionOf<T>>>,
|
|
witness: SolutionOrSnapshotSize,
|
|
) -> DispatchResultWithPostInfo {
|
|
ensure_none(origin)?;
|
|
let error_message = "Invalid unsigned submission must produce invalid block and \
|
|
deprive validator from their authoring reward.";
|
|
|
|
// Check score being an improvement, phase, and desired targets.
|
|
Self::unsigned_pre_dispatch_checks(&raw_solution).expect(error_message);
|
|
|
|
// Ensure witness was correct.
|
|
let SolutionOrSnapshotSize { voters, targets } =
|
|
Self::snapshot_metadata().expect(error_message);
|
|
|
|
// NOTE: we are asserting, not `ensure`ing -- we want to panic here.
|
|
assert!(voters as u32 == witness.voters, "{}", error_message);
|
|
assert!(targets as u32 == witness.targets, "{}", error_message);
|
|
|
|
let ready = Self::feasibility_check(*raw_solution, ElectionCompute::Unsigned)
|
|
.expect(error_message);
|
|
|
|
// Store the newly received solution.
|
|
log!(info, "queued unsigned solution with score {:?}", ready.score);
|
|
let ejected_a_solution = <QueuedSolution<T>>::exists();
|
|
<QueuedSolution<T>>::put(ready);
|
|
Self::deposit_event(Event::SolutionStored(
|
|
ElectionCompute::Unsigned,
|
|
ejected_a_solution,
|
|
));
|
|
|
|
Ok(None.into())
|
|
}
|
|
|
|
/// Set a new value for `MinimumUntrustedScore`.
|
|
///
|
|
/// Dispatch origin must be aligned with `T::ForceOrigin`.
|
|
///
|
|
/// This check can be turned off by setting the value to `None`.
|
|
#[pallet::weight(T::DbWeight::get().writes(1))]
|
|
pub fn set_minimum_untrusted_score(
|
|
origin: OriginFor<T>,
|
|
maybe_next_score: Option<ElectionScore>,
|
|
) -> DispatchResult {
|
|
T::ForceOrigin::ensure_origin(origin)?;
|
|
<MinimumUntrustedScore<T>>::set(maybe_next_score);
|
|
Ok(())
|
|
}
|
|
|
|
/// Set a solution in the queue, to be handed out to the client of this pallet in the next
|
|
/// call to `ElectionProvider::elect`.
|
|
///
|
|
/// This can only be set by `T::ForceOrigin`, and only when the phase is `Emergency`.
|
|
///
|
|
/// The solution is not checked for any feasibility and is assumed to be trustworthy, as any
|
|
/// feasibility check itself can in principle cause the election process to fail (due to
|
|
/// memory/weight constrains).
|
|
#[pallet::weight(T::DbWeight::get().reads_writes(1, 1))]
|
|
pub fn set_emergency_election_result(
|
|
origin: OriginFor<T>,
|
|
supports: Supports<T::AccountId>,
|
|
) -> DispatchResult {
|
|
T::ForceOrigin::ensure_origin(origin)?;
|
|
ensure!(Self::current_phase().is_emergency(), <Error<T>>::CallNotAllowed);
|
|
|
|
// Note: we don't `rotate_round` at this point; the next call to
|
|
// `ElectionProvider::elect` will succeed and take care of that.
|
|
|
|
let solution =
|
|
ReadySolution { supports, score: [0, 0, 0], compute: ElectionCompute::Emergency };
|
|
|
|
<QueuedSolution<T>>::put(solution);
|
|
Ok(())
|
|
}
|
|
|
|
/// Submit a solution for the signed phase.
|
|
///
|
|
/// The dispatch origin fo this call must be __signed__.
|
|
///
|
|
/// The solution is potentially queued, based on the claimed score and processed at the end
|
|
/// of the signed phase.
|
|
///
|
|
/// A deposit is reserved and recorded for the solution. Based on the outcome, the solution
|
|
/// might be rewarded, slashed, or get all or a part of the deposit back.
|
|
///
|
|
/// # <weight>
|
|
/// Queue size must be provided as witness data.
|
|
/// # </weight>
|
|
#[pallet::weight(T::WeightInfo::submit(*num_signed_submissions))]
|
|
pub fn submit(
|
|
origin: OriginFor<T>,
|
|
raw_solution: Box<RawSolution<SolutionOf<T>>>,
|
|
num_signed_submissions: u32,
|
|
) -> DispatchResult {
|
|
let who = ensure_signed(origin)?;
|
|
|
|
// ensure witness data is correct.
|
|
ensure!(
|
|
num_signed_submissions >=
|
|
<SignedSubmissions<T>>::decode_len().unwrap_or_default() as u32,
|
|
Error::<T>::SignedInvalidWitness,
|
|
);
|
|
|
|
// ensure solution is timely.
|
|
ensure!(Self::current_phase().is_signed(), Error::<T>::PreDispatchEarlySubmission);
|
|
|
|
// NOTE: this is the only case where having separate snapshot would have been better
|
|
// because could do just decode_len. But we can create abstractions to do this.
|
|
|
|
// build size. Note: this is not needed for weight calc, thus not input.
|
|
// unlikely to ever return an error: if phase is signed, snapshot will exist.
|
|
let size = Self::snapshot_metadata().ok_or(Error::<T>::MissingSnapshotMetadata)?;
|
|
|
|
ensure!(
|
|
Self::feasibility_weight_of(&raw_solution, size) < T::SignedMaxWeight::get(),
|
|
Error::<T>::SignedTooMuchWeight,
|
|
);
|
|
|
|
// create the submission
|
|
let deposit = Self::deposit_for(&raw_solution, size);
|
|
let reward = {
|
|
let call =
|
|
Call::submit { raw_solution: raw_solution.clone(), num_signed_submissions };
|
|
let call_fee = T::EstimateCallFee::estimate_call_fee(&call, None.into());
|
|
T::SignedRewardBase::get().saturating_add(call_fee)
|
|
};
|
|
|
|
let submission =
|
|
SignedSubmission { who: who.clone(), deposit, raw_solution: *raw_solution, reward };
|
|
|
|
// insert the submission if the queue has space or it's better than the weakest
|
|
// eject the weakest if the queue was full
|
|
let mut signed_submissions = Self::signed_submissions();
|
|
let maybe_removed = match signed_submissions.insert(submission) {
|
|
// it's an error if we failed to insert a submission: this indicates the queue was
|
|
// full but our solution had insufficient score to eject any solution
|
|
signed::InsertResult::NotInserted => return Err(Error::<T>::SignedQueueFull.into()),
|
|
signed::InsertResult::Inserted => None,
|
|
signed::InsertResult::InsertedEjecting(weakest) => Some(weakest),
|
|
};
|
|
|
|
// collect deposit. Thereafter, the function cannot fail.
|
|
T::Currency::reserve(&who, deposit).map_err(|_| Error::<T>::SignedCannotPayDeposit)?;
|
|
|
|
let ejected_a_solution = maybe_removed.is_some();
|
|
// if we had to remove the weakest solution, unreserve its deposit
|
|
if let Some(removed) = maybe_removed {
|
|
let _remainder = T::Currency::unreserve(&removed.who, removed.deposit);
|
|
debug_assert!(_remainder.is_zero());
|
|
}
|
|
|
|
signed_submissions.put();
|
|
Self::deposit_event(Event::SolutionStored(ElectionCompute::Signed, ejected_a_solution));
|
|
Ok(())
|
|
}
|
|
}
|
|
|
|
#[pallet::event]
|
|
#[pallet::generate_deposit(pub(super) fn deposit_event)]
|
|
pub enum Event<T: Config> {
|
|
/// A solution was stored with the given compute.
|
|
///
|
|
/// If the solution is signed, this means that it hasn't yet been processed. If the
|
|
/// solution is unsigned, this means that it has also been processed.
|
|
///
|
|
/// The `bool` is `true` when a previous solution was ejected to make room for this one.
|
|
SolutionStored(ElectionCompute, bool),
|
|
/// The election has been finalized, with `Some` of the given computation, or else if the
|
|
/// election failed, `None`.
|
|
ElectionFinalized(Option<ElectionCompute>),
|
|
/// An account has been rewarded for their signed submission being finalized.
|
|
Rewarded(<T as frame_system::Config>::AccountId, BalanceOf<T>),
|
|
/// An account has been slashed for submitting an invalid signed submission.
|
|
Slashed(<T as frame_system::Config>::AccountId, BalanceOf<T>),
|
|
/// The signed phase of the given round has started.
|
|
SignedPhaseStarted(u32),
|
|
/// The unsigned phase of the given round has started.
|
|
UnsignedPhaseStarted(u32),
|
|
}
|
|
|
|
/// Error of the pallet that can be returned in response to dispatches.
|
|
#[pallet::error]
|
|
pub enum Error<T> {
|
|
/// Submission was too early.
|
|
PreDispatchEarlySubmission,
|
|
/// Wrong number of winners presented.
|
|
PreDispatchWrongWinnerCount,
|
|
/// Submission was too weak, score-wise.
|
|
PreDispatchWeakSubmission,
|
|
/// The queue was full, and the solution was not better than any of the existing ones.
|
|
SignedQueueFull,
|
|
/// The origin failed to pay the deposit.
|
|
SignedCannotPayDeposit,
|
|
/// Witness data to dispatchable is invalid.
|
|
SignedInvalidWitness,
|
|
/// The signed submission consumes too much weight
|
|
SignedTooMuchWeight,
|
|
/// OCW submitted solution for wrong round
|
|
OcwCallWrongEra,
|
|
/// Snapshot metadata should exist but didn't.
|
|
MissingSnapshotMetadata,
|
|
/// `Self::insert_submission` returned an invalid index.
|
|
InvalidSubmissionIndex,
|
|
/// The call is not allowed at this point.
|
|
CallNotAllowed,
|
|
}
|
|
|
|
#[pallet::validate_unsigned]
|
|
impl<T: Config> ValidateUnsigned for Pallet<T> {
|
|
type Call = Call<T>;
|
|
fn validate_unsigned(source: TransactionSource, call: &Self::Call) -> TransactionValidity {
|
|
if let Call::submit_unsigned { raw_solution, .. } = call {
|
|
// Discard solution not coming from the local OCW.
|
|
match source {
|
|
TransactionSource::Local | TransactionSource::InBlock => { /* allowed */ },
|
|
_ => return InvalidTransaction::Call.into(),
|
|
}
|
|
|
|
let _ = Self::unsigned_pre_dispatch_checks(raw_solution)
|
|
.map_err(|err| {
|
|
log!(debug, "unsigned transaction validation failed due to {:?}", err);
|
|
err
|
|
})
|
|
.map_err(dispatch_error_to_invalid)?;
|
|
|
|
ValidTransaction::with_tag_prefix("OffchainElection")
|
|
// The higher the score[0], the better a solution is.
|
|
.priority(
|
|
T::MinerTxPriority::get()
|
|
.saturating_add(raw_solution.score[0].saturated_into()),
|
|
)
|
|
// Used to deduplicate unsigned solutions: each validator should produce one
|
|
// solution per round at most, and solutions are not propagate.
|
|
.and_provides(raw_solution.round)
|
|
// Transaction should stay in the pool for the duration of the unsigned phase.
|
|
.longevity(T::UnsignedPhase::get().saturated_into::<u64>())
|
|
// We don't propagate this. This can never be validated at a remote node.
|
|
.propagate(false)
|
|
.build()
|
|
} else {
|
|
InvalidTransaction::Call.into()
|
|
}
|
|
}
|
|
|
|
fn pre_dispatch(call: &Self::Call) -> Result<(), TransactionValidityError> {
|
|
if let Call::submit_unsigned { raw_solution, .. } = call {
|
|
Self::unsigned_pre_dispatch_checks(raw_solution)
|
|
.map_err(dispatch_error_to_invalid)
|
|
.map_err(Into::into)
|
|
} else {
|
|
Err(InvalidTransaction::Call.into())
|
|
}
|
|
}
|
|
}
|
|
|
|
#[pallet::type_value]
|
|
pub fn DefaultForRound() -> u32 {
|
|
1
|
|
}
|
|
|
|
/// Internal counter for the number of rounds.
|
|
///
|
|
/// This is useful for de-duplication of transactions submitted to the pool, and general
|
|
/// diagnostics of the pallet.
|
|
///
|
|
/// This is merely incremented once per every time that an upstream `elect` is called.
|
|
#[pallet::storage]
|
|
#[pallet::getter(fn round)]
|
|
pub type Round<T: Config> = StorageValue<_, u32, ValueQuery, DefaultForRound>;
|
|
|
|
/// Current phase.
|
|
#[pallet::storage]
|
|
#[pallet::getter(fn current_phase)]
|
|
pub type CurrentPhase<T: Config> = StorageValue<_, Phase<T::BlockNumber>, ValueQuery>;
|
|
|
|
/// Current best solution, signed or unsigned, queued to be returned upon `elect`.
|
|
#[pallet::storage]
|
|
#[pallet::getter(fn queued_solution)]
|
|
pub type QueuedSolution<T: Config> = StorageValue<_, ReadySolution<T::AccountId>>;
|
|
|
|
/// Snapshot data of the round.
|
|
///
|
|
/// This is created at the beginning of the signed phase and cleared upon calling `elect`.
|
|
#[pallet::storage]
|
|
#[pallet::getter(fn snapshot)]
|
|
pub type Snapshot<T: Config> = StorageValue<_, RoundSnapshot<T::AccountId>>;
|
|
|
|
/// Desired number of targets to elect for this round.
|
|
///
|
|
/// Only exists when [`Snapshot`] is present.
|
|
#[pallet::storage]
|
|
#[pallet::getter(fn desired_targets)]
|
|
pub type DesiredTargets<T> = StorageValue<_, u32>;
|
|
|
|
/// The metadata of the [`RoundSnapshot`]
|
|
///
|
|
/// Only exists when [`Snapshot`] is present.
|
|
#[pallet::storage]
|
|
#[pallet::getter(fn snapshot_metadata)]
|
|
pub type SnapshotMetadata<T: Config> = StorageValue<_, SolutionOrSnapshotSize>;
|
|
|
|
// The following storage items collectively comprise `SignedSubmissions<T>`, and should never be
|
|
// accessed independently. Instead, get `Self::signed_submissions()`, modify it as desired, and
|
|
// then do `signed_submissions.put()` when you're done with it.
|
|
|
|
/// The next index to be assigned to an incoming signed submission.
|
|
///
|
|
/// Every accepted submission is assigned a unique index; that index is bound to that particular
|
|
/// submission for the duration of the election. On election finalization, the next index is
|
|
/// reset to 0.
|
|
///
|
|
/// We can't just use `SignedSubmissionIndices.len()`, because that's a bounded set; past its
|
|
/// capacity, it will simply saturate. We can't just iterate over `SignedSubmissionsMap`,
|
|
/// because iteration is slow. Instead, we store the value here.
|
|
#[pallet::storage]
|
|
pub(crate) type SignedSubmissionNextIndex<T: Config> = StorageValue<_, u32, ValueQuery>;
|
|
|
|
/// A sorted, bounded set of `(score, index)`, where each `index` points to a value in
|
|
/// `SignedSubmissions`.
|
|
///
|
|
/// We never need to process more than a single signed submission at a time. Signed submissions
|
|
/// can be quite large, so we're willing to pay the cost of multiple database accesses to access
|
|
/// them one at a time instead of reading and decoding all of them at once.
|
|
#[pallet::storage]
|
|
pub(crate) type SignedSubmissionIndices<T: Config> =
|
|
StorageValue<_, SubmissionIndicesOf<T>, ValueQuery>;
|
|
|
|
/// Unchecked, signed solutions.
|
|
///
|
|
/// Together with `SubmissionIndices`, this stores a bounded set of `SignedSubmissions` while
|
|
/// allowing us to keep only a single one in memory at a time.
|
|
///
|
|
/// Twox note: the key of the map is an auto-incrementing index which users cannot inspect or
|
|
/// affect; we shouldn't need a cryptographically secure hasher.
|
|
#[pallet::storage]
|
|
pub(crate) type SignedSubmissionsMap<T: Config> =
|
|
StorageMap<_, Twox64Concat, u32, SignedSubmissionOf<T>, ValueQuery>;
|
|
|
|
// `SignedSubmissions` items end here.
|
|
|
|
/// The minimum score that each 'untrusted' solution must attain in order to be considered
|
|
/// feasible.
|
|
///
|
|
/// Can be set via `set_minimum_untrusted_score`.
|
|
#[pallet::storage]
|
|
#[pallet::getter(fn minimum_untrusted_score)]
|
|
pub type MinimumUntrustedScore<T: Config> = StorageValue<_, ElectionScore>;
|
|
|
|
#[pallet::pallet]
|
|
#[pallet::generate_store(pub(super) trait Store)]
|
|
pub struct Pallet<T>(PhantomData<T>);
|
|
}
|
|
|
|
impl<T: Config> Pallet<T> {
|
|
/// Internal logic of the offchain worker, to be executed only when the offchain lock is
|
|
/// acquired with success.
|
|
fn do_synchronized_offchain_worker(now: T::BlockNumber) {
|
|
let current_phase = Self::current_phase();
|
|
log!(trace, "lock for offchain worker acquired. Phase = {:?}", current_phase);
|
|
match current_phase {
|
|
Phase::Unsigned((true, opened)) if opened == now => {
|
|
// Mine a new solution, cache it, and attempt to submit it
|
|
let initial_output = Self::ensure_offchain_repeat_frequency(now).and_then(|_| {
|
|
// This is executed at the beginning of each round. Any cache is now invalid.
|
|
// Clear it.
|
|
unsigned::kill_ocw_solution::<T>();
|
|
Self::mine_check_save_submit()
|
|
});
|
|
log!(debug, "initial offchain thread output: {:?}", initial_output);
|
|
},
|
|
Phase::Unsigned((true, opened)) if opened < now => {
|
|
// Try and resubmit the cached solution, and recompute ONLY if it is not
|
|
// feasible.
|
|
let resubmit_output = Self::ensure_offchain_repeat_frequency(now)
|
|
.and_then(|_| Self::restore_or_compute_then_maybe_submit());
|
|
log!(debug, "resubmit offchain thread output: {:?}", resubmit_output);
|
|
},
|
|
_ => {},
|
|
}
|
|
}
|
|
|
|
/// Logic for [`<Pallet as Hooks>::on_initialize`] when signed phase is being opened.
|
|
pub fn on_initialize_open_signed() {
|
|
log!(info, "Starting signed phase round {}.", Self::round());
|
|
<CurrentPhase<T>>::put(Phase::Signed);
|
|
Self::deposit_event(Event::SignedPhaseStarted(Self::round()));
|
|
}
|
|
|
|
/// Logic for [`<Pallet as Hooks<T>>::on_initialize`] when unsigned phase is being opened.
|
|
pub fn on_initialize_open_unsigned(enabled: bool, now: T::BlockNumber) {
|
|
let round = Self::round();
|
|
log!(info, "Starting unsigned phase round {} enabled {}.", round, enabled);
|
|
<CurrentPhase<T>>::put(Phase::Unsigned((enabled, now)));
|
|
Self::deposit_event(Event::UnsignedPhaseStarted(round));
|
|
}
|
|
|
|
/// Parts of [`create_snapshot`] that happen inside of this pallet.
|
|
///
|
|
/// Extracted for easier weight calculation.
|
|
fn create_snapshot_internal(
|
|
targets: Vec<T::AccountId>,
|
|
voters: Vec<crate::unsigned::Voter<T>>,
|
|
desired_targets: u32,
|
|
) {
|
|
let metadata =
|
|
SolutionOrSnapshotSize { voters: voters.len() as u32, targets: targets.len() as u32 };
|
|
log!(info, "creating a snapshot with metadata {:?}", metadata);
|
|
|
|
<SnapshotMetadata<T>>::put(metadata);
|
|
<DesiredTargets<T>>::put(desired_targets);
|
|
|
|
// instead of using storage APIs, we do a manual encoding into a fixed-size buffer.
|
|
// `encoded_size` encodes it without storing it anywhere, this should not cause any
|
|
// allocation.
|
|
let snapshot = RoundSnapshot { voters, targets };
|
|
let size = snapshot.encoded_size();
|
|
log!(debug, "snapshot pre-calculated size {:?}", size);
|
|
let mut buffer = Vec::with_capacity(size);
|
|
snapshot.encode_to(&mut buffer);
|
|
|
|
// do some checks.
|
|
debug_assert_eq!(buffer, snapshot.encode());
|
|
// buffer should have not re-allocated since.
|
|
debug_assert!(buffer.len() == size && size == buffer.capacity());
|
|
|
|
sp_io::storage::set(&<Snapshot<T>>::hashed_key(), &buffer);
|
|
}
|
|
|
|
/// Parts of [`create_snapshot`] that happen outside of this pallet.
|
|
///
|
|
/// Extracted for easier weight calculation.
|
|
fn create_snapshot_external(
|
|
) -> Result<(Vec<T::AccountId>, Vec<crate::unsigned::Voter<T>>, u32), ElectionError<T>> {
|
|
let target_limit = <SolutionTargetIndexOf<T>>::max_value().saturated_into::<usize>();
|
|
// for now we have just a single block snapshot.
|
|
let voter_limit = T::VoterSnapshotPerBlock::get().saturated_into::<usize>();
|
|
|
|
let targets =
|
|
T::DataProvider::targets(Some(target_limit)).map_err(ElectionError::DataProvider)?;
|
|
let voters =
|
|
T::DataProvider::voters(Some(voter_limit)).map_err(ElectionError::DataProvider)?;
|
|
let desired_targets =
|
|
T::DataProvider::desired_targets().map_err(ElectionError::DataProvider)?;
|
|
|
|
// Defensive-only.
|
|
if targets.len() > target_limit || voters.len() > voter_limit {
|
|
debug_assert!(false, "Snapshot limit has not been respected.");
|
|
return Err(ElectionError::DataProvider("Snapshot too big for submission."))
|
|
}
|
|
|
|
Ok((targets, voters, desired_targets))
|
|
}
|
|
|
|
/// Creates the snapshot. Writes new data to:
|
|
///
|
|
/// 1. [`SnapshotMetadata`]
|
|
/// 2. [`RoundSnapshot`]
|
|
/// 3. [`DesiredTargets`]
|
|
///
|
|
/// Returns `Ok(())` if operation is okay.
|
|
///
|
|
/// This is a *self-weighing* function, it will register its own extra weight as
|
|
/// [`DispatchClass::Mandatory`] with the system pallet.
|
|
pub fn create_snapshot() -> Result<(), ElectionError<T>> {
|
|
// this is self-weighing itself..
|
|
let (targets, voters, desired_targets) = Self::create_snapshot_external()?;
|
|
|
|
// ..therefore we only measure the weight of this and add it.
|
|
let internal_weight =
|
|
T::WeightInfo::create_snapshot_internal(voters.len() as u32, targets.len() as u32);
|
|
Self::create_snapshot_internal(targets, voters, desired_targets);
|
|
Self::register_weight(internal_weight);
|
|
Ok(())
|
|
}
|
|
|
|
/// Register some amount of weight directly with the system pallet.
|
|
///
|
|
/// This is always mandatory weight.
|
|
fn register_weight(weight: Weight) {
|
|
<frame_system::Pallet<T>>::register_extra_weight_unchecked(
|
|
weight,
|
|
DispatchClass::Mandatory,
|
|
);
|
|
}
|
|
|
|
/// Kill everything created by [`Pallet::create_snapshot`].
|
|
pub fn kill_snapshot() {
|
|
<Snapshot<T>>::kill();
|
|
<SnapshotMetadata<T>>::kill();
|
|
<DesiredTargets<T>>::kill();
|
|
}
|
|
|
|
/// Checks the feasibility of a solution.
|
|
pub fn feasibility_check(
|
|
raw_solution: RawSolution<SolutionOf<T>>,
|
|
compute: ElectionCompute,
|
|
) -> Result<ReadySolution<T::AccountId>, FeasibilityError> {
|
|
let RawSolution { solution, score, round } = raw_solution;
|
|
|
|
// First, check round.
|
|
ensure!(Self::round() == round, FeasibilityError::InvalidRound);
|
|
|
|
// Winners are not directly encoded in the solution.
|
|
let winners = solution.unique_targets();
|
|
|
|
let desired_targets =
|
|
Self::desired_targets().ok_or(FeasibilityError::SnapshotUnavailable)?;
|
|
|
|
// NOTE: this is a bit of duplicate, but we keep it around for veracity. The unsigned path
|
|
// already checked this in `unsigned_per_dispatch_checks`. The signed path *could* check it
|
|
// upon arrival, thus we would then remove it here. Given overlay it is cheap anyhow
|
|
ensure!(winners.len() as u32 == desired_targets, FeasibilityError::WrongWinnerCount);
|
|
|
|
// Ensure that the solution's score can pass absolute min-score.
|
|
let submitted_score = raw_solution.score.clone();
|
|
ensure!(
|
|
Self::minimum_untrusted_score().map_or(true, |min_score| {
|
|
sp_npos_elections::is_score_better(submitted_score, min_score, Perbill::zero())
|
|
}),
|
|
FeasibilityError::UntrustedScoreTooLow
|
|
);
|
|
|
|
// Read the entire snapshot.
|
|
let RoundSnapshot { voters: snapshot_voters, targets: snapshot_targets } =
|
|
Self::snapshot().ok_or(FeasibilityError::SnapshotUnavailable)?;
|
|
|
|
// ----- Start building. First, we need some closures.
|
|
let cache = helpers::generate_voter_cache::<T>(&snapshot_voters);
|
|
let voter_at = helpers::voter_at_fn::<T>(&snapshot_voters);
|
|
let target_at = helpers::target_at_fn::<T>(&snapshot_targets);
|
|
let voter_index = helpers::voter_index_fn_usize::<T>(&cache);
|
|
|
|
// Then convert solution -> assignment. This will fail if any of the indices are gibberish,
|
|
// namely any of the voters or targets.
|
|
let assignments = solution
|
|
.into_assignment(voter_at, target_at)
|
|
.map_err::<FeasibilityError, _>(Into::into)?;
|
|
|
|
// Ensure that assignments is correct.
|
|
let _ = assignments
|
|
.iter()
|
|
.map(|ref assignment| {
|
|
// Check that assignment.who is actually a voter (defensive-only).
|
|
// NOTE: while using the index map from `voter_index` is better than a blind linear
|
|
// search, this *still* has room for optimization. Note that we had the index when
|
|
// we did `solution -> assignment` and we lost it. Ideal is to keep the index
|
|
// around.
|
|
|
|
// Defensive-only: must exist in the snapshot.
|
|
let snapshot_index =
|
|
voter_index(&assignment.who).ok_or(FeasibilityError::InvalidVoter)?;
|
|
// Defensive-only: index comes from the snapshot, must exist.
|
|
let (_voter, _stake, targets) =
|
|
snapshot_voters.get(snapshot_index).ok_or(FeasibilityError::InvalidVoter)?;
|
|
|
|
// Check that all of the targets are valid based on the snapshot.
|
|
if assignment.distribution.iter().any(|(d, _)| !targets.contains(d)) {
|
|
return Err(FeasibilityError::InvalidVote)
|
|
}
|
|
Ok(())
|
|
})
|
|
.collect::<Result<(), FeasibilityError>>()?;
|
|
|
|
// ----- Start building support. First, we need one more closure.
|
|
let stake_of = helpers::stake_of_fn::<T>(&snapshot_voters, &cache);
|
|
|
|
// This might fail if the normalization fails. Very unlikely. See `integrity_test`.
|
|
let staked_assignments = assignment_ratio_to_staked_normalized(assignments, stake_of)
|
|
.map_err::<FeasibilityError, _>(Into::into)?;
|
|
let supports = sp_npos_elections::to_supports(&staked_assignments);
|
|
|
|
// Finally, check that the claimed score was indeed correct.
|
|
let known_score = supports.evaluate();
|
|
ensure!(known_score == score, FeasibilityError::InvalidScore);
|
|
|
|
Ok(ReadySolution { supports, compute, score })
|
|
}
|
|
|
|
/// Perform the tasks to be done after a new `elect` has been triggered:
|
|
///
|
|
/// 1. Increment round.
|
|
/// 2. Change phase to [`Phase::Off`]
|
|
/// 3. Clear all snapshot data.
|
|
fn rotate_round() {
|
|
// Inc round.
|
|
<Round<T>>::mutate(|r| *r += 1);
|
|
|
|
// Phase is off now.
|
|
<CurrentPhase<T>>::put(Phase::Off);
|
|
|
|
// Kill snapshots.
|
|
Self::kill_snapshot();
|
|
}
|
|
|
|
fn do_elect() -> Result<Supports<T::AccountId>, ElectionError<T>> {
|
|
// We have to unconditionally try finalizing the signed phase here. There are only two
|
|
// possibilities:
|
|
//
|
|
// - signed phase was open, in which case this is essential for correct functioning of the
|
|
// system
|
|
// - signed phase was complete or not started, in which case finalization is idempotent and
|
|
// inexpensive (1 read of an empty vector).
|
|
let _ = Self::finalize_signed_phase();
|
|
<QueuedSolution<T>>::take()
|
|
.map_or_else(
|
|
|| {
|
|
T::Fallback::elect()
|
|
.map_err(|fe| ElectionError::Fallback(fe))
|
|
.map(|supports| (supports, ElectionCompute::Fallback))
|
|
},
|
|
|ReadySolution { supports, compute, .. }| Ok((supports, compute)),
|
|
)
|
|
.map(|(supports, compute)| {
|
|
Self::deposit_event(Event::ElectionFinalized(Some(compute)));
|
|
if Self::round() != 1 {
|
|
log!(info, "Finalized election round with compute {:?}.", compute);
|
|
}
|
|
supports
|
|
})
|
|
.map_err(|err| {
|
|
Self::deposit_event(Event::ElectionFinalized(None));
|
|
if Self::round() != 1 {
|
|
log!(warn, "Failed to finalize election round. reason {:?}", err);
|
|
}
|
|
err
|
|
})
|
|
}
|
|
|
|
/// record the weight of the given `supports`.
|
|
fn weigh_supports(supports: &Supports<T::AccountId>) {
|
|
let active_voters = supports
|
|
.iter()
|
|
.map(|(_, x)| x)
|
|
.fold(Zero::zero(), |acc, next| acc + next.voters.len() as u32);
|
|
let desired_targets = supports.len() as u32;
|
|
Self::register_weight(T::WeightInfo::elect_queued(active_voters, desired_targets));
|
|
}
|
|
}
|
|
|
|
impl<T: Config> ElectionProvider<T::AccountId, T::BlockNumber> for Pallet<T> {
|
|
type Error = ElectionError<T>;
|
|
type DataProvider = T::DataProvider;
|
|
|
|
fn elect() -> Result<Supports<T::AccountId>, Self::Error> {
|
|
match Self::do_elect() {
|
|
Ok(supports) => {
|
|
// All went okay, record the weight, put sign to be Off, clean snapshot, etc.
|
|
Self::weigh_supports(&supports);
|
|
Self::rotate_round();
|
|
Ok(supports)
|
|
},
|
|
Err(why) => {
|
|
log!(error, "Entering emergency mode: {:?}", why);
|
|
<CurrentPhase<T>>::put(Phase::Emergency);
|
|
Err(why)
|
|
},
|
|
}
|
|
}
|
|
}
|
|
|
|
/// convert a DispatchError to a custom InvalidTransaction with the inner code being the error
|
|
/// number.
|
|
pub fn dispatch_error_to_invalid(error: DispatchError) -> InvalidTransaction {
|
|
let error_number = match error {
|
|
DispatchError::Module { error, .. } => error,
|
|
_ => 0,
|
|
};
|
|
InvalidTransaction::Custom(error_number)
|
|
}
|
|
|
|
#[cfg(test)]
|
|
mod feasibility_check {
|
|
//! All of the tests here should be dedicated to only testing the feasibility check and nothing
|
|
//! more. The best way to audit and review these tests is to try and come up with a solution
|
|
//! that is invalid, but gets through the system as valid.
|
|
|
|
use super::*;
|
|
use crate::mock::{
|
|
raw_solution, roll_to, EpochLength, ExtBuilder, MultiPhase, Runtime, SignedPhase,
|
|
TargetIndex, UnsignedPhase, VoterIndex,
|
|
};
|
|
use frame_support::assert_noop;
|
|
|
|
const COMPUTE: ElectionCompute = ElectionCompute::OnChain;
|
|
|
|
#[test]
|
|
fn snapshot_is_there() {
|
|
ExtBuilder::default().build_and_execute(|| {
|
|
roll_to(<EpochLength>::get() - <SignedPhase>::get() - <UnsignedPhase>::get());
|
|
assert!(MultiPhase::current_phase().is_signed());
|
|
let solution = raw_solution();
|
|
|
|
// For whatever reason it might be:
|
|
<Snapshot<Runtime>>::kill();
|
|
|
|
assert_noop!(
|
|
MultiPhase::feasibility_check(solution, COMPUTE),
|
|
FeasibilityError::SnapshotUnavailable
|
|
);
|
|
})
|
|
}
|
|
|
|
#[test]
|
|
fn round() {
|
|
ExtBuilder::default().build_and_execute(|| {
|
|
roll_to(<EpochLength>::get() - <SignedPhase>::get() - <UnsignedPhase>::get());
|
|
assert!(MultiPhase::current_phase().is_signed());
|
|
|
|
let mut solution = raw_solution();
|
|
solution.round += 1;
|
|
assert_noop!(
|
|
MultiPhase::feasibility_check(solution, COMPUTE),
|
|
FeasibilityError::InvalidRound
|
|
);
|
|
})
|
|
}
|
|
|
|
#[test]
|
|
fn desired_targets() {
|
|
ExtBuilder::default().desired_targets(8).build_and_execute(|| {
|
|
roll_to(<EpochLength>::get() - <SignedPhase>::get() - <UnsignedPhase>::get());
|
|
assert!(MultiPhase::current_phase().is_signed());
|
|
|
|
let raw = raw_solution();
|
|
|
|
assert_eq!(raw.solution.unique_targets().len(), 4);
|
|
assert_eq!(MultiPhase::desired_targets().unwrap(), 8);
|
|
|
|
assert_noop!(
|
|
MultiPhase::feasibility_check(raw, COMPUTE),
|
|
FeasibilityError::WrongWinnerCount,
|
|
);
|
|
})
|
|
}
|
|
|
|
#[test]
|
|
fn winner_indices() {
|
|
ExtBuilder::default().desired_targets(2).build_and_execute(|| {
|
|
roll_to(<EpochLength>::get() - <SignedPhase>::get() - <UnsignedPhase>::get());
|
|
assert!(MultiPhase::current_phase().is_signed());
|
|
|
|
let mut raw = raw_solution();
|
|
assert_eq!(MultiPhase::snapshot().unwrap().targets.len(), 4);
|
|
// ----------------------------------------------------^^ valid range is [0..3].
|
|
|
|
// Swap all votes from 3 to 4. This will ensure that the number of unique winners will
|
|
// still be 4, but one of the indices will be gibberish. Requirement is to make sure 3 a
|
|
// winner, which we don't do here.
|
|
raw.solution
|
|
.votes1
|
|
.iter_mut()
|
|
.filter(|(_, t)| *t == TargetIndex::from(3u16))
|
|
.for_each(|(_, t)| *t += 1);
|
|
raw.solution.votes2.iter_mut().for_each(|(_, [(t0, _)], t1)| {
|
|
if *t0 == TargetIndex::from(3u16) {
|
|
*t0 += 1
|
|
};
|
|
if *t1 == TargetIndex::from(3u16) {
|
|
*t1 += 1
|
|
};
|
|
});
|
|
assert_noop!(
|
|
MultiPhase::feasibility_check(raw, COMPUTE),
|
|
FeasibilityError::NposElection(sp_npos_elections::Error::SolutionInvalidIndex)
|
|
);
|
|
})
|
|
}
|
|
|
|
#[test]
|
|
fn voter_indices() {
|
|
// Should be caught in `solution.into_assignment`.
|
|
ExtBuilder::default().desired_targets(2).build_and_execute(|| {
|
|
roll_to(<EpochLength>::get() - <SignedPhase>::get() - <UnsignedPhase>::get());
|
|
assert!(MultiPhase::current_phase().is_signed());
|
|
|
|
let mut solution = raw_solution();
|
|
assert_eq!(MultiPhase::snapshot().unwrap().voters.len(), 8);
|
|
// ----------------------------------------------------^^ valid range is [0..7].
|
|
|
|
// Check that there is an index 7 in votes1, and flip to 8.
|
|
assert!(
|
|
solution
|
|
.solution
|
|
.votes1
|
|
.iter_mut()
|
|
.filter(|(v, _)| *v == VoterIndex::from(7u32))
|
|
.map(|(v, _)| *v = 8)
|
|
.count() > 0
|
|
);
|
|
assert_noop!(
|
|
MultiPhase::feasibility_check(solution, COMPUTE),
|
|
FeasibilityError::NposElection(sp_npos_elections::Error::SolutionInvalidIndex),
|
|
);
|
|
})
|
|
}
|
|
|
|
#[test]
|
|
fn voter_votes() {
|
|
ExtBuilder::default().desired_targets(2).build_and_execute(|| {
|
|
roll_to(<EpochLength>::get() - <SignedPhase>::get() - <UnsignedPhase>::get());
|
|
assert!(MultiPhase::current_phase().is_signed());
|
|
|
|
let mut solution = raw_solution();
|
|
assert_eq!(MultiPhase::snapshot().unwrap().voters.len(), 8);
|
|
// ----------------------------------------------------^^ valid range is [0..7].
|
|
|
|
// First, check that voter at index 7 (40) actually voted for 3 (40) -- this is self
|
|
// vote. Then, change the vote to 2 (30).
|
|
assert_eq!(
|
|
solution
|
|
.solution
|
|
.votes1
|
|
.iter_mut()
|
|
.filter(|(v, t)| *v == 7 && *t == 3)
|
|
.map(|(_, t)| *t = 2)
|
|
.count(),
|
|
1,
|
|
);
|
|
assert_noop!(
|
|
MultiPhase::feasibility_check(solution, COMPUTE),
|
|
FeasibilityError::InvalidVote,
|
|
);
|
|
})
|
|
}
|
|
|
|
#[test]
|
|
fn score() {
|
|
ExtBuilder::default().desired_targets(2).build_and_execute(|| {
|
|
roll_to(<EpochLength>::get() - <SignedPhase>::get() - <UnsignedPhase>::get());
|
|
assert!(MultiPhase::current_phase().is_signed());
|
|
|
|
let mut solution = raw_solution();
|
|
assert_eq!(MultiPhase::snapshot().unwrap().voters.len(), 8);
|
|
|
|
// Simply faff with the score.
|
|
solution.score[0] += 1;
|
|
|
|
assert_noop!(
|
|
MultiPhase::feasibility_check(solution, COMPUTE),
|
|
FeasibilityError::InvalidScore,
|
|
);
|
|
})
|
|
}
|
|
}
|
|
|
|
#[cfg(test)]
|
|
mod tests {
|
|
use super::*;
|
|
use crate::{
|
|
mock::{
|
|
multi_phase_events, roll_to, AccountId, ExtBuilder, MockWeightInfo, MultiPhase,
|
|
Runtime, SignedMaxSubmissions, System, TargetIndex, Targets,
|
|
},
|
|
Phase,
|
|
};
|
|
use frame_election_provider_support::ElectionProvider;
|
|
use frame_support::{assert_noop, assert_ok};
|
|
use sp_npos_elections::Support;
|
|
|
|
#[test]
|
|
fn phase_rotation_works() {
|
|
ExtBuilder::default().build_and_execute(|| {
|
|
// 0 ------- 15 ------- 25 ------- 30 ------- ------- 45 ------- 55 ------- 60
|
|
// | | | | | |
|
|
// Signed Unsigned Elect Signed Unsigned Elect
|
|
|
|
assert_eq!(System::block_number(), 0);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Off);
|
|
assert_eq!(MultiPhase::round(), 1);
|
|
|
|
roll_to(4);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Off);
|
|
assert!(MultiPhase::snapshot().is_none());
|
|
assert_eq!(MultiPhase::round(), 1);
|
|
|
|
roll_to(15);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Signed);
|
|
assert_eq!(multi_phase_events(), vec![Event::SignedPhaseStarted(1)]);
|
|
assert!(MultiPhase::snapshot().is_some());
|
|
assert_eq!(MultiPhase::round(), 1);
|
|
|
|
roll_to(24);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Signed);
|
|
assert!(MultiPhase::snapshot().is_some());
|
|
assert_eq!(MultiPhase::round(), 1);
|
|
|
|
roll_to(25);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Unsigned((true, 25)));
|
|
assert_eq!(
|
|
multi_phase_events(),
|
|
vec![Event::SignedPhaseStarted(1), Event::UnsignedPhaseStarted(1)],
|
|
);
|
|
assert!(MultiPhase::snapshot().is_some());
|
|
|
|
roll_to(29);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Unsigned((true, 25)));
|
|
assert!(MultiPhase::snapshot().is_some());
|
|
|
|
roll_to(30);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Unsigned((true, 25)));
|
|
assert!(MultiPhase::snapshot().is_some());
|
|
|
|
// We close when upstream tells us to elect.
|
|
roll_to(32);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Unsigned((true, 25)));
|
|
assert!(MultiPhase::snapshot().is_some());
|
|
|
|
assert_ok!(MultiPhase::elect());
|
|
|
|
assert!(MultiPhase::current_phase().is_off());
|
|
assert!(MultiPhase::snapshot().is_none());
|
|
assert_eq!(MultiPhase::round(), 2);
|
|
|
|
roll_to(44);
|
|
assert!(MultiPhase::current_phase().is_off());
|
|
|
|
roll_to(45);
|
|
assert!(MultiPhase::current_phase().is_signed());
|
|
|
|
roll_to(55);
|
|
assert!(MultiPhase::current_phase().is_unsigned_open_at(55));
|
|
})
|
|
}
|
|
|
|
#[test]
|
|
fn signed_phase_void() {
|
|
ExtBuilder::default().phases(0, 10).build_and_execute(|| {
|
|
roll_to(15);
|
|
assert!(MultiPhase::current_phase().is_off());
|
|
|
|
roll_to(19);
|
|
assert!(MultiPhase::current_phase().is_off());
|
|
|
|
roll_to(20);
|
|
assert!(MultiPhase::current_phase().is_unsigned_open_at(20));
|
|
assert!(MultiPhase::snapshot().is_some());
|
|
|
|
roll_to(30);
|
|
assert!(MultiPhase::current_phase().is_unsigned_open_at(20));
|
|
|
|
assert_ok!(MultiPhase::elect());
|
|
|
|
assert!(MultiPhase::current_phase().is_off());
|
|
assert!(MultiPhase::snapshot().is_none());
|
|
});
|
|
}
|
|
|
|
#[test]
|
|
fn unsigned_phase_void() {
|
|
ExtBuilder::default().phases(10, 0).build_and_execute(|| {
|
|
roll_to(15);
|
|
assert!(MultiPhase::current_phase().is_off());
|
|
|
|
roll_to(19);
|
|
assert!(MultiPhase::current_phase().is_off());
|
|
|
|
roll_to(20);
|
|
assert!(MultiPhase::current_phase().is_signed());
|
|
assert!(MultiPhase::snapshot().is_some());
|
|
|
|
roll_to(30);
|
|
assert!(MultiPhase::current_phase().is_signed());
|
|
|
|
assert_ok!(MultiPhase::elect());
|
|
|
|
assert!(MultiPhase::current_phase().is_off());
|
|
assert!(MultiPhase::snapshot().is_none());
|
|
});
|
|
}
|
|
|
|
#[test]
|
|
fn both_phases_void() {
|
|
ExtBuilder::default().phases(0, 0).build_and_execute(|| {
|
|
roll_to(15);
|
|
assert!(MultiPhase::current_phase().is_off());
|
|
|
|
roll_to(19);
|
|
assert!(MultiPhase::current_phase().is_off());
|
|
|
|
roll_to(20);
|
|
assert!(MultiPhase::current_phase().is_off());
|
|
|
|
roll_to(30);
|
|
assert!(MultiPhase::current_phase().is_off());
|
|
|
|
// This module is now only capable of doing on-chain backup.
|
|
assert_ok!(MultiPhase::elect());
|
|
|
|
assert!(MultiPhase::current_phase().is_off());
|
|
});
|
|
}
|
|
|
|
#[test]
|
|
fn early_termination() {
|
|
// An early termination in the signed phase, with no queued solution.
|
|
ExtBuilder::default().build_and_execute(|| {
|
|
// Signed phase started at block 15 and will end at 25.
|
|
roll_to(14);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Off);
|
|
|
|
roll_to(15);
|
|
assert_eq!(multi_phase_events(), vec![Event::SignedPhaseStarted(1)]);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Signed);
|
|
assert_eq!(MultiPhase::round(), 1);
|
|
|
|
// An unexpected call to elect.
|
|
roll_to(20);
|
|
assert_ok!(MultiPhase::elect());
|
|
|
|
// We surely can't have any feasible solutions. This will cause an on-chain election.
|
|
assert_eq!(
|
|
multi_phase_events(),
|
|
vec![
|
|
Event::SignedPhaseStarted(1),
|
|
Event::ElectionFinalized(Some(ElectionCompute::Fallback))
|
|
],
|
|
);
|
|
// All storage items must be cleared.
|
|
assert_eq!(MultiPhase::round(), 2);
|
|
assert!(MultiPhase::snapshot().is_none());
|
|
assert!(MultiPhase::snapshot_metadata().is_none());
|
|
assert!(MultiPhase::desired_targets().is_none());
|
|
assert!(MultiPhase::queued_solution().is_none());
|
|
assert!(MultiPhase::signed_submissions().is_empty());
|
|
})
|
|
}
|
|
|
|
#[test]
|
|
fn early_termination_with_submissions() {
|
|
// an early termination in the signed phase, with no queued solution.
|
|
ExtBuilder::default().build_and_execute(|| {
|
|
// signed phase started at block 15 and will end at 25.
|
|
roll_to(14);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Off);
|
|
|
|
roll_to(15);
|
|
assert_eq!(multi_phase_events(), vec![Event::SignedPhaseStarted(1)]);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Signed);
|
|
assert_eq!(MultiPhase::round(), 1);
|
|
|
|
// fill the queue with signed submissions
|
|
for s in 0..SignedMaxSubmissions::get() {
|
|
let solution = RawSolution { score: [(5 + s).into(), 0, 0], ..Default::default() };
|
|
assert_ok!(MultiPhase::submit(
|
|
crate::mock::Origin::signed(99),
|
|
Box::new(solution),
|
|
MultiPhase::signed_submissions().len() as u32
|
|
));
|
|
}
|
|
|
|
// an unexpected call to elect.
|
|
roll_to(20);
|
|
assert_ok!(MultiPhase::elect());
|
|
|
|
// all storage items must be cleared.
|
|
assert_eq!(MultiPhase::round(), 2);
|
|
assert!(MultiPhase::snapshot().is_none());
|
|
assert!(MultiPhase::snapshot_metadata().is_none());
|
|
assert!(MultiPhase::desired_targets().is_none());
|
|
assert!(MultiPhase::queued_solution().is_none());
|
|
assert!(MultiPhase::signed_submissions().is_empty());
|
|
})
|
|
}
|
|
|
|
#[test]
|
|
fn fallback_strategy_works() {
|
|
ExtBuilder::default().onchain_fallback(true).build_and_execute(|| {
|
|
roll_to(25);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Unsigned((true, 25)));
|
|
|
|
// Zilch solutions thus far, but we get a result.
|
|
assert!(MultiPhase::queued_solution().is_none());
|
|
let supports = MultiPhase::elect().unwrap();
|
|
|
|
assert_eq!(
|
|
supports,
|
|
vec![
|
|
(30, Support { total: 40, voters: vec![(2, 5), (4, 5), (30, 30)] }),
|
|
(40, Support { total: 60, voters: vec![(2, 5), (3, 10), (4, 5), (40, 40)] })
|
|
]
|
|
)
|
|
});
|
|
|
|
ExtBuilder::default().onchain_fallback(false).build_and_execute(|| {
|
|
roll_to(25);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Unsigned((true, 25)));
|
|
|
|
// Zilch solutions thus far.
|
|
assert!(MultiPhase::queued_solution().is_none());
|
|
assert_eq!(MultiPhase::elect().unwrap_err(), ElectionError::Fallback("NoFallback."));
|
|
// phase is now emergency.
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Emergency);
|
|
})
|
|
}
|
|
|
|
#[test]
|
|
fn snapshot_too_big_failure_onchain_fallback() {
|
|
// the `MockStaking` is designed such that if it has too many targets, it simply fails.
|
|
ExtBuilder::default().build_and_execute(|| {
|
|
Targets::set((0..(TargetIndex::max_value() as AccountId) + 1).collect::<Vec<_>>());
|
|
|
|
// Signed phase failed to open.
|
|
roll_to(15);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Off);
|
|
|
|
// Unsigned phase failed to open.
|
|
roll_to(25);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Off);
|
|
|
|
// On-chain backup works though.
|
|
roll_to(29);
|
|
let supports = MultiPhase::elect().unwrap();
|
|
assert!(supports.len() > 0);
|
|
});
|
|
}
|
|
|
|
#[test]
|
|
fn snapshot_too_big_failure_no_fallback() {
|
|
// and if the backup mode is nothing, we go into the emergency mode..
|
|
ExtBuilder::default().onchain_fallback(false).build_and_execute(|| {
|
|
crate::mock::Targets::set(
|
|
(0..(TargetIndex::max_value() as AccountId) + 1).collect::<Vec<_>>(),
|
|
);
|
|
|
|
// Signed phase failed to open.
|
|
roll_to(15);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Off);
|
|
|
|
// Unsigned phase failed to open.
|
|
roll_to(25);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Off);
|
|
|
|
roll_to(29);
|
|
let err = MultiPhase::elect().unwrap_err();
|
|
assert_eq!(err, ElectionError::Fallback("NoFallback."));
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Emergency);
|
|
});
|
|
}
|
|
|
|
#[test]
|
|
fn snapshot_too_big_truncate() {
|
|
// but if there are too many voters, we simply truncate them.
|
|
ExtBuilder::default().build_and_execute(|| {
|
|
// we have 8 voters in total.
|
|
assert_eq!(crate::mock::Voters::get().len(), 8);
|
|
// but we want to take 2.
|
|
crate::mock::VoterSnapshotPerBlock::set(2);
|
|
|
|
// Signed phase opens just fine.
|
|
roll_to(15);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Signed);
|
|
|
|
assert_eq!(
|
|
MultiPhase::snapshot_metadata().unwrap(),
|
|
SolutionOrSnapshotSize { voters: 2, targets: 4 }
|
|
);
|
|
})
|
|
}
|
|
|
|
#[test]
|
|
fn untrusted_score_verification_is_respected() {
|
|
ExtBuilder::default().build_and_execute(|| {
|
|
roll_to(15);
|
|
assert_eq!(MultiPhase::current_phase(), Phase::Signed);
|
|
|
|
// set the solution balancing to get the desired score.
|
|
crate::mock::Balancing::set(Some((2, 0)));
|
|
|
|
let (solution, _) = MultiPhase::mine_solution::<<Runtime as Config>::Solver>().unwrap();
|
|
// Default solution has a score of [50, 100, 5000].
|
|
assert_eq!(solution.score, [50, 100, 5000]);
|
|
|
|
<MinimumUntrustedScore<Runtime>>::put([49, 0, 0]);
|
|
assert_ok!(MultiPhase::feasibility_check(solution.clone(), ElectionCompute::Signed));
|
|
|
|
<MinimumUntrustedScore<Runtime>>::put([51, 0, 0]);
|
|
assert_noop!(
|
|
MultiPhase::feasibility_check(solution, ElectionCompute::Signed),
|
|
FeasibilityError::UntrustedScoreTooLow,
|
|
);
|
|
})
|
|
}
|
|
|
|
#[test]
|
|
fn number_of_voters_allowed_2sec_block() {
|
|
// Just a rough estimate with the substrate weights.
|
|
assert!(!MockWeightInfo::get());
|
|
|
|
let all_voters: u32 = 10_000;
|
|
let all_targets: u32 = 5_000;
|
|
let desired: u32 = 1_000;
|
|
let weight_with = |active| {
|
|
<Runtime as Config>::WeightInfo::submit_unsigned(
|
|
all_voters,
|
|
all_targets,
|
|
active,
|
|
desired,
|
|
)
|
|
};
|
|
|
|
let mut active = 1;
|
|
while weight_with(active) <=
|
|
<Runtime as frame_system::Config>::BlockWeights::get().max_block ||
|
|
active == all_voters
|
|
{
|
|
active += 1;
|
|
}
|
|
|
|
println!("can support {} voters to yield a weight of {}", active, weight_with(active));
|
|
}
|
|
}
|