* Support repetitions in the tool
* Add support for account allocations
* Update the JSON schema
* Support virtual repeats
* Add a step path
* Update the schema
* Generate schema for the metadata file
* Groundwork for dyn traits
* Make the ethereum node trait object compatible
* Allow for compilers to be created in the dyn trait
* Add more identifiers to the platform
* Implement the dyn compiler trait for compilers
* Support the dyn compiler in the builder pattern
* Introduce a geth platform
* Provide a common node implementation for substrate chains
* Add all of the platforms that we support
* Add a way to convert platform identifier into a platform
* Replace infra with the dyn infra
* Remoe all references to leader and follower
* Remove the old traits
* Remove an un-needed dependency
* Update the default values for the platforms
* Final set of renames
* Update the default values of the cli
* Update tests
* Add leader and follower node assignment to test
* Update the compilers interface
* Fix Cargo machete
* Add reporting back to the compilers
* Remove the static testing target from the report
* Uncomment instrument macro
* Switch to a for loop when reporting cases
* Update compilers to use interior caching
* Update tests stream func
* Fix tests
* Add a quick run script
* Add more context to errors
* Fix the issue with corpus directory canonicalization
* Update the quick run script
* Edit the runner script
* Support specifying the path of the polkadot sdk
* Configure kitchensink to use devnode by default
* Update the kitchensink tests
* Fix the logic for finding the ABI in resolc
* Edit how CLI reporter prints
* Remove the old reporting infra
* Use the Test struct more in the code
* Implement the initial set of reporter events
* Add more runner events to the reporter and refine the structure
* Add reporting infra for reporting ignored tests
* Update report to use better map data structures
* Add case status information to the report
* Integrate the reporting infrastructure with the
CLI reporter used by the program.
* Include contract compilation information in report
* Cleanup report model
* Add information on the deployed contracts
* Fix the OS FD error
* Cache the compiler versions
* Allow for auto display impl in declare wrapper type macro
* Better logging and fix concurrency issues
* Fix tests
* Format
* Make the code even more concurrent
* WIP redo how we parse and use modes
* test expanding, too
* WIP integrate new Mode/ParsedMode into rest of code
* First pass integrated new mode bits
* fmt
* clippy
* Remove mode we no longer support from test metadata
* Address nits
* Add ability for compiler to opt out if it can't work with some Mode/version
* Elide viaIR input if compiler does not support it
* Improve test output a little; string modes and list ignored tests
* Move Mode to common crate
* constants.mod, and Display for CaseIdx to use it
* fmt
* Rename ModePipeline::E/Y
* Re-arrange Mode things; ParsedMode in format and Mode etc in common
* Move compile check to prepare_tests
* Remove now-unused deps
* clippy nits
* Update fallback tx weights to avoid out of gas errors
* Update kitchensink weights too and fmt
* Bump default geth timeout to 10s
* 30s timeout
* Improve geth stdout logging on failure
* fix line logging
* remove --networkid and arg, back to 5s timeout for geth
* Use channels to send data to reporting thread and avoid hangs / mutex / duration. Limit max concurrent tasks to avoid too many open files
* More appropriate name for dirver/reporter task fns
* Back to parallelise individual cases, report individual cases, address grumbles
* newline before 'Failures' title in report
* Make metadata serializable
* Refactor tests to use steps
* Add a balance assertion test step
* Test balance deserialization
* Box the test steps
* Permit size difference in step output
* Added a resolver tied to a specific block
* Increase the number of private keys
* Increase kitchensink wait time to 60 seconds
* Add a case ignore flag
* Parallelize over cases
* Rename the state and driver
* Parallelize execution
* Update the default config of the tool
* Make codebase async
* Fix machete
* Fix tests & clear node directories before startup
* Cleanup the cleanup logic
* Rename geth node
* Allow for downloader to use version requirements.
We will soon add support for the compiler version requirement from the
metadata files to be honored. The compiler version is specified in the
solc modes section of the file and its specified as a `VersionReq` and
not as a version.
Therefore, we need to have the ability to honor this version requirement
and find the best version that satisfies the requirement.
* Request `VersionOrRequirement` in compiler interface
* Honor the compiler version requirement in metadata
This commit honors the compiler version requirement listed in the solc
modes of the metadata file. If this version requirement is provided then
it overrides what was passed in the CLI. Otherwise, the CLI version will
be used.
* Make compiler IO completely generic.
Before this commit, the types that were used for the compiler input and
output were the resolc compiler types which was a leaky abstraction as
we have traits to abstract the compilers away but we expose their
internal types out to other crates.
This commit did the following:
1. Made the compiler IO types fully generic so that all of the logic for
constructing the map of compiled contracts is all done by the
compiler implementation and not by the consuming code.
2. Changed the input types used for Solc to be the forge standard JSON
types for Solc instead of resolc.
* Fix machete
* Add resolc to CI
* Add resolc to CI
* Add resolc to CI
* Add resolc to CI
* Re-order the input file.
This commit reorders the input file such that we have a definitions
section and an implementations section and such that the the order of
the items in both sections is the same.
* Implement a reverse polish calculator for calldata arithmetic
* Add a barebones common crate
* Refactor some code into the common crate
* Add a `ResolverApi` interface.
This commit adds a `ResolverApi` trait to the `format` crate that can be
implemented by any type that can act as a resolver. A resolver is able
to provide information on the chain state. This chain state could be
fresh or it could be cached (which is something that we will do in a
future PR).
This cleans up our crate graph so that `format` is not depending on the
node interactions crate for the `EthereumNode` trait.
* Cleanup the blocking executor
* Add support for wrapper types
* Move `FilesWithExtensionIterator` to `core::common`
* Remove unneeded use of two `HashMap`s
* Make metadata structs more typed
* Impl new_from for wrapper types
* Implement the new input handling logic
* Fix edge-case in input handling
* Ignore macro doc comment tests
* Correct comment
* Fix edge-case in deployment order
* Handle calldata better
* Allow for the use of function signatures
* Add support for exceptions
* Cached nonce allocator
* Fix tests
* Add support for address replacement
* Cleanup implementation
* Cleanup mutability
* Wire up address replacement with rest of code
* Implement caller replacement
* Switch to callframe trace for exceptions
* Add a way to skip tests if they don't match the target
* Handle values from the metadata files
* Remove address replacement
* Correct the arguments
* Remove empty impl
* Remove address replacement
* Correct the arguments
* Remove empty impl
* Fix size_requirement underflow
* Add support for wildcards in exceptions
* Fix calldata construction of single calldata
* Better handling for length in equivalency checks
* Make initial balance a constant
* Fix size_requirement underflow
* Add support for wildcards in exceptions
* Fix calldata construction of single calldata
* Better handling for length in equivalency checks
* Fix tests
* Add support for wrapper types
* Move `FilesWithExtensionIterator` to `core::common`
* Remove unneeded use of two `HashMap`s
* Make metadata structs more typed
* Impl new_from for wrapper types
* Implement the new input handling logic
* Fix edge-case in input handling
* Ignore macro doc comment tests
* Correct comment
* Fix edge-case in deployment order
* Introduce a custom kitchensink network
* fix formatting
* Added `--dev` to `substrate-node` arguments.
This commit adds the `--dev` argument to the `substrate-node` to allow
the chain to keep advancing as time goes own. We have found that if this
option is not added then the chain won't advance forward.
* fix clippy warning
* fix clippy warning
* Fix the ABI finding logic
* Fix function selector and argument encoding
* Avoid extra buffer allocation
* Remove reliance on the web3 crate
* Implement ABI fix in the compiler trait impl
* Update the async runtime with syntactic sugar.
* Fix tests
* Fix doc test
* Give nodes a standard way to get their alloy provider
* Add ability to get the chain_id from node
* Get kitchensink provider to use kitchensink network
* Use provider method in tests
* Add support for getting the gas limit from the node
* Add a way to get the coinbase address
* Add a way to get the block difficulty from the node
* Add a way to get block info from the node
* Expose APIs for getting the info of a specific block
* Add resolution logic for other matterlabs variables
* Fix tests
* Add comment on alternative solutions
* Change kitchensink gas limit assertion
* Cleanup execution logic
* Introduce a custom kitchensink network
* fix formatting
* Added `--dev` to `substrate-node` arguments.
This commit adds the `--dev` argument to the `substrate-node` to allow
the chain to keep advancing as time goes own. We have found that if this
option is not added then the chain won't advance forward.
* fix clippy warning
* fix clippy warning
* Fix function selector and argument encoding
* Avoid extra buffer allocation
* Remove reliance on the web3 crate
* Update the async runtime with syntactic sugar.
* Fix tests
* Fix doc test
* Give nodes a standard way to get their alloy provider
* Add ability to get the chain_id from node
* Get kitchensink provider to use kitchensink network
* Use provider method in tests
* Add support for getting the gas limit from the node
* Add a way to get the coinbase address
* Add a way to get the block difficulty from the node
* Add a way to get block info from the node
* Expose APIs for getting the info of a specific block
* Add resolution logic for other matterlabs variables
* Fix tests
* Add comment on alternative solutions
* Change kitchensink gas limit assertion
* Remove un-needed profile config
This commit updates how logging is done in the differential testing
harness to use `tracing` instead of using the `log` crate. This allows
us to be able to better associate logs with the cases being executed
which makes it easier to debug and understand what the harness is doing.
* Parsed ABI field in order to get method parameter
* Added logic for ABI
* Refactored dependencies
* Small refactoring
* Added unit tests for ABI parameter extraction logic
* Fixed format issues
* Fixed format
* Added new changes to format
* Added bail to stop execution when we have an error during deployment
* Fix legacy_transaction to address for execution part
* updated polkadot-sdk to latest
* Update polkadot-sdk to latest main with fixes
* Added extra logging
* Applied some clippy improvements
Omar Abdulla