Commit Graph
100 Commits
Author SHA1 Message Date
Pierre Krieger f7bd56d2a8 Handle RPC requests in the substrate-service (#2866)
* Rework RPC queries

* Remove SyncProvider trait

* Fix RPC tests
2019-06-15 15:44:04 +02:00
Pierre Krieger 12bbc2ffd9 Merge network-libp2p into network (#2843)
* Move network-libp2p into network

* Merge libp2p_service into service

* Don't expose RegisteredProtocol in the API

* Extract DiscoveryBehaviour from Behaviour

* Restore libp2p tests

* Add a test for discovery

* Line width

* Remove bandwidth check

* Fix gitlab
2019-06-13 18:21:31 +02:00
Pierre Krieger 68f4d11df3 Move the telemetry information to service (#2846)
* Move the telemetry information to service

* Proper exit
2019-06-12 21:32:52 +02:00
Pierre Krieger ce302390dd Refactoring: Remove ExtraVerification in the import queue (#2844)
* Remove ExtraVerification in the import queue

* Fix Babe

* Fix node-template
2019-06-12 14:56:31 +02:00
Pierre Krieger 925f8a1b04 Make it build for Android (#2833) 2019-06-10 18:09:14 +02:00
Pierre Krieger ac895023be More crate compiling for WASM-browser (#2825)
* More crate compiling for WASM-browser

* Update runtime Cargo.lock
2019-06-07 16:06:15 +02:00
Pierre Krieger 4d3396d095 Move modules around in network (#2822)
* Rename modules in protocol

* Line widths
2019-06-07 15:30:45 +02:00
Pierre Krieger 57afa9b440 Rewrite telemetry using libp2p (#2812)
* Rewrite telemetry using libp2p

* Update the Cargo.lock files

* Apply suggestion
2019-06-06 22:15:38 +02:00
Pierre Krieger 6130ff3f46 Don't pass the Endpoint as message (#2814) 2019-06-06 22:12:55 +02:00
Pierre Krieger f210557211 Require --locked when building runtime (#2813)
* Require --locked when building runtime

* Update locks

* Do it in a different way

* Accidentally reverted Cargo.lock

* pass on arguments in build.sh scripts
2019-06-06 15:53:22 +02:00
Pierre Krieger e18dc6d53c Update to libp2p 0.9.1 (#2804) 2019-06-06 11:50:22 +02:00
Pierre Krieger 67bdfc7d8e Small slots refactor (#2780)
* Deprecate SlotWorker::on_start

* start_slot_worker no longer needs an Arc

* start_slot_worker now always succeeds

* Removed on_exit parameter from start_*_worker

* Minor doc

* Fix node-template
2019-06-05 10:31:20 -04:00
Pierre Krieger 89b312fe9c Revert #2745 (#2791)
* Revert #2745

* Fix error in merge resolve

* Fix compilation
2019-06-05 11:56:36 +02:00
Pierre Krieger 9ad9f7eebd Minor sync refactoring (#2767)
* Make maintain_sync private

* Remove sync::Context::peer_info

* Print errors if sync state mismatch

* Line width
2019-06-05 09:15:54 +02:00
Pierre Krieger 9ae3082ef0 Update to libp2p 0.9 (#2783)
* Update to libp2p 0.9

* Fix browser-WASM
2019-06-04 20:11:17 +02:00
Pierre Krieger 5df89a8a6f Client::info() no longer returns a Result (#2776) 2019-06-04 16:09:46 +02:00
Pierre Krieger 4213fe15cf Split specialization context from network context (#2745)
* Split specialization context from network context

* Line width
2019-06-03 20:26:17 +02:00
Pierre Krieger 9904da17bb Add warning about secp256k1 network keys (#2764) 2019-06-03 14:48:46 +02:00
Pierre Krieger e9a4c80c40 Rewrite sync and network layers to use futures (#2683)
* Remove background thread from network

* Primarily use tokio-timer instead of tokio

* Minor style fix

* Reintroduce tokio as an optional dependency

* Renames

* Line width

* Ctxt -> Context

* Merge NetworkWorker and NetworkService
2019-05-29 11:58:02 +02:00
Pierre Krieger 643e309411 Fix compilation (#2708) 2019-05-28 18:01:20 +02:00
Pierre Krieger f329908887 Split the send_request method in multiple requests (#2696) 2019-05-28 17:13:54 +02:00
Pierre Krieger f8303a6b57 The network configuration now makes more sense (#2706)
* The network configuration now makes more sense

* Reexport ProtocolConfig
2019-05-28 16:50:36 +02:00
Pierre Krieger 3a0c52f2b1 Make RocksDB optional in client-db (#2686) 2019-05-28 15:12:55 +02:00
Pierre Krieger 165716a0fe Deprecate NetworkSpecialization::on_abort (#2697) 2019-05-28 15:07:55 +02:00
Pierre Krieger 25b88f1a1f Allow passing an optional transport to network-libp2p (#2680)
* Allow passing an optional transport

* Fix tests

* Fix Cargo.lock

* Fix Cargo.lock again?!?!
2019-05-28 12:54:02 +02:00
Pierre Krieger b10ecd7931 Peerset should never return Ready(None) (#2684) 2019-05-27 20:08:03 +02:00
Pierre Krieger e7d12e2915 Fix not connected peers being connected peers (#2692) 2019-05-27 12:01:07 +02:00
Pierre Krieger 24c08a780d Make peerset ban nodes under a reputation (#2667) 2019-05-23 20:17:58 +01:00
Pierre Krieger ff479c4e23 Rework the OnDemand service (#2670)
* Rework the OnDemand service

* Try fix line widths
2019-05-23 20:13:23 +01:00
Pierre Krieger c357854015 More extractions from the Protocol struct (#2641)
* Pass the TransactionPool explicitly

* Extract finality_proof_provider

* Remove Protocol::connected_peers

* Add note and rename function

* Fix tests

* More test fixing

* Revert the WASM locks, I guess

* Add space

* Remove space
2019-05-23 12:07:51 +02:00
Pierre Krieger dda04eef38 Remove dependency on parity-crypto (#2655) 2019-05-23 10:28:35 +01:00
Pierre Krieger d05f35f764 Make info! string less ambiguous (#2661) 2019-05-23 10:06:38 +01:00
Pierre Krieger 6431cdf601 Remove TaskExecutor from the API of the informant (#2642)
* Remove TaskExecutor from the API of the informant

* Fix node-template
2019-05-23 09:44:36 +01:00
Pierre Krieger 062b734571 Remove the NetworkChan (#2577)
* Remove the NetworkChan from the API

* Remove the NetworkChan altogether

* Address review

* Fix line widths

* More line width fixes

* Remove pub visibility from entire world

* Fix tests
2019-05-21 14:07:01 +02:00
Pierre Krieger b9c39d771a Allow warnings (#2627) 2019-05-20 17:14:02 -04:00
Pierre Krieger 85ce4623ce Update to libp2p 0.8 (#2607)
* Update to libp2p 0.8

* Fix CLI tests

* Zeroize
2019-05-20 15:47:52 +02:00
Pierre Krieger 8afbe0df59 Libp2p 0.7.1 (#2600) 2019-05-16 09:24:28 +02:00
Pierre Krieger c4e3970d9f Keep node information about disconnection (#2596)
* Keep node information about disconnection

* Fix line widths
2019-05-15 18:11:41 +02:00
Pierre Krieger 0181833f89 Randomly fuzz the PSM (#2470)
* Randomly fuzz the PSM

* Fix test

* Run it moar
2019-05-14 16:30:28 +02:00
Pierre Krieger 0d0fe6a0ea Add WebSocket addresses for bootnodes (#2578) 2019-05-14 16:30:16 +02:00
Pierre Krieger 18f7acce98 Move ProtocolMsg to service.rs (#2560)
* Move ProtocolMsg to service.rs

* Fix line width

* Fix line width again

* Correct whitespace

* Another whitespace correction
2019-05-14 14:26:52 +01:00
Pierre Krieger 5bde98e95a Increase tolerance for bandwidth usage in test (#2576) 2019-05-14 14:40:06 +02:00
Pierre Krieger 6ccdbea01c Move extra_requests.rs as a submodule of sync (#2573) 2019-05-14 12:08:01 +02:00
Pierre Krieger e5b0a98f1a Split SyncContext from protocol Context (#2550) 2019-05-13 21:16:52 +02:00
Pierre Krieger d974189e3c Make the behaviour in libp2p generic (#2525)
* Make the behaviour in libp2p generic

* Fix indentation

* Fix bad merge
2019-05-13 20:55:39 +02:00
Pierre Krieger 2724cdac33 Remove the NetworkChan from the OnDemandService (#2561) 2019-05-13 20:55:27 +02:00
Pierre Krieger 258f0835e4 Reserved peers don't occupy slots (#2546) 2019-05-13 11:02:51 +02:00
Pierre Krieger 6c41d0b3ec Isolate the code of ChainSync and turn it into a state machine (#2497)
* Move the is_offline and is_major_syncing logic to service.rs

* Move the ImportQueue to service.rs

* Remove stop() and abort()

* Add some more documentation to sync.rs
2019-05-12 19:23:45 +02:00
Pierre Krieger cbe13c459b Fix #2535 (#2540) 2019-05-11 17:36:10 +02:00
Pierre Krieger 4aa44ab280 Rewrite the PSM (#2440)
* Rewrite the PSM

* Fix disconnecting from reserved peers

* Minor adjustements

* Address review

* Reputation changes adjustements

* More adjustements

* Adjust all reputations

* More fixes and adjustments

* Improve proof

* Remove the possible panic

* Make sure reputation reaches 0
2019-05-10 14:08:42 +02:00
Pierre Krieger 099ff629b6 Add some benchmarks for ed25519 in substrate_primitives (#2520)
* Add some benchmarks for ed25519

* We don't need the Debug impl

* Add multiple message sizes
2019-05-09 17:58:45 +01:00
Pierre KriegerandSergei Pepyakin cad1f19d48 Make more crates compile for WASM browser (#2524)
* Make more crates compile for WASM browser

* More crates

* Update .gitlab-ci.yml

Co-Authored-By: Sergei Pepyakin <s.pepyakin@gmail.com>
2019-05-09 17:41:50 +01:00
Pierre Krieger d4eb3ec747 Replace ring with ed25519-dalek in primitives (#2415) 2019-05-09 16:24:56 +02:00
Pierre Krieger c3f20bf226 Merge the protocol thread with the network thread (#2475)
* Remove the Incoming enum

* Use tokio in the protocol background thread

* Some internal protocol logic simplifications

* Merge the protocol thread with the network thread

* More the status_sinks logic to Service

* Remove FromNetworkMsg
2019-05-08 13:49:29 +02:00
Pierre Krieger 2dea51cd3b Add some crate-level documentation to network-libp2p (#2483) 2019-05-06 13:10:37 +02:00
Pierre Krieger 3935b247dd Move construct_simple_protocol! to appropriate module (#2476) 2019-05-06 09:37:25 +02:00
Pierre Krieger 82cb52a400 Show more information when too many addresses are reported (#2473)
* Show more information when too many addresses are reported

* Update core/network-libp2p/src/behaviour.rs

Co-Authored-By: tomaka <pierre.krieger1708@gmail.com>
2019-05-06 09:32:35 +02:00
Pierre Krieger 5a820db7f5 Remove the dependency on heapsize (#2459)
* Remove heapsize dependency

* Finish removing heapsize

* Revert accidental change

* Fix Cargo.lock
2019-05-04 13:59:59 +02:00
Pierre Krieger 35b84ae8f6 Remove NetworkService::report_handle (#2462) 2019-05-04 13:58:52 +02:00
Pierre Krieger 747df1f332 Disable mDNS when passing --dev (#2467) 2019-05-04 13:58:06 +02:00
Pierre Krieger 8ca343ca8c Add reputation system to network crate (#2454) 2019-05-04 13:51:06 +02:00
Pierre Krieger 6921b2ce3d tokio -> tokio-timer in consensus (#2460) 2019-05-03 16:00:47 +02:00
Pierre Krieger 52472238bd Drop connections when the handler gets disabled (#2439)
* Drop connections when the handler gets disabled

* Add test
2019-05-02 21:03:04 +02:00
Pierre Krieger 586dce10ed Simplify the code of connection_keep_alive (#2438) 2019-05-02 20:32:05 +02:00
Pierre Krieger 3c42e6d4f0 Try run check-web-wasm for PRs (#2424) 2019-05-01 09:47:51 +02:00
Pierre Krieger dbff5c4962 Add reason for closing and fix multiple substreams (#2437) 2019-05-01 09:42:54 +02:00
Pierre Krieger f14580535e Depreate functions that spawn a thread (#2418)
* Depreate functions that spawn a thread

* Bump versions
2019-04-30 09:33:19 +02:00
Pierre Krieger 8b7258f850 Simplify the network background thread future (#2419) 2019-04-29 18:57:12 +02:00
Pierre Krieger 0b6490854d Make libp2p compile for wasm32-unkown-unknown (#2412)
* Make libp2p compile for wasm32-unkown-unknown

* Fix tests

* Add some crates
2019-04-29 16:07:40 +02:00
Pierre Krieger ebbd6c8ec4 Split Context::send_message into multiple methods (#2409)
* Split Context::send_message into multiple methods

* Apply suggestions from code review

Co-Authored-By: tomaka <pierre.krieger1708@gmail.com>
2019-04-29 13:54:19 +02:00
Pierre Krieger 9d7a72027c Fix #2403 (#2404)
* Fix #2403

* Apply suggestions from code review

Co-Authored-By: tomaka <pierre.krieger1708@gmail.com>
2019-04-29 12:05:20 +02:00
Pierre Krieger 48d53a35b7 Allow multiple substreams (#2379)
* Allow multiple substreams

* Update core/network-libp2p/src/custom_proto/handler.rs

Co-Authored-By: tomaka <pierre.krieger1708@gmail.com>
2019-04-27 16:33:42 +02:00
Pierre Krieger f3df7250e9 Remove the multiplexed networking system (#2373)
* Remove the multiplexed networking system

* Rename BackCompat to Normal

* Remove CustomMessageId

* Fix tests
2019-04-25 11:39:57 +02:00
Pierre Krieger 5b3e31266b Silence the spam a little bit (#2362) 2019-04-24 11:58:08 +02:00
Pierre Krieger 3f06fe32f3 Update to libp2p v0.7.0 (#2343)
* Update to libp2p master

* Fix tests

* More tests fixing
2019-04-23 18:46:30 +01:00
Pierre Krieger b483c5608f ProtocolId can now be more than 3 bytes (#2350) 2019-04-23 17:15:21 +01:00
Pierre Krieger 648dcc2728 Add warnings about breaking changes in network (#2348) 2019-04-23 16:34:47 +02:00
Pierre Krieger 0ae060d4d1 Use ed25519 by default for network keys (#2290) 2019-04-17 12:03:00 +02:00
Pierre Krieger e57e54ab9c Add warning when using default protocol ID (#2234)
* Add warning when using default protocol ID

* Update core/service/src/lib.rs
2019-04-09 10:30:43 +02:00
Pierre Krieger decddaab0f Fix state inconsistency between handler and behaviour (#2220)
* Fix state inconsistency between handler and behaviour

* Fix the error! being in the wrong place
2019-04-05 19:07:09 +02:00
Pierre Krieger e89ce263bd Minor logging improvements in libp2p (#2162) 2019-04-02 09:38:44 +02:00
Pierre Krieger 3dfda381d5 Add support for mDNS (#2153)
* Use libp2p 0.6.0 instead of a custom branch

* Add support for mDNS

* Fix tests

* Nit
2019-03-31 19:47:15 -04:00
Pierre Krieger d4a4022dd1 Use libp2p 0.6.0 instead of a custom branch (#2150) 2019-03-30 20:53:20 +00:00
Pierre Krieger a9420424b2 Improvements to system_networkState (#2088) 2019-03-26 14:45:11 +01:00
Pierre Krieger 4fe70ee639 Forgot to handle Banned in inject_connected (#2107)
* Forgot to handle Banned in inject_connected

* Also add debug for the state
2019-03-25 14:48:43 +01:00
Pierre Krieger 44db5f44e3 Directly connect if notice that ban has expired (#2100) 2019-03-24 11:49:38 +01:00
Pierre Krieger b6c54b5c40 Always accept incoming connections (#2101) 2019-03-24 11:48:53 +01:00
Pierre Krieger a1f3b0b529 Fix hardcoded values in the PSM config (#2103) 2019-03-24 11:29:45 +01:00
Pierre Krieger 3ba7442dca Properly distinguish in/out connections in the PSM (#2102) 2019-03-24 11:29:29 +01:00
Pierre Krieger 418edcfbac Don't print dozens of the times the handler init warning (#2089) 2019-03-23 12:44:35 +01:00
Pierre Krieger 6e394464b8 Replace NodeIndex with PeerId everywhere (#2077)
* Replace NodeIndex with PeerId

* Fix tests

* More test fixing

* Whitespace
2019-03-23 10:34:28 +01:00
Pierre Krieger 7469713dea Fix #2073 (#2087) 2019-03-22 18:21:24 +01:00
Pierre Krieger b712795aa2 Fix #1777 (#2072) 2019-03-21 16:49:21 +01:00
Pierre Krieger 90c6f85db5 Add a substrate-peerset crate (#2042)
* Add a substrate-peerset crate

* Some adjustements

* More adjustements

* Use a temporary libp2p branch

* Add back-off mechanism

* Fix RPC tests

* Some adjustements

* Another libp2p bugfix

* Do a round-robin in the peerset

* Use a real dependency instead of a patch for libp2p

* Initialize reserved nodes correctly

* Better diagnostic for no address

* Don't allocate slots if in reserved only

* Ban node on dial failure

* Fix indentation
2019-03-21 14:02:28 +01:00
Pierre Krieger b5957a6aa2 Show the remote PeerId in the handler's logs (#2057) 2019-03-20 17:18:53 +01:00
Pierre Krieger 98a88a7d42 Start the handler init timer later (#2041) 2019-03-20 09:29:58 +01:00
Pierre Krieger 002143d0a2 Remove support for multiple network protocols (#2005)
* Remove support multiple network protocols

* Address concerns

* Add back debug_asserts
2019-03-19 11:56:56 +01:00
Pierre Krieger 35a67b31e5 Add a 16MiB hard limit to Substrate packets (#2009) 2019-03-15 14:52:22 +01:00
Pierre Krieger e91426ac77 Add a warning when banning or dropping reserved peers (#1976) 2019-03-12 15:43:22 +01:00
Pierre Krieger ead437d0f4 Remove dialing without a PeerId 2019-03-12 11:47:08 +01:00