Tweak docker(compose) files (can't test them yet) and add a little backend documentation

backend/.dockerignore

@@ -1,3 +1,3 @@
 target
-Dockerfile
+*.Dockerfile
 .git

backend/README.md

@@ -0,0 +1,18 @@
+# Backend Crates
+
+This folder contains the rust crates and documentation specific to the telemetry backend. A description of the folders:
+
+- [telemetry](./telemetry): The Telemetry Core. This aggregates data received from shards and allows UI feeds to connect and receive this information.
+- [shard](./shard): A Shard. It's expected that multiple of these will run. Nodes will connect to Shard instances and send JSON telemetry to them, and Shard instances will each connect to the Telemetry Core and relay on relevant data to it.
+- [common](./common): common code shared between the telemetry shard and core
+- [docs](./docs): Material supporting the documentation lives here
+
+# Architecture
+
+As we move to a sharded version of this telemetry server, this set of architecture diagrams may be useful in helping to understand the current setup (middle diagram), previous setup (first diagram) and possible future setup if we need to scale further (last diagram):
+
+![Architecture Diagram](./docs/architecture.svg)
+
+# Deployment
+
+A `shard.Dockerfile` and `telemetry.Dockerfile` exist to build the Shard and Telemetry Core binaries into docker containers. A `socker-compose.yaml` in the root of the repository can serve as an example of these services, along with the UI, running together.

backend/docs/architecture.svg

@@ -0,0 +1,3 @@
+<?xml version="1.0" encoding="UTF-8"?>
+<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN" "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd">
+<svg xmlns="http://www.w3.org/2000/svg" style="background-color: rgb(255, 255, 255);" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="827px" height="2569px" viewBox="-0.5 -0.5 827 2569" content="&lt;mxfile host=&quot;app.diagrams.net&quot; modified=&quot;2021-07-05T09:23:48.973Z&quot; agent=&quot;5.0 (Macintosh)&quot; etag=&quot;GQ4pBLNcUn__SJvbHp3q&quot; version=&quot;14.8.3&quot; type=&quot;device&quot;&gt;&lt;diagram id=&quot;ib34fVOXFVp8dovNSkbX&quot; name=&quot;Page-1&quot;&gt;7V1bk5s4Fv41rk0e0mWBDfhx0jOZ3a2ZzOwmVZl5xCC3VY3BC7jdya9fXUFI2MZuQHK35yHTlrFAR9+5SDrnY+Leb55/zcPt+vcshsnEmcbPE/fnieMAJwjw/0jLd94yDWas5SFHMW+rG76gH1BcyFt3KIZF48Iyy5ISbZuNUZamMCobbWGeZ/vmZassad51Gz5AreFLFCZ66zcUl2vWGjh+3f5PiB7W/M7O3FuwbzahuJiPpFiHcbaXmtxfJu59nmUl+2vzfA8TIj0hF/a7Twe+rR4sh2nZ5Qdffyuh82XrPH+OovI/P9BfCP33g8vn5ylMdnzE/GnL70IEebZLY0h6mU7cj/s1KuGXbRiRb/d41nHbutwk+BPAf65QktxnSZbT37pxCINVhNuLMs8eofgmzVL884/6EPionmBewmepiQ/pV5htYJl/x5eIb6dcvAJgAf+8r2drNudta3mmBMJCjpCHqu9aiPgPLsczZDrXRPoVJlA8932WwyMiBqdF3IPUHK8pNUfgWZIa8FqkBgaTmqdJ7RPEEnGmwLi0gNuU1ixwNGkFLcKaDyUr/5CsjinvSMhyLJOVbuC4rFzjsnKBZbJatDgDL8F3/RijJ/znA/mTi++z+GqZi29EC763dL1xMc9mlolZTPsxpwvT+CcSvuBPURIWBYqacoHPqPyLuOS7Of/0t/TNz8/cW9MP38WHFD/9X/KHv+UP9Y/oJ/GrogzzUjwLd9y07RMiw6bXHJylItvlETwmC4453OEDLE97VRg34jV90qVJbXP7oi2HSViip2aU1zbT/A5/ZggPrXYJvhJ2CAcqumAD57+So7ITHTmu0hETjNYRBV417BdgUaiTMSzeOXOL4Di/Sjiq8dzFcHRUOHr+3VT6zxkXnI5xcPo2gdO7SnC6s8XdQvov6AmqgQJV3yhUXcNQBRbh1L9KnM78YXC6UHAaGMWpvjvxOYst2JGYN6XUso0zboyu70dYISd3Zpmc9L0IK+Q0cy2Tk762tkJOwLNLTm4ffrQO3y6P3uqeZcfYcNOdnfTlrrTrcsSzypOqoZnr9bQ6do0uR9zZ9WCTr6otgadvFzxVVPleW+B3NlgV1M8WI8NTD+3shadN6AzsQqdqPIN+0KksQ+ZjG089oLYVncAibC7swqYCInfRCzYd5RB/DsbF5qxtE1w7+Op+4KX9lIT6xaTOUiFJLOSfNST/StkBYRznsCCXhmnMrkB5/UOUpWQs5Hu8UCjpQdyBniKaZzDd5lmEO7zr/KgvGOVX+hDNG1MFxy109OsQpR+KLYzQCisg+SYs8bX31XDpoMilG/zT8IH+KY0Poxc+hRQ5tC/x7W4b047wZWFZ98s7LSD9H7uo6nEFYUyfbrcsohwtZVmG1R1Gkdsn9VHEk9BHqMEQUsG2TXyLYMIIi11clcMIEq2XpbDKsw0BU3n3gkcf5aeKl8Ar27LpF1qTi+RMJLHFiVfSKH3ADfP609cMr6p//uAcSm7K8GJ6lVDXsUZxDFPc1kyJWmVpyTPXwFGv0H1ZPlc3Daf6urxKtWgk6HhDrcxn+k7Pv7/88bnH6QkT9JASD43lBnH7RyIvFIXJT/yLDZY/uU3rPB2ck6CnHaW515iSKqCSM83aEs0Gm5AT6RrSpHj/25E0QyqVDwUVy0/4gmD7zNSOfy1Ujs3rVNbQyzvrYBAu7/xdlG0wDIjhW2X5JizfD/vQbxTrM3FscGJb0JkPhHURv7ZgnYy+y1QDD8/1wYleKkHMLqfiI043IhMQlTvifY+4rGVLG3u2NwYeoBzluLqddFvBM1hCboccl6tKcg5aooHWJOfZYNHA3NFk+mUd5iQutS9hdzHT05tHPdWY66caQlrHoGgmZde8tPR9diEt+5J2zUtL3/YV0tKDc9O5t+alpW9DWl+dAYD58oz5wZoD+8w9cIV3Moayg1UH9pl7C6SlL2StrdEwLy2h96+8SsMCQRtPjZ/0f8Z1cKZOn1jx0Z/O6rQrGQWo9g7Me8pGwd523GINT190jYzIlxRrDAJK90pBqRzy4xV+TxUbALgmc6Q803nww6QGvAChsytF6EJFKOipUAOAmVGE9pHFZ6ZSYxB8dq54swufas4ImPZVoEECBJP4tLVCQwnQ/ZZ9/XHjc1tLNFzbBGVrjYZjm6D0bRsrBKWeqJkXVFvqwbhRHsCBlexH70gEfdyX0k9/whxhIZBj0xemcAq0nM5+n1rlOefqlpa2a9x5QawocOAqHQ3sKoVgJRj+loUxblmGSZhGeJKNq65ahzbTVdddjKm7vvFtrTsPBLLufsDK64ytvF1r6S1TXkdR3ioV4OyoF2Cpz6Xc7XmzX296587rGFh50KEV2zGO0WA2M47RrnX0N4yawKj5nS43mKsY9UaGaOcKQMsgquxJ+cGFEFXPBwM1i21oFPa6m3VG0eilG66XY01A6PRO1cwurCk7Vf7iUnM4PW4O50bNYR/VpyNu/I+BQ8cuHL4Nt9xHnWmFQ/91ANEuoiU1Aym4dP8Bd3QUiL5RIOq7ri8Aoud4MhLxsP1B0Eg66S887I5Q1y6Eqrs2alTXGaHucYQGRhHagfzdkpL8Ubh2OtMrWkZnop6vaxyyFyc4OUZzSfw+ThleF99OZ4haxmmiAWs2COUOcL1xISrufxUQtQuhljGbaEZ0PgjtDnD9kRHax3HPK+Ld6YpPkWZvCz5VHDneINQ7wA1Gxqej4fMxKDSI2lEsfRB3ZzB7qKfvVbRmikciaDvIuCr2IzLR+N9V1Wn4FKIkXCbk74IUQxICpOkfqdLXPfsBuTUnCaoJAorvRQk39Q/I3WryAJmgaEV5dmAYrWk/pXiUlKYOTVHKmCnY0/Pb7VGxFk/Pb41HJA88pfjHhpJfQXhrZPqecMl+wNmKyM3OIPLpTbuul1LHFwp1ilJHPRrqT/Hazm76VLw/qF7sQyIFCtIwzTC0cob8PfwHwVqCHivCqRjheUfLXcmAG2UbBrtaaSj0ojxjzF6VagkV3yM6bCZ4QT1VqT0jpiIqA/cU1vgrynyFVrVqMJYr/CSV4t1wfQ6ug5bkwFZcD8YNEbQdBfWJa1rfXkxkXjNOWSR7E05wRiwjxehX7k02nDkuLB6FO2HghwXMEQ4XflD0lzIxHbfRYZJRfZD8l149jt1RQj5hSx3WBhpRcrYwl4036R/HIFnOtExwuRWEkm36r5J++FA9VPWgpNcNu5VKf4T/eLckihtLLDbJ9/fVMzM/SweDdRttUEEuXOIWBpfG2AiV3035zlG+RUsw1+5U3KGUr+38awSWx0cItxSheRg9ThrRmKBjpE1SOMVUkwlBjZMwsGHBXUathss8C+MoLEqm/BXpYR0W8aCoYnikmrRiliGpfZa4po7pNtTpHYjwJEtC5pZFZ8STwsphlVlGbUv6XboyEw6PszLeV464bmMX4eUaNUH05wkqylGYJ5lk1qhom9EYwToUJ1YJB6MFG0MlRO7v8cxFUBq35vnDFVl7SW1ItaPs9rRziYSzGZ2LiJfZ8XNjdfIYD2NxelLJhkJUk7Y1TJIVZbUGqScghxtsyqjkqWwf02yf0F0IaV1RNAc7fUKSq+G3PEdtGgpzs/ed7T2YBjozXqvBd9Rsi/4sfttB8xD8tMzQLclLtWFe1Hhbh09QweMRUmJikUWPD5Avb8n/lmFBWYGbjqBe58KJxIjLbw2fUdEI1PjKuWRyayjWXuL1rU3LnqkCW4k3CHh5zFh3cMDFodpKEjvVynQsORMeHdIbIrIlhS0rldlN/c5XP3fmdFM/dX+0P+3TD9GrANzKPcwRmHGnnr4EHXdLUz85fltcxQqD2AIYnhChtzeu4htX8dDWx2kJyUYlK14cfp3EIGTFKd1NbRIVT99JyyOyHpDXRO8lyNxoiw8UWXvGeYvF+6NeDW8x8LsSF89ngwn1MBWvhUyWgWm+1MVhLt5jYDREZWleXIfJeC3ksjQvLn2z2l7uYgvEpe/0WEderJmwxaKFvLhtiS4KavsX20E2XvssvuO6+o7GuCA7yMZrn8E3L60qxLkG8mIbxHV4bfSa2IttkHSH1YNNBbmDMx2KyP/0Ozftqu9RWZacaV8Exo7GOjtwsi+Y6quvNw7KrvSwtoFSrZdY9EVgjB2nyaIzMDXND2sdRLtyvADXriperfZm0ReFsTM1SmEMpldGtjE8RruW9QDXbnIYsOiLxlgPEwZHpaWEvCpzMWjb2h85OLeUklflLrZBVJaS8qrsxTaISt+6sUJU6tGaBaISOyNvmsG4AsxptwmAVW5TraJ0pn1xGAN/ZBLjSrRXxGIMfOM0xgA4xjXYAh7jKpK4OhVW6ejq5ICe+eiAb5SQDgDze14WkBlXcdwNqNYC1fzOl3lG42oVe304Vbdkvb5IjYGv5rgNDsVeN7ispjWuYHT6CMAyGk9168obiNgY+EaZjQHolVL2lWDRrq3+t+Oje2WVtZre+AwwenaBUdtSGIjgGPhGGY4B6INALine truncated

backend/shard.Dockerfile

@@ -0,0 +1,24 @@
+FROM paritytech/ci-linux:production as builder
+
+ARG PROFILE=release
+WORKDIR /app
+
+COPY . .
+
+RUN cargo build --${PROFILE} --bins
+
+# MAIN IMAGE FOR PEOPLE TO PULL --- small one#
+FROM debian:buster-slim
+LABEL maintainer="Parity Technologies"
+LABEL description="Polkadot Telemetry backend shard, static build"
+
+ARG PROFILE=release
+WORKDIR /usr/local/bin
+
+COPY --from=builder /etc/ssl/certs/ca-certificates.crt /etc/ssl/certs/
+COPY --from=builder /app/target/$PROFILE/shard /usr/local/bin
+RUN apt-get -y update && apt-get -y install openssl && apt-get autoremove -y && apt-get clean && rm -rf /var/lib/apt/lists/
+
+EXPOSE 8000
+
+ENTRYPOINT ["shard"]

backend/telemetry.Dockerfile

@@ -10,7 +10,7 @@ RUN cargo build --${PROFILE} --bins
 # MAIN IMAGE FOR PEOPLE TO PULL --- small one#
 FROM debian:buster-slim
 LABEL maintainer="Parity Technologies"
-LABEL description="Polkadot Telemetry backend, static build"
+LABEL description="Polkadot Telemetry backend core, static build"
 
 ARG PROFILE=release
 WORKDIR /usr/local/bin