Network IO handling -- load balancing
All inputs and outputs currently traverse Clockwork's controller, making it a trivial bottleneck beyond a few workers.
We should remove this fundamental limitation as soon as possible. A simple solution would be a tier of load balancers that receive requests, while only forwarding request metadata to the controller.
We would need to ensure that client requests are well distributed across load balancers.
We would need to think about what network bottlenecks the controller should be aware of in this design.