Broker-Visible vs Client-Local Parallelism
Summary
The article examines broker-visible vs. client-local parallelism in Kafka, arguing that parallelism can be managed on the client side to reduce broker load. It introduces a simple aggregate parallelism formula and uses workload examples to show how many parallel units may be required, with takeaway guidance on when to prefer client-side parallelism over broker-managed approaches.