Kafka vs RedPanda Benchmark (also Tarantool and Clickhouse as queue)

  1. the benchmark has locking (atomic counters, sync.Map, etc), so consumer might not utilize whole CPU cores.
  2. confluent’s kafka docker always error when starting because /var/lib/kafka/data not writable, so I bind on /var/lib/kafka instead. Clickhouse also always failed to start when bind to /var/lib/clickhouse/data, so I don’t bind volume for Clickhouse.
  3. RedPanda failed to start when fs.aio-max-nr even when it’s already ~1 million (originally only 64K), so I set it to 4194304

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store