Kafka Master Engineer (Architect)

Compare your skills with our requirements

We are migrating from RabbitMQ to Kafka, which will become the backbone of our trading and data infrastructure. This role is for a hands-on Kafka expert with real-world experience in designing, implementing, and operating high-load, mission-critical systems.

You should be someone who has already navigated the pitfalls of large-scale production deployments and can ensure zero data loss, zero downtime, and strong ordering/consistency guarantees.

Must-have

7+ years of hands-on experience with Kafka in production (not just theoretical knowledge).
Proven track record of designing clusters for very high throughput & low latency.
Deep understanding of Kafka internals (replication, partitioning, ISR management, broker tuning, retention policies).
Experience mitigating real-world issues (GC pauses, Zookeeper/KRaft quirks, producer/consumer tuning, cross-DC replication).
Strong expertise in performance optimization and resilience engineering.
Solid background in monitoring, alerting, and troubleshooting Kafka under extreme load.

Is a plus

Knowledge of RabbitMQ to assist with migration strategy.
Experience with financial-grade, real-time streaming systems.
Familiarity with C++, Java, Python, PHP, or Go (though this role is Kafka-focused).
Exposure to BI, payments, and order processing pipelines.

What you will do

Architect and lead the migration from RabbitMQ to Kafka.
Design and deploy Kafka clusters for trade order processing, price feeds, payments, BI, and real-time data streams.
Define hardware, storage, and networking configurations tailored for high reliability and low latency.
Establish policies and best practices for replication, partitioning, consistency, and fault tolerance.
Implement monitoring, alerting, and automated recovery mechanisms.
Mentor internal teams and ensure operational excellence during and after migration.
Challenge assumptions and propose pragmatic, battle-tested solutions for production environments.

The Kafka Master Engineer (Architect) position is archived.

We appreciate your interest in joining Hatom. However, this position is no longer accepting new applications as it has been archived. Please explore our other open roles or check back soon for future opportunities.