Kafka Administrator - IT Infrastructure Services

Role Overview :

We are seeking a seasoned Kafka Administrator to join our infrastructure team in Bangalore, tasked with architecting, scaling, and maintaining high-throughput messaging platforms. In this role, you will serve as the primary custodian of our event-streaming ecosystem, ensuring seamless data flow across distributed systems. You will collaborate closely with platform engineering teams, data architects, and product stakeholders to optimize cluster performance and ensure 99.99% availability. Your work will directly influence the reliability of our real-time data pipelines, enabling the business to derive actionable insights and deliver superior experiences to our global customer base.

Key Responsibilities :

- Design and manage large-scale Kafka clusters to ensure high availability, fault tolerance, and optimal throughput for mission-critical applications.

- Configure and maintain Kafka Connect pipelines to facilitate seamless data integration between heterogeneous source and sink systems.

- Implement and manage MirrorMaker configurations to support robust cross-datacenter replication and disaster recovery strategies.

- Monitor cluster health, identify performance bottlenecks, and execute proactive tuning to maintain low-latency data processing.

- Collaborate with cross-functional development teams to define best practices for topic management, partition strategies, and consumer group optimization.

Required Skillset :

- Demonstrated expertise in managing and scaling Apache Kafka environments within complex, high-traffic enterprise architectures.

- Proven ability to troubleshoot intricate cluster issues, including broker failures, network latency, and consumer lag, ensuring minimal downtime.

- Strong proficiency in automating administrative tasks and infrastructure provisioning using scripting languages or configuration management tools.

- Exceptional communication skills, with the ability to translate complex technical requirements into actionable infrastructure roadmaps for stakeholders.

- A Bachelor's or Master's degree in Computer Science or a related field, complemented by a track record of delivering stable, scalable distributed systems.

- Ability to thrive in a hybrid work environment, demonstrating self-motivation and the capacity to lead technical initiatives independently while working from our Bangalore office.

Skills

Kafka, Distributed Systems, Troubleshooting, IT Infrastructure, Message Broker, Cluster Management