{"id":3954108,"url":"https://alion.io/job/code-vyasa-confluent-kafka-developer","title":"Confluent Kafka Developer","company":{"id":5506,"name":"Code Vyasa","domain":"codevyasa.com","url":"https://alion.io/company/code-vyasa","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Mumbai, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Kafka","optional":false},{"name":"Grafana","optional":false},{"name":"Linux","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"Splunk","optional":false},{"name":"ZooKeeper","optional":false}],"status":"live","first_seen_at":"2026-11-09T06:35:30Z","employer_posted_date":null,"last_verified_at":"2026-11-09T06:35:30Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"Job description:\n\nWe are looking for an experienced Confluent Kafka Developer having 8+ years of experience.\n\nKey Responsibilities:\nCluster Architecture & Solutioning: Design, architect, and optimize Confluent Kafka clusters stretched across four geographically distributed data centers. Define topic architecture, partitioning strategy, replication factor, and rack-awareness configurations. Provide solutioning inputs, capacity planning, and sizing for current and projected TPS loads. Collaborate with enterprise architects and application teams on event-driven and streaming solutions.\nDeployment & Configuration: Lead end-to-end deployment of Confluent Kafka components (Brokers, Zookeeper/KRaft, Schema Registry, Kafka Connect, ksqlDB, REST Proxy, Control Center, and MirrorMaker/Cluster Linking). Manage cluster upgrades, patching, and version migrations with minimal downtime. Implement security configurations (SSL/TLS, SASL/Kerberos, ACLs, RBAC). Configure and manage multi-DC replication strategies.\nProduction Support & Troubleshooting (L3): Act as the highest level of technical escalation (L3) for production incidents, providing RCA and permanent fixes. Monitor and manage an environment supporting ~4.5 crore accounts with a throughput of 5,000-10,000 TPS. Troubleshoot broker failures, ISR issues, consumer lag, partition rebalancing, and replication issues. Perform deep-dive performance tuning (JVM, OS, network, producer/consumer). Drive proactive capacity planning.\nMonitoring & Operations: Set up and manage monitoring, alerting, and observability using Confluent Control Center, Prometheus, Grafana, and Splunk/ELK. Track operational metrics like broker health, under-replicated partitions, consumer lag, latency, and throughput. Ensure adherence to banking regulatory, audit, and compliance requirements. Participate in DR drills, BCP, and periodic failover testing.\nEcosystem & Integration Knowledge: Demonstrate strong understanding of the surrounding banking ecosystem (core banking systems, payment gateways/switches, NPCI/RTGS/NEFT/IMPS/UPI rails, fraud engines, reconciliation systems). Partner with cross-functional teams to resolve issues impacting Kafka pipelines. Support integration via Kafka Connect, custom producers/consumers, and stream processing frameworks.\nDocumentation & Governance: Create and maintain runbooks, SOPs, architecture diagrams, and knowledge base articles. Enforce platform best practices and governance. Mentor L1/L2 support engineers.\n\nRequired Skills & Qualifications:\nTechnical Skills: 8-10 years total IT experience; minimum 4-5 years of dedicated Kafka/Confluent Platform experience. Hands-on expertise with Confluent Platform components. Proven experience managing stretched/multi-DC Kafka clusters and cross-DC replication. Strong understanding of Kafka internals, performance tuning, capacity planning, and troubleshooting. Working knowledge of Linux administration, networking fundamentals, and scripting (Shell/Python). Familiarity with security implementations (TLS/SSL, SASL, Kerberos, ACLs, RBAC) and monitoring tools. Exposure to stream processing frameworks is a plus.\nDomain Skills: Prior experience in banking/payments/fintech environments with an understanding of core banking, payment processing, and settlement/reconciliation workflows. Familiarity with regulatory and compliance requirements (RBI guidelines, data security standards, audit trails). Understanding of the broader banking technology ecosystem.\nSoft Skills: Strong analytical and problem-solving skills under pressure (P1/P2 situations). Excellent communication skills. Ability to lead RCA discussions and drive permanent fixes. Willingness to participate in on-call rotations.\nSkills\nACLs, Confluent, KRaft, Kafka, Kafka Connect, Kerberos, SASL, SSL, Schema Registry, TLS, Zookeeper, ksqlDB","description_format":"text","description_chars":3834,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Mobile App Development Services","Custom Software Development","IT Staffing & Staff Augmentation"],"lifecycle":[{"event":"open","at":"2026-11-09T06:35:30Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":29,"reasons":["seen:0","win:early"],"computed_at":"2026-11-09T09:21:23Z"},"pay":null,"html_url":"https://alion.io/job/code-vyasa-confluent-kafka-developer","json_url":"https://alion.io/job/code-vyasa-confluent-kafka-developer.json","meta":{"generated_at":"2026-11-09T09:21:23Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":8819,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-10T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5506},"rest":"https://alion.io/mcp/rest/get_company?id=5506"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcode-vyasa-confluent-kafka-developer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcode-vyasa-confluent-kafka-developer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcode-vyasa-confluent-kafka-developer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/code-vyasa-confluent-kafka-developer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcode-vyasa-confluent-kafka-developer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3954108}},{"tool":"search_jobs","arguments":{"company":"codevyasa.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3954108},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}