{"id":1642789,"url":"https://alion.io/job/coupang-staff-backend-engineer-k8-envoy-2","title":"Staff Backend Engineer - K8 (Envoy)","company":{"id":239,"name":"Coupang","domain":"coupang.com","url":"https://alion.io/company/coupang","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":83,"open_postings":105,"ghost_share":0.086,"stale_share":0.181,"repost_share":0.124,"time_to_fill_p50_days":71,"computed_at":"2026-11-03T05:54:40Z"}},"role":"Backend","role_family":"Backend","seniority":"staff","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":39000,"max_usd":96000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":26},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Kafka","optional":false},{"name":"ArgoCD","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Envoy","optional":false},{"name":"GCP","optional":false},{"name":"Go","optional":false},{"name":"gRPC","optional":false},{"name":"Istio","optional":false},{"name":"Java","optional":false},{"name":"KServe","optional":false},{"name":"Kubeflow","optional":false},{"name":"Kubernetes","optional":false},{"name":"Linkerd","optional":false},{"name":"LLM","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Ray","optional":false},{"name":"Redis","optional":false},{"name":"SGLang","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"Triton","optional":false},{"name":"vLLM","optional":false},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-09-22T08:50:35Z","employer_posted_date":"2026-10-23","last_verified_at":"2026-11-03T09:28:15Z","board_verified":true,"closed_at":null,"days_open":42,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":42},"description":"Company Introduction :\nWe exist to wow our customers. We know we’re doing the right thing when we hear our customers say, “How did I ever live without Coupang?” Born out of an obsession to make shopping, eating, and living easier than ever, we’re collectively disrupting the multi-billion-dollar e-commerce industry from the ground up. We are one of the fastest-growing e-commerce companies that established an unparalleled reputation for being a dominant and reliable force in South Korean commerce.\nWe are proud to have the best of both worlds - a startup culture with the resources of a large global public company. This fuels us to continue our growth and launch new services at the speed we have been since our inception. We are all entrepreneurs surrounded by opportunities to drive new initiatives and innovations. At our core, we are bold and ambitious people that like to get our hands dirty and make a hands-on impact. At Coupang, you will see yourself, your colleagues, your team, and the company grow every day.\nOur mission to build the future of commerce is real. We push the boundaries of what’s possible to solve problems and break traditional tradeoffs. Join Coupang now to create an epic experience in this always-on, high-tech, and hyper-connected world.\nRole Overview :\nAs a Staff Backend Engineer, you will work closely with platform and product leaders to design and deliver solutions for complex infrastructure problems. You will drive the development of highly scalable, reliable, and efficient platform services while providing technical direction across teams working with Java, AWS, Kafka, Kubernetes, Kubeflow, Argo CD, and gRPC.\nWhat You Will Do :\nArchitect and build Coupang's next-generation AI Inference Gateway platform that serves mission-critical machine learning and generative AI workloads at scale.\nDesign and develop high-performance request routing, model endpoint abstraction, traffic shaping, load balancing, failover, caching, and policy enforcement mechanisms for inference services.\nDrive the technical vision and roadmap for scalable, secure, and reliable AI inference infrastructure across cloud and on-prem environments.\nDevelop critical infrastructure components in Go, Java, or Python with a strong focus on performance, resiliency, and operational excellence.\nDesign multi-tenant platform capabilities including authentication, authorization, quota management, cost attribution, rate limiting, and governance controls.\nPartner closely with ML Platform, Model Serving, Data, and Product Engineering teams to enable seamless deployment and operation of AI workloads.\nLead architecture and design reviews, raise engineering standards, and mentor senior engineers across multiple teams.\nOptimize system performance, latency, throughput, and infrastructure efficiency for large-scale inference workloads.\nDefine observability standards through metrics, tracing, logging, and SLO-based operations for business-critical AI services.\nInvestigate complex production issues, drive root-cause analysis, and implement long-term architectural solutions.\nCollaborate with engineering leaders across Coupang to establish common platform standards and unlock AI innovation across the organization.\nBasic Qualifications:\n8+ years of professional software development experience.\n5+ years of experience designing and operating large-scale distributed systems in production.\nStrong hands-on programming expertise in one or more of Go, Java, or Python.\nProven track record of building highly available, mission-critical platform or infrastructure services.\nExperience designing API platforms, service gateways, service mesh, or large-scale networking infrastructure.\nDeep understanding of microservices architecture, distributed systems design, and cloud-native technologies.\nExperience with Kubernetes and containerized workloads in production environments.\nExperience operating services on AWS, Azure, or GCP.\nStrong understanding of observability, reliability engineering, capacity planning, and production operations.\nPreferred Qualifications:\nExperience building AI/ML inference platforms, LLM gateways, model serving infrastructure, or GPU-accelerated workloads.\nDeep expertise in Kubernetes ecosystem technologies such as Gateway API, Ingress Controllers, Service Mesh (Istio, Linkerd, Envoy), and platform networking.\nExperience with inference serving frameworks such as vLLM, Triton Inference Server, TensorRT-LLM, Ray Serve, KServe, SGLang, or similar technologies.\nStrong understanding of high-performance networking, gRPC, HTTP/2, streaming protocols, API gateways, and service proxy architectures.\nExperience designing large-scale traffic management systems including routing, retries, circuit breaking, rate limiting, and request prioritization.\nExperience optimizing latency, throughput, and resource utilization for CPU and GPU workloads.\nFamiliarity with GenAI and LLM ecosystems including model deployment, prompt routing, RAG systems, model observability, and AI governance.\nExperience with distributed data systems such as Kafka, Cassandra, Redis, MongoDB, or similar technologies.\nStrong understanding of concurrency, synchronization, asynchronous programming, and non-blocking I/O.\nType of work model :\nHybrid /Onsite / Remote working\nOur Hybrid work model: Coupang hybrid work model is designed to enable a culture of collaboration that acts a catalyst to enrich the experience of employees. Employees are required to work at least 3 days in the office per week, with the flexibility to work from home 2 days a week, depending on the role requirement. Some businesses may require more time in office due to nature of work.\nDetails to consider :\nThose eligible for employment protection (recipients of veteran’s benefits, the disabled, etc.) may receive preferential treatment for employment in accordance with applicable laws.\nPrivacy Notice\nYour personal information will be collected and managed by Coupang as stated in the Application Privacy Notice located below. https://privacy.coupang.com/en/land/jobs/","description_format":"text","description_chars":6062,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Commerce","E-commerce Platforms","Delivery","Marketplaces"],"lifecycle":[{"event":"open","at":"2026-10-01T22:34:40Z"},{"event":"close","at":"2026-10-22T14:55:50Z"},{"event":"reopen","at":"2026-10-23T07:39:44Z"}],"visa":[],"liveness":{"score":64,"band":"ok","label":"Likely open","p_open":1,"p_active":0.882,"p_room":0.72,"age_days":41,"expected_fill_days":71,"reasons":["conf:1","velocity","win:mid","crowd:brand"],"computed_at":"2026-11-03T05:54:40Z"},"pay":null,"html_url":"https://alion.io/job/coupang-staff-backend-engineer-k8-envoy-2","json_url":"https://alion.io/job/coupang-staff-backend-engineer-k8-envoy-2.json","meta":{"generated_at":"2026-11-03T11:55:59Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":16373,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-04T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":239},"rest":"https://alion.io/mcp/rest/get_company?id=239"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcoupang-staff-backend-engineer-k8-envoy-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcoupang-staff-backend-engineer-k8-envoy-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcoupang-staff-backend-engineer-k8-envoy-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/coupang-staff-backend-engineer-k8-envoy-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcoupang-staff-backend-engineer-k8-envoy-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":1642789}},{"tool":"search_jobs","arguments":{"company":"coupang.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":1642789},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}