{"id":2529338,"url":"https://alion.io/job/ebay-mts-2-ai-platform","title":"MTS 2, AI Platform","company":{"id":7519,"name":"eBay","domain":"ebay.com","url":"https://alion.io/company/ebay","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":78,"open_postings":29,"ghost_share":0,"stale_share":0.862,"repost_share":0,"time_to_fill_p50_days":26,"computed_at":"2026-10-28T05:59:10Z"}},"role":"Operations","role_family":"Operations","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":11500,"max_usd":26000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":25},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CUDA","optional":false},{"name":"HPC","optional":false},{"name":"KV Cache","optional":false},{"name":"LLM","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Quantization","optional":false},{"name":"SGLang","optional":false},{"name":"Speculative Decoding","optional":false},{"name":"TensorRT","optional":false},{"name":"Triton","optional":false},{"name":"vLLM","optional":false},{"name":"Human-in-the-Loop","optional":true}],"status":"live","first_seen_at":"2026-10-12T00:00:00Z","employer_posted_date":"2026-10-12","last_verified_at":"2026-10-28T13:25:33Z","board_verified":true,"closed_at":null,"days_open":16,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":16},"description":"At eBay, we're more than a global ecommerce leader - we’re changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We’re committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts.\nOur customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work - every day. We're in this together, sustaining the future of our customers, our company, and our planet.\nJoin a team of passionate thinkers, innovators, and dreamers - and help us connect people and build communities to create economic opportunity for all.\nAt eBay, we're more than a global ecommerce leader - we're changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We're committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts.\nOur customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work - every day. We're in this together, sustaining the future of our customers, our company, and our planet.\nJoin a team of passionate thinkers, innovators, and dreamers - and help us connect people and build communities to create economic opportunity for all.\nAbout the role\nAs an LLM Inference Engineer on our AI Platform team, you'll remove the compute-scaling bottleneck for production LLMs. Your job is to make frontier-model inference fast, efficient, reliable, and observable - the \"last mile\" from GPUs to APIs that products depend on. This role sits at the intersection of HPC, GPU systems, and MLOps, and requires strong intuition for how model architecture, runtimes, and hardware interact.\nWhat you'll do\nOwn production inference: take models from handoff to production-grade serving, including release engineering, capacity planning, cost optimization, and incident response.\nTune inference performance: reduce end-to-end latency and increase throughput across real production traffic patterns.\nOptimize runtimes and servers: scale inference across heterogeneous GPU fleets; optimize stacks such as vLLM, Triton, and related components (e.g., schedulers, KV cache, batching, memory).\nBenchmark and measure: build benchmarking suites, metrics, and tooling to quantify latency, throughput, GPU utilization, memory, and cost.\nReliability and observability: improve monitoring, tracing, and alerting; participate in incident response and postmortems to harden systems.\nApply and ship new optimizations: evaluate research and implement pragmatic inference optimizations (e.g., quantization, paging, kernel/runtime improvements).\nPartner with cross-functional teams: work with data science and product teams to translate business requirements into performance and availability SLOs.\nWhat we're looking for\n8+ years of strong development experience. \nExperience deploying and operating LLM inference services in production.\nStrong production coding skills in Python plus Go (systems-level implementation and debugging).\nExperience with ML frameworks and runtimes: PyTorch, vLLM, SGLang (and/or TensorRT).\nKnowledge of GPU architecture and performance (profiling, memory bandwidth/latency tradeoffs); CUDA/kernel programming is a strong plus.\nSolidunderstanding of LLM inference and optimization techniques: continuous batching, KV cache management, quantization, speculative decoding (nice-to-have), etc.\nHands-on experience in performance optimization and systems programming for AI/ML workloads.\nDemonstrated ability to deliver measurable production improvements (e.g., 2X throughput, lower p95/p99 latency, reduced GPU cost).\nProven skill in root-cause analysis: finding bottlenecks across model, runtime, networking, and infrastructure.\nDemonstrated proficiency in applying autonomous AI coding agents to speed up software delivery pipelines. This includes advanced prompting and careful human-in-the-loop code review to improve development speed and code accuracy.\nAdditional Details\neBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status. If you have a need that requires accommodation, please contact us at . We will make every effort to respond to your request for accommodation as soon as possible. View ouraccessibility statement to learn more about eBay's commitment to ensuring digital accessibility for people with disabilities.\nAdditional Details\neBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status. If you have a need that requires accommodation, please contact us at . We will make every effort to respond to your request for accommodation as soon as possible. View our accessibility statement to learn more about eBay's commitment to ensuring digital accessibility for people with disabilities.\nWe use cookies to enhance your experience and may use AI tools for administrative tasks in the hiring process. To learn how we handle your personal data and use AI responsibly, please visit ourTalent Privacy Notice,Privacy Center, and AI Hiring Guidelines.","description_format":"text","description_chars":5580,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Marketplaces"],"lifecycle":[{"event":"open","at":"2026-10-14T12:33:45Z"}],"visa":[],"liveness":{"score":53,"band":"ok","label":"Likely open","p_open":1,"p_active":0.594,"p_room":0.9,"age_days":16,"expected_fill_days":26,"reasons":["conf:5","stale_co","velocity","win:mid","comp:brand"],"computed_at":"2026-10-28T05:59:10Z"},"pay":null,"html_url":"https://alion.io/job/ebay-mts-2-ai-platform","json_url":"https://alion.io/job/ebay-mts-2-ai-platform.json","meta":{"generated_at":"2026-10-28T17:31:21Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":23867,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-29T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":7519},"rest":"https://alion.io/mcp/rest/get_company?id=7519"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Febay-mts-2-ai-platform"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Febay-mts-2-ai-platform"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Febay-mts-2-ai-platform"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ebay-mts-2-ai-platform\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Febay-mts-2-ai-platform"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":2529338}},{"tool":"search_jobs","arguments":{"company":"ebay.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":2529338},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}