{"id":4234915,"url":"https://alion.io/job/ai21-labs-deep-learning-engineer","title":"Deep Learning Engineer","company":{"id":175,"name":"AI21 Labs","domain":"ai21.com","url":"https://alion.io/company/ai21-labs","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Comeet","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"middle","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Tel Aviv, Israel"],"countries":["IL"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"DeepSpeed","optional":false},{"name":"DPO","optional":false},{"name":"FSDP","optional":false},{"name":"GRPO","optional":false},{"name":"JAX","optional":false},{"name":"Knowledge Distillation","optional":false},{"name":"Kubernetes","optional":false},{"name":"KV Cache","optional":false},{"name":"LLM","optional":false},{"name":"Megatron-LM","optional":false},{"name":"Mixture of Experts","optional":false},{"name":"Model Distillation","optional":false},{"name":"NCCL","optional":false},{"name":"Post-training","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Quantization","optional":false},{"name":"SFT","optional":false},{"name":"SGLang","optional":false},{"name":"SLURM","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"TRL","optional":false},{"name":"vLLM","optional":false},{"name":"AI Agents","optional":true},{"name":"TensorRT","optional":true},{"name":"Transformers","optional":true}],"status":"live","first_seen_at":"2026-11-09T02:23:56Z","employer_posted_date":"2026-11-09","last_verified_at":"2026-11-13T11:43:39Z","board_verified":true,"closed_at":null,"days_open":4,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":4},"description":"Description\nOur team is looking for a Deep Learning Engineer.\nAI21 is one of the few companies to have trained multi-billion parameter Large Language Models (LLMs). This feat requires top-tier engineering and deep learning algorithmic knowledge. Serving these LLMs efficiently requires cutting-edge technology as well. As a deep learning engineer on the team, you will be responsible for improving and maintaining our training infrastructure, developing/scaling/testing new ideas such as performance improvements and new training methods, adapting our code to run on and best utilize the newest and most advanced hardware accelerators, and running training and evaluation experiments to optimize LLMs on different tasks.\nRole and Responsibilities\nDevelop, improve and maintain our training framework and related infrastructure, as part of our applied research projects\nOptimize training performance and quality in a variety of aspects, such as adding parallelism methods, improving training SDK, integrating RL environments, optimizing new model architectures, research and development of training methods, etc.\nOptimize model serving to support high throughput and low latency in production and training\nTake part in critical post-training efforts along with applied researchers\nRequirements\n3+ years developing software for production systems, with strong Python and solid engineering fundamentals (testing, debugging, performance work, reading unfamiliar codebases).\nHands-on understanding of how modern LLM training works end to end in PyTorch: data/model/tensor/pipeline parallelism and when each applies, mixed precision, memory vs. compute tradeoffs, and what a framework like FSDP, Megatron, or DeepSpeed is actually doing under the hood. You don't need to have used a specific one.\nA deep understanding of LLM architectures - attention variants, MoE, positional encodings, KV cache.\nAbility to debug across the stack: a loss spike, a NCCL hang, a logprob mismatch, or a kernel that's slower than it should be.\nAt least a BSc in computer science, E.E. or a degree in a similar field.\nBonus - experience working in a distributed, containerized GPU training environment (Slurm, Kubernetes, or similar): launching and debugging multi-node jobs, dealing with images, storage, and scheduling constraints.\nSignificant experience in at least one of the following\nDistributed training: scaling training jobs across nodes, working with any of FSDP/Megatron/DeepSpeed/JAX-based stacks, diagnosing communication and scaling inefficiencies.\nPost-training and RL: SFT/DPO/GRPO-style pipelines, online vs. offline training, rollout-trainer coupling, frameworks such as verl, slime, prime-RL, TRL, or in-house equivalents.\nInference systems: serving frameworks (vLLM, SGLang, TensorRT-LLM), batching and scheduling, KV cache management, latency/throughput optimization.\nModel efficiency: quantization, distillation, kernel-level optimization, spec-decoding, model export/serialization for deployment.\nAbout Us\nAI21 is one of the leading, most experienced foundational AI labs in the world.\nAs companies start to deploy AI agents at scale, they face challenges rooted in missing expertise and ownership. We help companies scale their AI agents - sustainably. We automatically reduce token cost and waste without harming frontier quality, replacing weeks or months of manual tuning. This is achievable by applying advanced research and methodologies across the stack, from intelligent model routing and up to harness and model training.","description_format":"text","description_chars":3527,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Israel","iso":"IL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["LLM & Generative AI","Natural Language Processing","Foundation Models","AI Research Labs"],"lifecycle":[{"event":"open","at":"2026-11-13T11:43:39Z"}],"visa":[],"liveness":{"score":85,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.853,"p_room":1,"age_days":4,"expected_fill_days":28,"reasons":["conf:1","win:early"],"computed_at":"2026-11-13T13:28:03Z"},"pay":null,"html_url":"https://alion.io/job/ai21-labs-deep-learning-engineer","json_url":"https://alion.io/job/ai21-labs-deep-learning-engineer.json","meta":{"generated_at":"2026-11-13T13:28:03Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":27036,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-14T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":175},"rest":"https://alion.io/mcp/rest/get_company?id=175"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fai21-labs-deep-learning-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fai21-labs-deep-learning-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fai21-labs-deep-learning-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ai21-labs-deep-learning-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fai21-labs-deep-learning-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4234915}},{"tool":"search_jobs","arguments":{"company":"ai21.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4234915},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}