{"id":3235120,"url":"https://alion.io/job/byteridge-ml-infrastructure-engineer","title":"ML Infrastructure Engineer","company":{"id":2519206,"name":"Byteridge","domain":"byteridge.com","url":"https://alion.io/company/byteridge","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India","Chennai, India","Noida, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":24000,"max_usd":50000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":41},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon EC2","optional":false},{"name":"Amazon S3","optional":false},{"name":"Amazon SageMaker","optional":false},{"name":"AWS","optional":false},{"name":"AWS Trainium","optional":false},{"name":"CUDA","optional":false},{"name":"Fine-tuning","optional":false},{"name":"JAX","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"TensorFlow","optional":false},{"name":"Knowledge Distillation","optional":true},{"name":"Model Distillation","optional":true},{"name":"Quantization","optional":true}],"status":"live","first_seen_at":"2026-10-25T10:35:30Z","employer_posted_date":null,"last_verified_at":"2026-10-25T10:35:30Z","board_verified":false,"closed_at":null,"days_open":3,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":3},"description":"Byteridge is seeking a Rapid Prototyping Engineer specializing in AI Infrastructure and Optimization to work with our most strategic customers on deploying, fine-tuning, and optimizing large language models at scale. You will be at the forefront of Byteridge's AI infrastructure capabilities, helping customers unlock the full potential of foundation models through expert-level deployment on GPU infrastructure. This highly technical role requires deep expertise in machine learning infrastructure, GPU optimization, and production ML systems, combined with the ability to translate complex technical concepts into customer success.\n\nThe core responsibilities for the job include the following:\n\nModel Deployment and Optimization: \nLead end-to-end deployments of large language models on AWS infrastructure for strategic customers.\nDesign and implement training, fine-tuning, and inference pipelines using Amazon SageMaker AI.\nOptimize model performance through GPU-level tuning, kernel optimization, and infrastructure configuration.\nDeploy models on diverse GPU architectures, including NVIDIA and AWS custom silicon (Trainium, Inferentia).\n\nInfrastructure Architecture and Performance: \nArchitect scalable ML infrastructure using SageMaker AI Inference, HyperPod, and distributed training frameworks.\nImplement CUDA-level optimizations and custom kernels for improved model performance.\nDesign storage and networking architectures optimized for high-throughput ML workloads.\nTroubleshoot and resolve complex performance bottlenecks at the GPU driver and kernel level.\n\nCustomer Engagement and Technical Leadership: \nPartner with AWS AI Specialist Solution Architects and customer ML teams to understand model requirements and deployment constraints.\nProvide technical guidance on model selection, fine-tuning strategies, and production best practices.\nConduct performance benchmarking and cost optimization analysis for ML workloads.\nShare field insights with AWS product teams to influence infrastructure and service roadmaps.\n\nRequirements: \nBachelor's degree in Computer Science, Engineering, or equivalent practical experience (Master's or PhD preferred).\n5+ years of experience in machine learning infrastructure, model deployment, or GPU computing.\nStrong programming skills in Python and experience with ML frameworks (PyTorch, TensorFlow, JAX).\nDeep understanding of LLM architectures, training methodologies, and inference optimization.\n\nTechnical Expertise (High-Level Alignment): \nHands-on experience training, fine-tuning, or deploying large language models in production.\nProficiency with GPU programming, CUDA, and kernel-level optimization techniques.\nExperience with distributed training frameworks and multi-GPU/multi-node orchestration.\nStrong knowledge of AWS core services: EC2 (GPU instances), S3 EFS, VPC, and networking.\n\nPreferred Experience: \nDirect experience with Amazon SageMaker AI (Training, Inference, HyperPod) or equivalent ML platforms.\nUnderstanding of GPU architectures (NVIDIA A100 H100) and AWS custom silicon (Trainium, Inferentia).\nExperience with model compression techniques (quantization, pruning, distillation).\nKnowledge of MLOps practices, model monitoring, and production ML system design.\nBackground in high-performance computing, distributed systems, or systems programming.\n\nEssential Attributes: \nAbility to dive deep into technical problems and debug complex infrastructure issues.\nStrong analytical skills with a data-driven approach to optimization.\nExcellent communication skills to explain complex technical concepts to diverse audiences.\nComfortable working in ambiguous, fast-paced environments with evolving requirements.\nOwnership mindset with the ability to drive projects from architecture to production.\nSkills\nCUDA, JAX, PyTorch, Python, TensorFlow","description_format":"text","description_chars":3816,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Outsourcing & Dedicated Teams","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-25T10:35:30Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":2,"expected_fill_days":28,"reasons":["seen:2","velocity","win:early"],"computed_at":"2026-10-28T05:59:10Z"},"pay":null,"html_url":"https://alion.io/job/byteridge-ml-infrastructure-engineer","json_url":"https://alion.io/job/byteridge-ml-infrastructure-engineer.json","meta":{"generated_at":"2026-10-28T13:24:05Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":18035,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-29T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2519206},"rest":"https://alion.io/mcp/rest/get_company?id=2519206"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbyteridge-ml-infrastructure-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbyteridge-ml-infrastructure-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbyteridge-ml-infrastructure-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/byteridge-ml-infrastructure-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbyteridge-ml-infrastructure-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3235120}},{"tool":"search_jobs","arguments":{"company":"byteridge.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3235120},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}