{"id":1251179,"url":"https://alion.io/job/dsta-machine-learning-systems-senior-engineer","title":"Machine Learning Systems Senior Engineer","company":{"id":247928,"name":"Defence Science and Technology Agency","domain":"dsta.gov.sg","url":"https://alion.io/company/dsta","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Career site","truth_index":{"grade":"C","score":60,"open_postings":41,"ghost_share":0.659,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-16T05:45:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Singapore"],"countries":["SG"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":62000,"max_usd":134000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":26},"experience_years_min":2,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"Computer Vision","optional":false},{"name":"Docker","optional":false},{"name":"Go","optional":false},{"name":"Kubernetes","optional":false},{"name":"Linux","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"Multimodal AI","optional":false},{"name":"NLP","optional":false},{"name":"OpenShift","optional":false},{"name":"Python","optional":false},{"name":"Rust","optional":false},{"name":"SGLang","optional":false},{"name":"Triton Inference Server","optional":false},{"name":"vLLM","optional":false},{"name":"KV Cache","optional":true},{"name":"Platform Engineering","optional":true}],"status":"live","first_seen_at":"2026-06-09T02:12:23Z","employer_posted_date":"2026-09-25","last_verified_at":"2026-10-16T19:44:52Z","board_verified":true,"closed_at":null,"days_open":129,"trust":{"level":"ghost","repost_count":0,"flags":["stale","company_stale"],"days_open":129},"description":"We are looking for a highly technical ML Systems Engineer to architect and build scalable AI inference capabilities across heterogeneous environments.\nThis role focuses on solving real-world challenges in AI model execution, runtime interoperability and performance optimization.\nYou will operate at the intersection of machine learning, systems engineering, and software engineering, building platforms and tooling that standardise and simplify AI models serving in production environments.\nKey Responsibilities\n1. Inference Systems Engineering\n· Design and develop abstractions, middleware, and system components to support model inference across Traditional and Generative AI\n· Build integration layers across different model formats, execution engines, and deployment environments\n· Ensure consistency, portability, reliability, and scalability of model execution\n2. Model Handling\n· Support diverse model architectures, including:\nLarge Language Models (LLMs)\nComputer vision models\nNLP models\nMulti-modal models\n· Optimise models for latency, throughput and resource efficiency\n· Optimise model loading strategies\n· Implement robust mechanisms for model lifecycle management.\n3. Benchmarking & Evaluation\n· Develop and execute benchmarking methodologies to evaluate:\nLatency vs throughput trade-offs\nRuntime and hardware performance characteristics\nUse case performance characteristics\n· Support data-driven deployment decisions through profiling and performance analysis\n4. Platform Integration & Developer Experience\n· Develop APIs, libraries, and platform services that enable:\nSimplified model deployment and serving\nRuntime backends selection\nModel Observability\nModel Scaling\n· Improve developer and platform operators’ experience while preserving operational flexibility and low-level control\nTechnical Experience\nMust-Have\n· Hands-on experience with at least one inference stack:\nTraditional AI\nNVIDIA Triton Inference Server\nGenerative AI\nvLLM\nSGLang\nDynamo/LLM-D\n· Strong ability to profile, diagnose, and optimise performance bottlenecks\n· Strong proficiency in at least one programming language (e.g. Python, C++, Go, Rust)\n· Good understanding of Linux systems, distributed systems concept, and system-level debugging\n· Familiarity with containers and orchestration platforms such as Docker, and Kubernetes/OpenShift\nPreferred Experience\n· Experience working in air-gapped or restricted environments with enterprise GPU (e.g. A100, H200, B200)\n· Experience with LLM inference, including the understanding of terms such as KV cache management, Prefill vs decode phases, continuous batching and token-level scheduling.\n· Experience with model optimisation including the understanding of terms such as quantisation (FP16, INT8, INT4), graph optimisation and compilation.\nRequirements\n· Degree in Computer Science, Computer Engineering, or a related discipline.\n· Minimum 2-3 years of relevant experience in ML systems, inference engineering, platform engineering, or performance-critical software systems.","description_format":"text","description_chars":3021,"description_truncated":false,"requirements":{"experience_years_min":2,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Military"],"lifecycle":[{"event":"open","at":"2026-09-25T18:34:17Z"}],"visa":[],"liveness":{"score":8,"band":"cold","label":"Long shot","p_open":1,"p_active":0.271,"p_room":0.28,"age_days":129,"expected_fill_days":38,"reasons":["conf:3","stale_co","velocity","ghost","win:tail","crowd:"],"computed_at":"2026-10-16T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/dsta-machine-learning-systems-senior-engineer","json_url":"https://alion.io/job/dsta-machine-learning-systems-senior-engineer.json","meta":{"generated_at":"2026-10-16T23:17:29Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":5260,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":247928},"rest":"https://alion.io/mcp/rest/get_company?id=247928"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdsta-machine-learning-systems-senior-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdsta-machine-learning-systems-senior-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdsta-machine-learning-systems-senior-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/dsta-machine-learning-systems-senior-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdsta-machine-learning-systems-senior-engineer"}]}