{"id":4150847,"url":"https://alion.io/job/globaltech-ai-engineer","title":"AI Engineer","company":{"id":3827668,"name":"Globaltech","domain":"globaltechjsc.com","url":"https://alion.io/company/globaltech-2","size_band":null,"is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Ho Chi Minh City, Vietnam"],"countries":["VN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"CI/CD","optional":false},{"name":"DeepSeek","optional":false},{"name":"Docker","optional":false},{"name":"Embeddings","optional":false},{"name":"FastAPI","optional":false},{"name":"Function Calling","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"Hybrid Search","optional":false},{"name":"Kubernetes","optional":false},{"name":"KV Cache","optional":false},{"name":"Linux","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Model Context Protocol","optional":false},{"name":"NLP","optional":false},{"name":"Node JS","optional":false},{"name":"OpenAI","optional":false},{"name":"OpenAI Codex","optional":false},{"name":"Prompt Caching","optional":false},{"name":"Python","optional":false},{"name":"Quantization","optional":false},{"name":"RAG","optional":false},{"name":"Reranking","optional":false},{"name":"SGLang","optional":false},{"name":"Structured Outputs","optional":false},{"name":"Tokenization","optional":false},{"name":"Transformers","optional":false},{"name":"TypeScript","optional":false},{"name":"vLLM","optional":false},{"name":"JavaScript","optional":true}],"status":"live","first_seen_at":"2026-11-12T00:00:00Z","employer_posted_date":null,"last_verified_at":"2026-11-12T00:00:00Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"You will build the company's AI Platform: the shared layer that lets every product team ship LLM features and agents without rebuilding serving, agent runtime, retrieval or evaluation. This is a platform engineering role with internal teams as your users.\n\nThe platform has four parts: model serving and an LLM gateway, an agent runtime built on harnesses such as DeepSeek Harness, Codex, shared NLP and RAG services, and an evaluation and observability stack.\nTrách nhiệm công việc\nModel serving and LLM gateway\n\nServe open-source LLMs, embedding and reranking models on GPUs with vLLM and SGLang, behind OpenAI-compatible endpoints.\n\nBuild the LLM gateway: one API across self-hosted and external models, with routing, fallback, rate limits, quotas, API keys and per-team cost tracking.\n\nTune throughput and latency: batching, quantization, KV and prompt caching, autoscaling, GPU capacity planning.\n\nAgent runtime and harness\n\nOffer the agent harness as a platform service: sandboxed execution, session storage, permissions, headless runs in CI/CD and scheduled jobs.\n\nExtend harnesses with plugins, model adapters and tool registries so teams can run any platform model in them.\n\nMaintain a shared catalog of tools, MCP servers and skills that teams can reuse, with access control per team.\n\nProvide templates and an SDK for common agent patterns: single-agent, multi-agent, subagents, human-in-the-loop.\n\nShared NLP and RAG services\n\nBuild retrieval as a service: ingestion, chunking, embedding, hybrid search, reranking, per-tenant indexes.\n\nProvide reusable NLP components: classification, information extraction, summarization, Vietnamese document processing.\n\nEvaluation, observability and governance\n\nBuild the eval platform: benchmark task sets, automated scoring, LLM-as-judge, regression gates before model or prompt releases.\n\nProvide tracing, logging and session replay for every model call and agent run.\n\nEnforce guardrails: prompt injection defenses, PII handling, tool permissions, audit logs.\n\nYêu cầu\n\nBachelor's degree in Computer Science, Artificial Intelligence, Applied Mathematics or equivalent.\n\n2+ years of NLP/LLM experience, including at least one LLM or agent system running in production.\n\nExperience building shared services or internal platforms used by other teams: API design, multi-tenancy, versioning, SLAs.\n\nExperience serving LLMs with vLLM or SGLang: deploying OpenAI-compatible endpoints on GPUs, tuning batching, quantization and KV cache, and benchmarking throughput and latency.\n\nStrong Python and backend skills (FastAPI or similar, async, queues); reading and writing TypeScript/Node.js is a big advantage, since many harnesses are written in TypeScript.\n\nSolid understanding of how agents work: agent loop, tool calling, context window management, prompt caching, structured output.\n\nHands-on with at least one agent harness or coding agent (DeepSeek Harness, Codex or similar) at the customization level, not only as an end user.\n\nExperience building RAG and working with vector databases.\n\nStrong NLP fundamentals: Transformers, tokenization, embeddings, evaluation metrics.\n\nSolid infrastructure skills: Docker, Kubernetes, Linux, CI/CD, monitoring.\n\nNice to have\n\nYou have built or operated an internal ML/AI platform or LLM gateway serving several product teams.\n\nYou have written a plugin, MCP server or skill for an agent harness and have a public repo to show.\n\nGPU cluster operations: scheduling, autoscaling, multi-GPU and multi-node inference.\n\nKnowledge of agent safety: prompt injection, sandboxing, tool permissions.","description_format":"text","description_chars":3578,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-11-12T09:09:30Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":26,"reasons":["seen:0","win:early"],"computed_at":"2026-11-12T10:38:37Z"},"pay":null,"html_url":"https://alion.io/job/globaltech-ai-engineer","json_url":"https://alion.io/job/globaltech-ai-engineer.json","meta":{"generated_at":"2026-11-12T15:49:21Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":33105,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3827668},"rest":"https://alion.io/mcp/rest/get_company?id=3827668"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fglobaltech-ai-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fglobaltech-ai-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fglobaltech-ai-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/globaltech-ai-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fglobaltech-ai-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4150847}},{"tool":"search_jobs","arguments":{"company":"globaltechjsc.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4150847},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}