{"id":3383438,"url":"https://alion.io/job/insight-softmax-consulting-llc-ai-engineer","title":"AI Engineer","company":{"id":2982245,"name":"Insight Softmax Consulting, LLC","domain":"insightsoftmax.com","url":"https://alion.io/company/insightsoftmax","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"BambooHR","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"Ansible","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Datadog","optional":false},{"name":"Envoy","optional":false},{"name":"Fine-tuning","optional":false},{"name":"Function Calling","optional":false},{"name":"Gateway API","optional":false},{"name":"GCP","optional":false},{"name":"GitOps","optional":false},{"name":"Grafana","optional":false},{"name":"Helm","optional":false},{"name":"HPC","optional":false},{"name":"Kubernetes","optional":false},{"name":"Linux","optional":false},{"name":"LiteLLM","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"Machine Learning","optional":false},{"name":"OpenTelemetry","optional":false},{"name":"Platform Engineering","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"Quantization","optional":false},{"name":"RAG","optional":false},{"name":"Rust","optional":false},{"name":"SLURM","optional":false},{"name":"Structured Outputs","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"Terraform","optional":false},{"name":"Traefik","optional":false},{"name":"Triton","optional":false},{"name":"vLLM","optional":false},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-10-27T00:00:00Z","employer_posted_date":"2026-10-27","last_verified_at":"2026-10-30T10:51:08Z","board_verified":true,"closed_at":null,"days_open":3,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":3},"description":"Insight Softmax is a leading organization in the fields of machine learning, data science, and high-performance computing (HPC). We are dedicated to providing innovative solutions in computing technology to solve complex problems in various sectors including research, science, manufacturing, finance, and data analytics.\nDescription:\nWe are hiring an AI Engineer for our engineering team. You will implement the AI platforms and services our architects design and our customers run: inference stacks, AI gateways, RAG and agent systems, and the automation around them.\nYou will work directly inside customer environments, from neoclouds with thousands of GPUs to enterprises deploying their first production LLM service, and on our own platform product work for vendor partners.\nThe role is forward-deployed in spirit. You will spend much of your time embedded with a customer team, shipping working systems and leaving behind documentation and automation they can run.\nOur team requires individuals with focus on delivery and results, hunger to learn, ability to adapt, and can thrive in a self-directed environment where you’ll figure out what’s needed to deliver rather than wait for detailed instructions.\nKey Responsibilities:\nDeploy and operate LLM inference services on Kubernetes and bare metal GPU clusters, including model serving, autoscaling, GPU scheduling and performance tuning.\nBuild and operate AI gateway and routing layers: tenant keys, model pools, quotas, rate limits, caching, failover and usage metrics.\nImplement RAG pipelines, agentic workflows, evaluation harnesses and the APIs that expose them to customer applications.\nWrite production-quality services and automation in Python, with infrastructure as code for the surrounding platform.\nInstrument AI services for observability: latency, throughput, token and cost accounting, quality signals.\nRun benchmarks and load tests, and turn results into tuning changes and capacity recommendations.\nIntegrate AI services with customer identity, security and data systems.\nDocument deployments and hand over runbooks to customer and internal operations teams.\nReserve time each week for pre-sales support, internal platform work and knowledge sharing.\nQualifications:\nAt least 4 years of software or platform engineering experience, with at least 2 years building and running LLM or ML services in production.\nHands-on with at least one inference server (for example vLLM, TensorRT-LLM, Triton, llm-d) and with running GPU workloads on Kubernetes.\nStrong Python. Comfortable building services, CLIs and automation, with tests.\nWorking knowledge of Kubernetes, containers, Helm and GitOps workflows.\nStrong linux chops.\nDeep knowledge of at least one of AWS, GCP, or Azure. Preferably AWS.\nExperience with LLM application patterns: prompt and context management, retrieval, tool use, structured output, evaluation.\nAble to work independently inside a customer environment and communicate progress clearly.\nOptional Experience and Skills:\nAI gateway tooling (for example LiteLLM, Envoy or Traefik based gateways, KubernetesGateway API inference extensions).\n\nVector databases and embedding pipelines.\nFine-tuning, quantization and model optimization.\nMulti-tenant GPU platforms, GPU partitioning and Dynamic Resource Allocation.\nObservability stacks (OpenTelemetry, Prometheus, Grafana, Datadog) applied to AI services.\nSpectro Cloud Palette and PaletteAI, Run:ai, or similar GPU platform products.\nSlurm or other batch schedulers.\nBonus Experience and Skills:\nGo or Rust.\nTerraform and Ansible.\nAir-gapped or regulated environment deployments.\nUsing linux as your primary desktop workstation environment.\nAttributes that we value:\nTransparency\nGrit\nEffectiveness\nWillingness to learn\nLocation and Hours:\nFull time position\nRemote work environment\n80% of your work schedule will be during the business time zones for Latin America and Canada.\nSome customer meetings will occur each week at non-standard / nighttime hours, as wecurrently support a global team across 3-4 continents.\n\nSome customer engagements include on-site work at US customer sites, typically forworkshops, platform bring-up and go-live. Expect occasional US travel.\n\nReferences:\n3 references will be required.\nNotes:\nAI systems may be used with the recruitment and screening processes for this job requisition.","description_format":"text","description_chars":4350,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["High-Performance Computing"],"lifecycle":[{"event":"open","at":"2026-10-28T06:20:17Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":3,"expected_fill_days":24,"reasons":["conf:3","velocity","win:early"],"computed_at":"2026-10-30T05:48:23Z"},"pay":null,"html_url":"https://alion.io/job/insight-softmax-consulting-llc-ai-engineer","json_url":"https://alion.io/job/insight-softmax-consulting-llc-ai-engineer.json","meta":{"generated_at":"2026-10-30T11:35:41Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":16580,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-31T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2982245},"rest":"https://alion.io/mcp/rest/get_company?id=2982245"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Finsight-softmax-consulting-llc-ai-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Finsight-softmax-consulting-llc-ai-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Finsight-softmax-consulting-llc-ai-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/insight-softmax-consulting-llc-ai-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Finsight-softmax-consulting-llc-ai-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3383438}},{"tool":"search_jobs","arguments":{"company":"insightsoftmax.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3383438},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}