{"id":3383437,"url":"https://alion.io/job/insight-softmax-consulting-llc-ai-architect","title":"AI Architect","company":{"id":2982245,"name":"Insight Softmax Consulting, LLC","domain":"insightsoftmax.com","url":"https://alion.io/company/insightsoftmax","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"BambooHR","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"staff","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Envoy","optional":false},{"name":"Fine-tuning","optional":false},{"name":"Gateway API","optional":false},{"name":"GCP","optional":false},{"name":"HPC","optional":false},{"name":"Kubernetes","optional":false},{"name":"Linux","optional":false},{"name":"LiteLLM","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Rust","optional":false},{"name":"SLURM","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"Traefik","optional":false},{"name":"Triton","optional":false},{"name":"vLLM","optional":false},{"name":"TensorRT","optional":true}],"status":"live","first_seen_at":"2026-10-21T00:00:00Z","employer_posted_date":"2026-10-21","last_verified_at":"2026-11-02T17:42:48Z","board_verified":true,"closed_at":null,"days_open":12,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":12},"description":"Insight Softmax is a leading organization in the fields of machine learning, data science, and high-performance computing (HPC). We are dedicated to providing innovative solutions in computing technology to solve complex problems in various sectors including research, science, manufacturing, finance, and data analytics.\nDescription:\nWe are hiring an AI Architect for our engineering team. You will be the senior technical voice for customers who are building or operating AI infrastructure: GPU clusters, inference platforms, AI gateways, and the services that sit on top of them.\nOur customers range from chip vendors and neoclouds running thousands of GPUs, to enterprises standing up their first production LLM services, to platform vendors who have us build parts of their product. They ask us how the leading AI labs and AI-native companies run their platforms, and they expect answers grounded in experience.\nYou will lead discovery and architecture phases of engagements, produce reference architectures and recommendations, and hand clear designs to our engineers for implementation. You will also support pre-sales scoping and estimates.\nThis is a hands-on architect role. You are expected to prototype, validate assumptions in a lab, and review the implementation, not only produce slides.\nOur team requires individuals with focus on delivery and results, hunger to learn, ability to adapt, and can thrive in a self-directed environment where you’ll figure out what’s needed to deliver rather than wait for detailed instructions.\nKey Responsibilities:\nLead technical discovery with customers and translate business goals into AI platform architectures, phased roadmaps and effort estimates.\nDesign inference serving platforms on Kubernetes and bare metal: model serving, GPU scheduling and partitioning, autoscaling, multi-tenancy, and capacity planning.\nDesign AI gateway and routing layers: tenant-aware routing, model pools, budgets and quotas, rate limiting, observability, and multi-site failover.\nDefine reference architectures for multi-tenant GPU clouds, sovereign and air-gapped deployments, and hybrid cloud and on-prem estates.\nAdvise on AI usage governance: cost visibility, token accounting, audit, data handling, and security posture for LLM services.\nEvaluate and recommend build, buy or compose decisions across open source and commercial AI infrastructure components.\nReview implementations delivered by our AI and platform engineers and own the technical quality of the outcome.\nRepresent Insight Softmax in customer architecture reviews, partner enablement sessions and executive readouts.\nReserve time each week for pre-sales support, internal platform work and mentoring.\nQualifications:\nAt least 8 years in infrastructure, platform or ML engineering, with at least 3 years designing and operating production AI or ML platforms at scale.\nHands-on experience deploying LLM inference in production (for example vLLM, TensorRT-LLM, llm-d, Triton) including tensor and pipeline parallelism, batching, caching and performance tuning.\nDeep understanding of GPU infrastructure: NVIDIA and AMD accelerators, drivers and runtimes, GPU scheduling on Kubernetes, high-speed interconnects and storage for AI workloads.\nExperience designing AI gateway or API management layers (for example LiteLLM, Traefik, Envoy or Tetrate based designs, Kubernetes Gateway API inference extensions). Strong Kubernetes and Linux skills. Able to read and debug the stack from the scheduler down to the node.\nDeep knowledge of at least one of AWS, GCP, or Azure. Preferably AWS.\nTrack record of leading architecture engagements with enterprise customers, including writing proposals, estimates and architecture documents that engineers can execute against.\nClear written and spoken communication with both engineers and executives.\nOptional Experience and Skills:\nExperience at an AI lab, AI-native company, or neocloud, or building platform products for them.\nMulti-tenant GPU cloud design, including namespace and cluster-level isolation, quota, billing and chargeback.\nSlurm or other batch schedulers alongside Kubernetes for mixed HPC and AI estates.\nRAG, agentic systems, model evaluation and fine-tuning pipelines.\nAir-gapped, FIPS or other regulated deployment experience.\nSpectro Cloud Palette and PaletteAI, Run:ai, or similar GPU platform products.\nObservability for AI services: traces, token and cost metrics, quality monitoring.\nBonus Experience and Skills:\nPython, Go or Rust.\nSoftware engineering background beyond infrastructure.\nPublished talks, blog posts or open source contributions in AI infrastructure.\nUsing linux as your primary desktop workstation environment.\nAttributes that we value:\nTransparency\nGrit\nEffectiveness\nWillingness to learn\nLocation and Hours:\nFull time position\nRemote work environment\n80% of your work schedule will be during the business time zones for Latin America and Canada.\nSome customer meetings will occur each week at non-standard / nighttime hours, as we currently support a global team across 3-4 continents.\nOccasional travel to customer sites in the US for architecture workshops, load tests and go-livereviews.\n\nReferences:\n3 references will be required.\nNotes:\nAI systems may be used with the recruitment and screening processes for this job requisition.","description_format":"text","description_chars":5315,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["High-Performance Computing"],"lifecycle":[{"event":"open","at":"2026-10-28T06:20:17Z"}],"visa":[],"liveness":{"score":80,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.885,"p_room":0.9,"age_days":12,"expected_fill_days":31,"reasons":["conf:0","velocity","win:mid"],"computed_at":"2026-11-02T06:13:15Z"},"pay":null,"html_url":"https://alion.io/job/insight-softmax-consulting-llc-ai-architect","json_url":"https://alion.io/job/insight-softmax-consulting-llc-ai-architect.json","meta":{"generated_at":"2026-11-02T18:36:04Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":26006,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-03T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2982245},"rest":"https://alion.io/mcp/rest/get_company?id=2982245"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Finsight-softmax-consulting-llc-ai-architect"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Finsight-softmax-consulting-llc-ai-architect"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Finsight-softmax-consulting-llc-ai-architect"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/insight-softmax-consulting-llc-ai-architect\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Finsight-softmax-consulting-llc-ai-architect"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3383437}},{"tool":"search_jobs","arguments":{"company":"insightsoftmax.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3383437},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}