{"id":166950,"url":"https://alion.io/job/palantir-technologies-software-engineer-hosted-model-infrastructure","title":"Software Engineer - Hosted Model Infrastructure","company":{"id":24,"name":"Palantir Technologies","domain":"palantir.com","url":"https://alion.io/company/palantir","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Lever","truth_index":{"grade":"C","score":60,"open_postings":232,"ghost_share":0.578,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":116,"computed_at":"2026-10-17T05:46:00Z"}},"role":"Backend","role_family":"Backend","seniority":"middle","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Washington, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":120000,"max_usd":238000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":1351},"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"Java","optional":false},{"name":"Kubernetes","optional":false},{"name":"Machine Learning","optional":false},{"name":"Python","optional":false},{"name":"Rust","optional":false},{"name":"Docker","optional":true},{"name":"GitHub","optional":true},{"name":"Go","optional":true},{"name":"Gradle","optional":true}],"status":"live","first_seen_at":"2026-06-03T19:38:40Z","employer_posted_date":"2026-06-03","last_verified_at":"2026-10-18T09:40:49Z","board_verified":true,"closed_at":null,"days_open":136,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":136},"description":"The Role\nWe are a software engineering team with expertise in enabling ML models in production. We deploy AI models to run in variety of environments: air-gapped government networks, forward-deployed defense environments, edge nodes, and enterprises with strict data sovereignty requirements. Our customers rely on us for frontier AI capabilities running on hardware they control, often with constrained GPU resources and limited direct access. Rising to that challenge and meeting those expectations is what Palantir's excels at.\nWe treat models like any other software: continuously tested, continually delivered, packaged for reproducible deployment, and built for long-term maintainability. You will own services end-to-end, and work across the full stack, from inference engines, GPU scheduling to deployment pipelines, observability, and integration with Palantir's platform. The goal is to deliver new models and capabilities quickly and continuously.\nJoin us if you want to solve problems at the intersection of infrastructure and machine learning that directly enable critical customers.\nTechnologies We Use\nDifferent backend languages, including Java, Rust, Python and Go\nModel serving engines for GPU-accelerated inference\nDocker and Kubernetes for containerization and orchestration\nIndustry-standard build tooling, including Gradle and GitHub\nCore Responsibilities\nBuilding high-performance model serving infrastructure that integrates with security models, hardware constraints, and different inference engines\nDesigning intelligent request handling including authentication, rate limiting, concurrency control, and audit logging for multi-tenant model access\nBuilding and maintaining packaging and deployment pipelines enabling fast, secure, and reliable model rollouts across on-premises and air-gapped environments\nDeveloping observability for production AI systems to enable easy service monitoring and fast incident triage and resolution\nDebugging complex issues and performance problems throughout the stack, including open source inference engines, container runtimes, and GPU drivers, in environments you cannot always access directly\nDesigning and running testing and benchmarking infrastructure that validates model deployments across varying GPU hardware before they reach production\nWorking with product teams and customers to understand requirements, debug production issues, and deliver the models and capabilities they need\nIntegrating hosted model infrastructure with Palantir's deployment, configuration, and identity systems\nWhat We Value\nOwnership mindset and bias toward quality. Our software runs in environments where direct access for debugging is limited or unavailable.\nHigh empathy for customer needs and drive to deliver reliable, easy-to-use models\nAbility to work effectively across multiple languages and layers of the stack, from backend services and ML tooling to container orchestration and deployment configuration\nStrong debugging skills and motivation to trace problems from application code through containers, orchestration, and hardware\nCuriosity about emerging AI capabilities and the ability to quickly evaluate and integrate new models and technologies as the landscape evolves\nActive US Security clearance, or eligibility and willingness to obtain a US Security clearance is beneficial, but not necessary\nWhat We Require\n4+ years of professional software engineering experience building and operating production systems\nEngineering background in Computer Science, Mathematics, Software Engineering, Physics, or similar field\nStrong coding skills with demonstrated proficiency in programming languages, such as Java, C++, Python, Rust, or similar languages. Familiarity with the Python ML ecosystem is valuable.\nExperience with containers, Kubernetes, and deploying backend services in production environments\nStrong written and verbal communication skills and ability to iterate quickly with teammates, incorporating feedback and holding a high bar for quality","description_format":"text","description_chars":4017,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Data Integration & ETL Tools","Decision Intelligence","Defense AI"],"lifecycle":[{"event":"open","at":"2026-06-03T19:38:40Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 207 · green card filings: 38","filings_12m":207,"filings_prev_12m":125,"green_card_filings_12m":38,"median_offered_wage_usd":150949,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":74}],"liveness":{"score":22,"band":"cold","label":"Long shot","p_open":1,"p_active":0.495,"p_room":0.44,"age_days":135,"expected_fill_days":116,"reasons":["conf:1","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-17T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/palantir-technologies-software-engineer-hosted-model-infrastructure","json_url":"https://alion.io/job/palantir-technologies-software-engineer-hosted-model-infrastructure.json","meta":{"generated_at":"2026-10-18T09:54:12Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":14639,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":24},"rest":"https://alion.io/mcp/rest/get_company?id=24"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fpalantir-technologies-software-engineer-hosted-model-infrastructure"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fpalantir-technologies-software-engineer-hosted-model-infrastructure"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fpalantir-technologies-software-engineer-hosted-model-infrastructure"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/palantir-technologies-software-engineer-hosted-model-infrastructure\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fpalantir-technologies-software-engineer-hosted-model-infrastructure"}]}