{"id":2644951,"url":"https://alion.io/job/penguin-solutions-senior-ai-engineer","title":"Senior AI Engineer","company":{"id":178085,"name":"Penguin Solutions","domain":"penguinsolutions.com","url":"https://alion.io/company/penguin-solutions","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SuccessFactors","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":175000,"max":215000,"currency":"USD","period":"year","gross":null,"usd_annual":215000},"salary_estimate":null,"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"Amazon SageMaker","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Docker","optional":false},{"name":"Fine-tuning","optional":false},{"name":"Function Calling","optional":false},{"name":"GCP","optional":false},{"name":"HPC","optional":false},{"name":"Kubernetes","optional":false},{"name":"Linux","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"LLMOps","optional":false},{"name":"NVIDIA NeMo","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Ray Serve","optional":false},{"name":"TGI","optional":false},{"name":"Tool Use","optional":false},{"name":"Triton Inference Server","optional":false},{"name":"vLLM","optional":false},{"name":"Ansible","optional":true},{"name":"Grafana","optional":true},{"name":"Hugging Face","optional":true},{"name":"Kubeflow","optional":true},{"name":"LangChain","optional":true},{"name":"LangGraph","optional":true},{"name":"LlamaIndex","optional":true},{"name":"MLFlow","optional":true},{"name":"OpenTelemetry","optional":true},{"name":"OWASP Top 10","optional":true},{"name":"Prometheus","optional":true},{"name":"PyTorch","optional":true},{"name":"Ray","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-10-15T19:50:24Z","employer_posted_date":"2026-10-15","last_verified_at":"2026-10-17T06:06:23Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"At Penguin Solutions (Nasdaq: PENG) - The AI Factory Platform Company - we’re building a team of innovators who thrive on collaboration, creativity, and the opportunity to help shape the future of AI. As part of the AI technology revolution, our teams design, build, deploy, and manage AI factories for enterprises, sovereign AI initiatives, and neocloud providers worldwide.\nHeadquartered in Silicon Valley, California, Penguin Solutions operates globally through a network of R&D, manufacturing, and sales locations. For nearly three decades, we have operated at the intersection of memory and AI/HPC infrastructure. That engineering expertise positions us to power the next generation of AI workloads, from training to inference and agentic AI at scale.\nPenguin Solutions brings together differentiated infrastructure software, advanced memory, compute systems, end-to-end services, and industry-leading partner solutions in a full-stack AI factory platform designed to help customers deploy and scale AI workloads with speed and precision.\nAt Penguin Solutions, we value ideas over hierarchy and believe in servant leadership, where leaders enable teams to do their best work. We empower employees to take ownership, drive innovation, and grow through challenging work, continuous learning, and exposure to advanced AI tools and technologies. With flexibility where it matters and a strong focus on outcomes, Penguin Solutions is a place to do your best work, grow your career, and make a meaningful impact.\nJob Overview\nAs an Senior AI/ML Engineer, you will be a hands-on technical expert within our post-sales delivery organization, designing, building, deploying, and troubleshooting enterprise AI solutions for our customers. You will work across AI models, agentic applications, security, MLOps, and the NVIDIA AI Enterprise software stack, supporting public-cloud, sovereign, on-premises, and hybrid environments.\nThis role is ideal for an experienced AI engineer who enjoys solving complex technical challenges, translating customer requirements into practical solutions, and delivering secure, production-ready AI systems.\nResponsibilities\nBuild Production AI Solutions\nArchitect and implement applications using commercial, open-source, and customer-developed models. \nBuild agentic solutions incorporating retrieval, tool use, workflow orchestration, memory, evaluation, guardrails, and observability. \nEvaluate models and determine when to use prompt engineering, retrieval-augmented generation, fine-tuning, or other adaptation techniques. \nIntegrate AI applications with enterprise data, APIs, tools, and business systems.\nDesign Enterprise AI Environments\nDesign and deploy solutions using the NVIDIA AI Enterprise software stack and the broader AI ecosystem. \nBuild portable solutions for AWS, Azure, GCP, on-premises data centers, and hybrid environments. \nWork with containers, Kubernetes, GPU-enabled infrastructure, networking, storage, identity, and platform services. \nImplement reliable LLMOps and MLOps practices for testing, deployment, monitoring, governance, versioning, and rollback.\nEmbed Security\nAddress AI-specific risks such as prompt injection, insecure tool use, sensitive-data exposure, excessive permissions, and software supply-chain vulnerabilities.\nApply enterprise security practices including access controls, encryption, secrets management, network segmentation, and auditability.\nSupport deployments with data-privacy, regulatory, sovereignty, or disconnected-environment requirements.\nDeliver Customer Solutions\nTranslate customer requirements and constraints into practical architectures and implementations. \nContribute directly to technical discovery, proofs of concept, production deployments, and operational support. \nTroubleshoot complex issues across AI applications, orchestration platforms, integrations, and infrastructure. \nClearly explain technical options, limitations, and tradeoffs to customers and internal stakeholders.\nQualifications\n7+ years of experience in software engineering, ML engineering, AI infrastructure, or distributed systems. \nStrong Python programming skills - testing, packaging, async, and API development, not just scripting.\nGPU model serving at scale. NVIDIA AI Enterprise (NIM, NeMo, Triton Inference Server) is what we deploy most often, and prior experience with it is a significant plus - but equivalent experience with vLLM, TGI, Ray Serve, SageMaker, or similar inference stacks is fully acceptable, and we'll support your ramp-up on the NVIDIA stack. \nProduction experience with Linux, Docker, Kubernetes, APIs, and distributed systems. \nHands-on experience building LLM applications that carried real production traffic - retrieval-augmented generation, agentic workflows, tool integration, evaluation, and guardrails. \nExperience deploying beyond a single managed cloud: multi-cloud, on-premises, or hybrid environments. \nStrong communication and technical judgment, with experience explaining tradeoffs to non-specialist stakeholders.\nPreferred Qualifications\nFamiliarity with AI-specific security risks (for example, the OWASP Top 10 for LLM Applications) and comfort partnering with security teams on enterprise controls. \nExperience with PyTorch and Hugging Face. \nExperience with agentic frameworks such as LangGraph or LlamaIndex. \nExperience with MLOps platforms such as MLflow or Kubeflow. \nExperience with model fine-tuning, data preparation, or other model-adaptation techniques. \nExperience deploying in sovereign, regulated, disconnected, or air-gapped environments. \nFamiliarity with observability and infrastructure-automation tooling (OpenTelemetry, Prometheus/Grafana, Terraform, Ansible). \nKnowledge of AI governance, model risk, data privacy, and responsible-AI practices. \nExperience delivering in customer-facing or professional-services environments.\nLocation\nThis is a remote position in the United States.\nTravel\nFlexible (with travel to client sites and Penguin Solutions offices as needed).\nCompensation & Benefits\nThe base pay range that the Company reasonably expects to pay for this position in the United States is $175,000 - 215,000; the pay ultimately offered may vary based on business considerations, including job-related knowledge, skills, experience, and education. The position is bonus-eligible, and there are medical, dental, and vision benefits available. There is a 401k saving plan and other benefits, such as Paid Time Off, Life Insurance, and an Employee Assistance Plan.\nInclusion & Belonging Statement\nWe are committed to creating an inclusive environment that embraces differences and fosters belonging for all.\nEqual Opportunity Statement\nWe are an Affirmative Action/Equal Opportunity Employer and strongly committed to all policies which will afford equal opportunity employment to all qualified persons without regard to age, national origin, race, ethnicity, creed, gender, disability, veteran status, or any other characteristic protected by law.","description_format":"text","description_chars":6996,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["401k plan","Continuous learning","Life insurance"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Education","LLM & Generative AI","High-Performance Computing"],"lifecycle":[{"event":"open","at":"2026-10-15T19:50:24Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 1","filings_12m":1,"filings_prev_12m":0,"green_card_filings_12m":0,"median_offered_wage_usd":92500,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":0}],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":1,"expected_fill_days":19,"reasons":["conf:4","velocity","win:early"],"computed_at":"2026-10-17T05:46:00Z"},"pay":{"stated_usd_annual":215000,"is_top_pay":true},"html_url":"https://alion.io/job/penguin-solutions-senior-ai-engineer","json_url":"https://alion.io/job/penguin-solutions-senior-ai-engineer.json","meta":{"generated_at":"2026-10-17T14:05:54Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":18976,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":178085},"rest":"https://alion.io/mcp/rest/get_company?id=178085"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fpenguin-solutions-senior-ai-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fpenguin-solutions-senior-ai-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fpenguin-solutions-senior-ai-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/penguin-solutions-senior-ai-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fpenguin-solutions-senior-ai-engineer"}]}