{"id":1740374,"url":"https://alion.io/job/vertex-senior-principal-ai-engineer-2","title":"Senior Principal AI Engineer","company":{"id":3854728,"name":"Vertex","domain":"vertex.com","url":"https://alion.io/company/vertex-8","size_band":null,"is_staffing_agency":false,"employer_type":"staffing","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"lead","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"inferred_payroll_markers","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":229800,"max":298700,"currency":"USD","period":"year","gross":null,"usd_annual":298700},"salary_estimate":null,"experience_years_min":15,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Azure","optional":false},{"name":"Embeddings","optional":false},{"name":"Fine-tuning","optional":false},{"name":"Hybrid Search","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"LoRA","optional":false},{"name":"Model Context Protocol","optional":false},{"name":"PEFT","optional":false},{"name":"QLoRA","optional":false},{"name":"Quantization","optional":false},{"name":"RAG","optional":false},{"name":"FinOps","optional":true},{"name":"Prompt Engineering","optional":true},{"name":"Transformers","optional":true}],"status":"live","first_seen_at":"2026-10-03T02:03:32Z","employer_posted_date":null,"last_verified_at":"2026-10-03T02:03:32Z","board_verified":false,"closed_at":null,"days_open":26,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":26},"description":"Job Description:\nServe as the most senior individual-contributor engineer and principal technical authority within the Commercial AI Center of Excellence (CAI CoE), owning the technical vision for AI-as-a-Service (AIaaS) enablement at enterprise scale. \n\nOperate as a full-spectrum AI engineer fluent across the entire lifecycle — data, model training and fine-tuning, retrieval, orchestration, evaluation, and production operations — able to go as deep as any specialist and to compose the pieces into coherent, production-grade systems. \n\nThis role requires both traditional AI/ML, GenAI product engineering, and traditional software architecture skillsets. \n\nEstablish reference architectures, paved-road patterns, and enterprise technical standards for agentic orchestration, tool and MCP design, retrieval, model training, and responsible AI across production systems. \n\nLead the most complex, ambiguous, cross-team initiatives spanning multiple value streams, and review and influence AI designs across product teams to ensure alignment with enterprise standards. \n\nSet long-term technical direction while remaining deeply hands-on with the most critical AI infrastructure and services. \n\nKey ResponsibilitiesSet the multi-year technical vision, reference architectures, and enterprise standards for AIaaS across PDD, and act as the final technical authority and escalation point for the organization's hardest AI problems. \n\nDefine and own the enterprise model-training strategy across traditional AI/ML and LLMs, and personally train, fine-tune (e.g., QLoRA, LoRA, PEFT, and full fine-tuning), and evaluate models when the problem demands it. \n\nEstablish standards for how and where training data from Commercial AI products is sourced, cleaned, versioned, stored, and governed (lineage, licensing/consent, and PII), and architect the large-scale data and feature pipelines behind them. \n\nArchitect the orchestration and abstraction layers of the central AI system that connect LLMs to tools, data, and sub-agents, and set standards for MCP servers, tool-surface design (optimal number of tools exposed per LLM and APIs per server), and when to use specialized sub-agents versus direct tool exposure. \n\nDesign retrieval/RAG systems end to end — chunking strategies, embeddings, vector stores, hybrid search, re-ranking, context assembly, and memory. \n\nOwn the enterprise evaluation, observability, and safety strategy for AI systems, including offline and online evaluation, tracing, red-teaming, guardrails, and responsible-AI and compliance requirements. \n\nDrive build-versus-buy, model and vendor selection, and long-term architectural bets, anticipating where the field is heading and preparing the organization to adopt it. \n\nOptimize the performance, cost (token and inference economics), scalability, and reliability of AI workloads in partnership with Security, Cloud Platform, and SRE teams. \n\nMultiply the organization: mentor and grow Principal and Staff engineers and raise the AI engineering bar. \n\nRequired Qualifications15+ years in AI/ML software engineering with demonstrated Senior Principal-level (or equivalent) impact delivering production AI at enterprise scale. \n\nFull-lifecycle, hands-on mastery across both specialist domains: (a) training and fine-tuning traditional AI/ML models and LLMs — including parameter-efficient methods (QLoRA/LoRA/PEFT), quantization, distributed training, and rigorous evaluation; and (b) LLM orchestration, agentic systems, tool/MCP design, and retrieval/RAG in production. \n\nDeep expertise in distributed systems, cloud-native architecture, and large-scale data and feature pipelines. \n\nStrong command of data management and governance: dataset storage architecture, versioning, lineage, quality, PII handling, and licensing/consent for training data. \n\nProven ability to design developer platforms, APIs, reusable SDKs, MCP servers, and multi-agent orchestrations that many teams depend on. \n\nRigorous, demonstrated approach to AI evaluation, observability and tracing, and responsible-AI guardrails. \n\nExpertise with cloud platforms (Azure strongly preferred) and a track record of optimizing AI workload cost, performance, scalability, and reliability. \n\nDemonstrated ability to set technical strategy and influence decisions across many teams without direct authority, and to mentor Principal- and Staff-level engineers. \n\nExperience operating in regulated SaaS environments and meeting security and compliance requirements. \n\nPreferred QualificationsBachelor's degree in Computer Science, Engineering, or a related discipline; advanced degree preferred. An equivalent combination of education, training, and relevant professional experience is accepted in lieu of a formal degree. \n\nIndustry experience in tax or other regulated domains (insurance, fintech, or healthcare). \n\nExperience with vector databases and retrieval optimization at scale. \n\nFinOps for GenAI: experience modeling and optimizing LLM token and inference costs. \n\nData science or classical AI background beyond prompt engineering (statistics, feature engineering, and model evaluation). \n\nContributions to open-source AI tooling, published research, patents, or recognized technical thought leadership. \n\nStrong executive communication and technical storytelling skills. \n\nDisclaimer:The above statements describe the general nature and level of work performed in this role. Other duties may be assigned.\nOther Qualifications:\nThe Winning Way behaviors that all Vertex employees need in order to meet the expectations of each other, our customers, and our partners.\n• Communicate with Clarity - Be clear, concise and actionable. Be relentlessly constructive. Seek and provide meaningful feedback.\n• Act with Urgency - Adopt an agile mentality - frequent iterations, improved speed, resilience. 80/20 rule – better is the enemy of done. Don’t spend hours when minutes are enough.\n• Work with Purpose - Exhibit a “We Can” mindset. Results outweigh effort. Everyone understands how their role contributes. Set aside personal objectives for team results.\n• Drive to Decision - Cut the swirl with defined deadlines and decision points. Be clear on individual accountability and decision authority. Guided by a commitment to and accountability for customer outcomes.\n• Own the Outcome - Defined milestones, commitments and intended results. Assess your work in context, if you’re unsure, ask. Demonstrate unwavering support for decisions.\nComments:The above statements are intended to describe the general nature and level of work being performed by individuals in this position. Other functions may be assigned, and management retains the right to add or change the duties at any time.\nPay Transparency Statement:\nUS Base Salary Range: $229,800.00 - $298,700.00Base pay offered to new hires may vary based upon factors including relevant industry and job-related skills and experience, geographic location, and business needs.* The range displayed does not encompass the full potential of the role, which allows for further growth and career progression.\nIn addition, as a part of our total compensation package, this role may be eligible for the Vertex Bonus Plan (VOB), a role-specific sales commission/bonus, and/or equity grants.\nLearn more about Life at Vertex and connect with your recruiter for more details regarding Vertex's compensation and benefit programs.\n*In no case will your pay fall below applicable local minimum wage requirements.\nOriginally posted on Himalayas","description_format":"text","description_chars":7514,"description_truncated":false,"requirements":{"experience_years_min":15,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Software","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-03T03:01:43Z"}],"visa":[],"liveness":{"score":50,"band":"ok","label":"Likely open","p_open":0.85,"p_active":0.785,"p_room":0.75,"age_days":26,"expected_fill_days":28,"reasons":["seen:26","velocity","win:late"],"computed_at":"2026-10-29T05:49:05Z"},"pay":{"stated_usd_annual":298700,"is_top_pay":true},"html_url":"https://alion.io/job/vertex-senior-principal-ai-engineer-2","json_url":"https://alion.io/job/vertex-senior-principal-ai-engineer-2.json","meta":{"generated_at":"2026-10-29T15:30:12Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":23281,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3854728},"rest":"https://alion.io/mcp/rest/get_company?id=3854728"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fvertex-senior-principal-ai-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fvertex-senior-principal-ai-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fvertex-senior-principal-ai-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/vertex-senior-principal-ai-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fvertex-senior-principal-ai-engineer-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":1740374}},{"tool":"search_jobs","arguments":{"company":"vertex.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":1740374},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}