{"id":940394,"url":"https://alion.io/job/accenture-agentic-ai-quality-engineer","title":"Agentic AI Quality Engineer","company":{"id":271,"name":"Accenture","domain":"accenture.com","url":"https://alion.io/company/accenture","size_band":"5000+","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":100,"open_postings":2119,"ghost_share":0.002,"stale_share":0.17,"repost_share":0.006,"time_to_fill_p50_days":5,"computed_at":"2026-11-09T06:03:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"middle","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Amsterdam, Netherlands"],"countries":["NL"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Machine Learning","optional":false},{"name":"RAG","optional":false},{"name":"Red Teaming","optional":false},{"name":"Galileo","optional":true},{"name":"MLFlow","optional":true},{"name":"Prompt Engineering","optional":true},{"name":"Python","optional":true},{"name":"Threat Modeling","optional":true}],"status":"live","first_seen_at":"2026-09-15T17:19:32Z","employer_posted_date":"2026-09-15","last_verified_at":"2026-11-09T22:06:39Z","board_verified":true,"closed_at":null,"days_open":55,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":55},"description":"Lead with expertise, drive innovation.\nAre you an experienced professional ready to take your career to the next level? At Accenture the Netherlands, we're seeking an Agentic AI Quality Engineer who brings deep expertise, strategic thinking, and a passion for innovation to help us solve complex challenges and deliver exceptional results.\nWhat you'll do:\nQuality & Performance Evaluation\nAutomate evaluation of multi-turn conversations and long-horizon tasks using metrics for reasoning accuracy, evidence grounding, plan execution, latency, token usage, and recovery.\n\nApply schema validation, tracing, and calibrated LLM-as-a-Judge frameworks to detect inaccurate tool calls, loops, and misuse.\n\nSafety & Compliance Guardrails\nImplement filters and golden datasets to test harmful content, policy violations, hallucinations, bias, and brand drift.\n\nUse human-in-the-loop review for high-risk edge cases.\n\nAdversarial Security & Red Teaming\nRun red-team, prompt-injection, jailbreak, privacy, and PII-leak tests across agent workflows.\n\nAnalyze failures in model logic and API integrations to identify root causes and controls.\n\nMLOps & Production Monitoring\nEmbed test harnesses in CI/CD and monitor production telemetry for regressions, behavioral drift, and recovery.\n\nMaintain evaluation data lineage, versioning, curation, and golden responses.\n\nConsulting & Collaboration\nTranslate business risks into measurable quality criteria, practical controls, and release recommendations.\n\nAlign stakeholders on user journeys, edge cases, thresholds, mitigations, testability, observability, governance, and evaluation strategy.\n\nCommunicate findings and residual risks for go/no-go decisions; coach teams and share reusable assets and standards.\n\nWhat Success Looks Like (KPIs)\nSafety: Zero critical production incidents.\n\nAutomation: High coverage of non-deterministic agent paths.\n\nSpeed: Rapid regression detection and remediation after model updates.\n\nIndustry Context & Methodology Alignment\nTreat non-determinism as a core characteristic. As the Data Science Collective notes, robust testing verifies correct reasoning, grounded evidence, scoped actions, and safe, compliant decisions.\n\nDrive continuous optimization by embedding evaluation in CI/CD, using tunable judges, aligned scorers, automated dataset updates, and dashboards, as outlined by Databricks.\n\nHow We Reinvent\nAt Accenture, our teams operate within one of our core service lines- Digital Core, Industry & Enterprise, Supply Chain & Engineering, Cybersecurity, Song, Finance, Talent, Client Groups, Global Operations, Reinventions Services -each designed to drive reinvention at scale. This role falls under Digital Core, where we help clients modernize their technology foundations and accelerate business transformation through cloud, data, software engineering, and AI.\nYou will join multidisciplinary teams consisting of quality engineers, software engineers, architects, AI specialists, platform engineers, and business consultants. Together, we help organizations reinvent how software is designed, built, tested, deployed, and operated through the power of AI.\nWe go to market by industry, leveraging our global delivery network and strategic partnerships with ecosystem leaders like Microsoft, AWS, and Google. Our culture of shared success and continuous learning ensures that every team member contributes to-and benefits from-our reinvention journey.\nWhat we're looking for:\nEducation: Bachelor’s or Master’s in Computer Science, Data Science, or a related quantitative field.\n\nExperience: 3+ years in machine learning QA, AI evaluation engineering, or MLOps engineering.\n\nLanguage(s):\nDutch - B2+ for collaboration with Dutch-speaking clients and stakeholders.\n\nEnglish - C2.\n\nSkills:\nAgentic AI Expertise: Experience evaluating autonomous agents, multi-step workflows, or Retrieval-Augmented Generation (RAG) applications.\n\nTechnical Stack: Strong Python proficiency and experience with AI evaluation tools such as MLflow, Galileo, and PyRIT.\n\nFramework Mastery: Deep knowledge of prompt engineering, vector databases, tool schema design, and execution telemetry.\n\nSecurity Mindset: Hands-on experience in adversarial testing, threat modeling, or model safety guardrails.\n\nLeadership: Strong communication, technical leadership, a growth mindset, and commitment to continuous innovation.\n\nBonus points for:\nTMAP or ISTQB Certification\n\nContributions to open-source projects or engineering communities\n\nWhat we offer:\nWork-Life Flexibility: 4x9 Workweek Option, Hybrid Working, FlexDay\n\nFinancial Well-being: Competitive Base Salary, MyBenefits Budget, Annual Bonus, Net Allowance, Employee Share Purchase Plan\n\nHealth & Wellness: Collective Health Insurance Scheme, Mental Health Support, Well-being Hub\n\nTime Off & Leave: 26 Vacation Days, Special Leave Types (parental leave, partner leave, bereavement leave, and gender affirmation leave), Culture Days\n\nMobility & Commuting: NS Business Card, Mobility Budget(option to choose between electric bike, car lease, or public transport reimbursement)\n\nCareer Development: Performance Achievement Program, Learning & Development Platform, Guidance from People Leads\n\nInclusion, Diversity & Social Impact: Do Good Volunteer Program, I&D Networks, Refugee Talent Track\n\nCulture & Community: Accentrics & Friday Drinks, Annual Accenture NL Party, Flat Organizational Hierarchy\n\nReady to lead and innovate? Apply today and become a Reinventor at Accenture the Netherlands.\nAbout Accenture\nAccenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services-creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.Visit us atwww.accenture.com\nEqual Employment Opportunity Statement\nWe believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, sexual orientation, gender identity or expression, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.","description_format":"text","description_chars":7229,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[{"language":"Dutch","level":"Upper-Intermediate (B2)","optional":false},{"language":"English","level":"Proficiency (C2)","optional":false}]},"benefits":["Car lease","Continuous learning","Health insurance","Hybrid work","Parental leave"],"hiring_locations":[{"name":"Netherlands","iso":"NL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","Systems Integrators","Business Process Outsourcing (BPO)","Management Consulting"],"lifecycle":[{"event":"open","at":"2026-09-15T17:19:32Z"}],"visa":[],"liveness":{"score":5,"band":"cold","label":"Long shot","p_open":1,"p_active":0.189,"p_room":0.28,"age_days":54,"expected_fill_days":5,"reasons":["conf:2","velocity","win:tail","crowd:brand"],"computed_at":"2026-11-09T06:03:00Z"},"pay":null,"html_url":"https://alion.io/job/accenture-agentic-ai-quality-engineer","json_url":"https://alion.io/job/accenture-agentic-ai-quality-engineer.json","meta":{"generated_at":"2026-11-09T22:45:39Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":12702,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-10T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":271},"rest":"https://alion.io/mcp/rest/get_company?id=271"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Faccenture-agentic-ai-quality-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Faccenture-agentic-ai-quality-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Faccenture-agentic-ai-quality-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/accenture-agentic-ai-quality-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Faccenture-agentic-ai-quality-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":940394}},{"tool":"search_jobs","arguments":{"company":"accenture.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":940394},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}