{"id":2878378,"url":"https://alion.io/job/proofpoint-qa-engineer-ai-systems-iii","title":"QA Engineer - AI Systems III","company":{"id":5122,"name":"Proofpoint","domain":"proofpoint.com","url":"https://alion.io/company/proofpoint","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":84,"open_postings":14,"ghost_share":0,"stale_share":0.643,"repost_share":0,"time_to_fill_p50_days":38,"computed_at":"2026-10-21T05:46:15Z"}},"role":"QA","role_family":"QA","seniority":"middle","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Hyderabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":10000,"max_usd":26000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":13},"experience_years_min":2,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"DeepEval","optional":false},{"name":"FastAPI","optional":false},{"name":"Function Calling","optional":false},{"name":"GCP","optional":false},{"name":"Go","optional":false},{"name":"Hallucination","optional":false},{"name":"LLM","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"Promptfoo","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Rest API","optional":false},{"name":"SQL","optional":false},{"name":"Structured Outputs","optional":false},{"name":"Tool Use","optional":false}],"status":"live","first_seen_at":"2026-10-19T22:09:24Z","employer_posted_date":"2026-10-19","last_verified_at":"2026-10-21T06:27:42Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"About Us:\nProofpoint is a global leader in human- and agent-centric cybersecurity. We protect how people, data, and AI agents connect across email, cloud, and collaboration tools. Over 80 of the Fortune 100, 10,000 large enterprises, and millions of smaller organizations trust Proofpoint to stop threats, prevent data loss, and build resilience across their people and AI workflows. Our mission is simple: safeguard the digital world and empower people to work securely and confidently. Join us in our pursuit to defend data and protect people.\nHow We Work:\nAt Proofpoint you’ll be part of a global team that breaks barriers to redefine cybersecurity guided by our BRAVE core values:\nBold in how we dream and innovate\nResponsive to feedback, challenges and opportunities\nAccountable for results and best in class outcomes\nVisionary in future focused problem-solving\nExceptional in execution and impact\nWe're looking for an AI Engineer who is passionate about both building AI-powered applications and ensuring they work reliably in production. This role combines AI engineering with quality engineering, focusing on developing LLM-based solutions while creating automated testing and evaluation frameworks to measure quality, accuracy, safety, and performance. You will work closely with engineering, product, and business teams to deliver AI solutions that are not only innovative, but also measurable, stable, and production-ready. \nResponsibilities:\n- AI Engineering: Build and maintain AI-powered applications using LLMs, RAG pipelines, and agent-based workflows. \n- Develop integrations with foundation models and AI services using Python and modern AI frameworks.\n- Design prompt workflows, structured outputs, tool calling, and retrieval-based systems.\n- Build APIs, backend services, and internal tools using FastAPI or similar frameworks.\n- Collaborate with stakeholders to translate business requirements into AI solutions.\n- AI Quality & Automation Design and execute automated test suites for AI applications and agentic workflows.\n- Create and maintain evaluation datasets, benchmark scenarios, and regression test cases.\n- Build pipelines to measure response quality, hallucinations, accuracy, latency, and cost.\n- Implement LLM-as-a-judge evaluations and automated scoring frameworks using tools such as DeepEval, RAGAS, or PromptFoo.\n- Develop AI-powered test generation for functional, edge-case, and negative testing scenarios.\n- Perform adversarial testing including prompt injection, jailbreak attempts, and safety validation.\n- Monitor production AI systems through logging, tracing, and quality dashboards.\n- Work with engineering teams to establish quality gates before AI features are released.\nRequired Qualifications:\n- 2- 4 years of software engineering, QA automation, AI engineering, or related experience.\n- Strong Python and Golang programming skills and understanding of software engineering fundamentals.\n- Familiarity with LLM applications, prompt engineering, RAG, or agent-based AI systems.\n- Experience in test automation using frameworks such as PyTest or equivalent tools.\n- Understanding of API testing, backend services, and REST architectures.\n- Knowledge of AI evaluation concepts such as hallucination detection, response quality measurement, benchmark testing, and regression testing.\n- Experience with SQL and basic cloud platforms (AWS, Azure, or GCP). \n- Strong analytical and problem-solving skills.\nWhy Proofpoint?\nAt Proofpoint, we believe that an exceptional career experience includes a comprehensive compensation and benefits package. Here are just a few reasons you’ll love working with us:\nCompetitive compensation\n\nComprehensive benefits\n\nCareer success on your terms\n\nFlexible work environment\n\nAnnual wellness and community outreach days\n\nAlways on recognition for your contributions\n\nGlobal collaboration and networking opportunities\n\nOur Culture:\nOur culture is rooted in values that inspire belonging, empower purpose and drive success-every day, for everyone.\nWe encourage applications from individuals of all backgrounds, experiences, and perspectives. If you need accommodation during the application or interview process, please reach out to .\nHow to Apply\nInterested? Submit your application along with any supporting information- we can’t wait to hear from you!","description_format":"text","description_chars":4358,"description_truncated":false,"requirements":{"experience_years_min":2,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Flexible schedule"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Data Loss Prevention","Email Security","Cybersecurity AI"],"lifecycle":[{"event":"open","at":"2026-10-19T22:09:24Z"}],"visa":[],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":1,"expected_fill_days":38,"reasons":["conf:7","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-10-21T05:46:15Z"},"pay":null,"html_url":"https://alion.io/job/proofpoint-qa-engineer-ai-systems-iii","json_url":"https://alion.io/job/proofpoint-qa-engineer-ai-systems-iii.json","meta":{"generated_at":"2026-10-21T06:50:58Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":9659,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5122},"rest":"https://alion.io/mcp/rest/get_company?id=5122"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fproofpoint-qa-engineer-ai-systems-iii"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fproofpoint-qa-engineer-ai-systems-iii"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fproofpoint-qa-engineer-ai-systems-iii"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/proofpoint-qa-engineer-ai-systems-iii\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fproofpoint-qa-engineer-ai-systems-iii"}]}