{"id":664935,"url":"https://alion.io/job/verantos-senior-sdet","title":"Senior SDET","company":{"id":689565,"name":"Verantos","domain":"verantos.com","url":"https://alion.io/company/verantos","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":75,"open_postings":4,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-11-01T06:10:25Z"}},"role":"QA","role_family":"QA","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pune, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":11500,"max_usd":28000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":35},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"GitHub Actions","optional":false},{"name":"Hallucination","optional":false},{"name":"Langfuse","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"Playwright","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"Ragas","optional":false},{"name":"Rest API","optional":false},{"name":"Shift-Left Security","optional":false},{"name":"Amazon CloudWatch","optional":true},{"name":"Amazon ECS","optional":true},{"name":"Amazon S3","optional":true},{"name":"ETL/ELT","optional":true},{"name":"HIPAA","optional":true},{"name":"JMeter","optional":true},{"name":"k6","optional":true},{"name":"Snowflake","optional":true},{"name":"SOC 2","optional":true},{"name":"SQL","optional":true}],"status":"live","first_seen_at":"2026-09-07T06:27:43Z","employer_posted_date":"2026-09-07","last_verified_at":"2026-11-02T01:21:44Z","board_verified":true,"closed_at":null,"days_open":55,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":55},"description":"Overview\nVerantos (https://verantos.com) is the market leader in high-accuracy real-world evidence (RWE) generation. The Verantos RWE platform integrates heterogeneous real-world data sources and generates evidence with the accuracy necessary for regulatory and reimbursement use. The platform leverages data science and artificial intelligence, along with advanced data sources such as electronic health records (EHR), to generate RWE capable of supporting complex clinical studies. Some of the largest biopharma companies in the world are Verantos customers.\nWe use a heterogeneous AWS-centric tech stack with data processing, AI, workflows, and analytics. Our teams are cross-functional and collaborative, bringing together engineering, product, design, QA, and clinical domain experts to deliver meaningful, real-world impact.\nThis position is open only to candidates currently based in Pune.\nDescription\nWe're looking for a Senior SDET to own end-to-end quality for assigned product features across web apps and backend APIs, with a strong focus on evaluating AI/LLM-powered workflows. You'll build CI-gated automation and evaluation harnesses - covering UI, API, and non-deterministic AI agent behavior - set testing standards for the team, and drive a shift-left quality culture with engineering and product teams.\nResponsibilities\nDesign and maintain Python-based test automation frameworks for UI (Playwright) and REST APIs - reusable, scalable, and maintainable across the team's test suites\nBuild automated evaluation suites for AI/LLM-powered features - tracking output correctness, hallucination rate, and regression across model/prompt versions - using tools such as Langfuse, Ragas, or equivalent\nCollaborate with engineering leads to define and integrate CI/CD quality checks in GitHub Actions - wiring test suites and evaluation runs into the pipeline and agreeing on pre-merge gates that block on failed tests, evaluation-score thresholds, or schema-compatibility issues\nSet testing standards and best practices for automation and AI evaluation, and mentor other SDETs on the team\nContribute to acceptance criteria and flag quality risks early, working with cross-timezone engineering and product stakeholders\nExecute release verification for assigned features - feature-flag checks, smoke tests, and rollback validation\nQualifications\n5+ years as an SDET with end-to-end quality ownership across web apps, backend APIs, and release processes\nStrong Python skills for test automation, API testing, and Pytest; hands-on experience with Playwright\nExperience evaluating AI/LLM-powered features - familiarity with metrics such as hallucination rate, output correctness, or LLM-as-judge approaches, and hands-on experience with at least one evaluation/tracing tool (e.g., Langfuse, Ragas)\nExperience integrating quality checks into CI/CD pipelines in GitHub Actions (or equivalent) - writing and maintaining pre-merge checks, test/quality gates, and pipeline configuration\nTrack record of setting testing standards or mentoring other engineers/SDETs\nStrong communication skills; comfortable working across time zones\nBachelor's in CS, Engineering, or equivalent experience\nNice to Have\nSQL proficiency and experience validating ETL/batch transforms in Snowflake, Athena, or equivalent; familiarity with idempotency and failure recovery\nExperience testing access control and data security in multi-tenant systems (RBAC, dataset-level permissions); exposure to compliance frameworks such as HIPAA, SOC 2, or HITRUST\nWorking knowledge of AWS (S3, ECS, CloudWatch) and tracing/logging tools\nExperience conducting performance, load, or stress testing (k6, JMeter)\nFamiliarity with healthcare data infrastructure, the OMOP Common Data Model (CDM), or clinical vocabularies\nWhy Verantos?\nWork at the intersection of cutting-edge tech, complex data, and healthcare research - where your quality engineering directly shapes research-grade evidence.\nWe Offer\nCompetitive salary\nComprehensive medical benefits and work-life balance\nCollaboration with healthcare technology visionaries","description_format":"text","description_chars":4087,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["CRO & CDMO Services","Medical AI"],"lifecycle":[{"event":"open","at":"2026-09-10T21:52:37Z"}],"visa":[],"liveness":{"score":28,"band":"fade","label":"Fading","p_open":1,"p_active":0.617,"p_room":0.45,"age_days":54,"expected_fill_days":36,"reasons":["conf:1","win:tail"],"computed_at":"2026-11-01T06:10:25Z"},"pay":null,"html_url":"https://alion.io/job/verantos-senior-sdet","json_url":"https://alion.io/job/verantos-senior-sdet.json","meta":{"generated_at":"2026-11-02T04:59:13Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":7172,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-03T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":689565},"rest":"https://alion.io/mcp/rest/get_company?id=689565"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fverantos-senior-sdet"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fverantos-senior-sdet"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fverantos-senior-sdet"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/verantos-senior-sdet\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fverantos-senior-sdet"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":664935}},{"tool":"search_jobs","arguments":{"company":"verantos.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":664935},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}