{"id":1253239,"url":"https://alion.io/job/legacyleap-qa-automation-engineer","title":"QA Automation Engineer","company":{"id":2209300,"name":"Legacyleap","domain":"legacyleap.ai","url":"https://alion.io/company/legacyleap","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"QA","role_family":"QA","seniority":"middle","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":["India"],"countries":["IN"],"hiring_countries":["IN"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":10000,"max_usd":26000,"period":"year","method":"role_seniority_country_cell","sample_n":9},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"CI/CD","optional":false},{"name":"Java","optional":false},{"name":"LLM","optional":false},{"name":"Playwright","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Selenium","optional":false},{"name":"SQL","optional":false},{"name":"TestNG","optional":false},{"name":"DeepEval","optional":true},{"name":"LangSmith","optional":true},{"name":"Linux","optional":true},{"name":"Unix","optional":true}],"status":"live","first_seen_at":"2026-09-10T11:04:30Z","employer_posted_date":null,"last_verified_at":"2026-09-10T11:04:30Z","board_verified":false,"closed_at":null,"days_open":20,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":20},"description":"QA Automation Engineer - AI & Application Testing\n\nExperience : 3 + Years\n\nLocation : Remote\n\nEmployment Type : Full-time\n\nAbout LegacyLeap :\n\nLegacyLeap is a fast-growing technology startup building AI-powered solutions for enterprise application modernization.\n\nWe're working at the intersection of GenAI, Agentic AI, data intelligence, and software engineering to solve complex real-world problems around legacy enterprise systems.\n\nThis is an opportunity to join an early-stage, engineering-driven team where you won't just execute predefined tasks - you'll have the opportunity to build, experiment, challenge existing approaches, and directly influence the quality of the product.\n\nIf you enjoy working on challenging engineering problems and want to grow with a startup that is building something meaningful with AI, we'd love to hear from you.\n\nAbout the Role :\n\nWe are looking for a QA Automation Engineer with strong core QA fundamentals, hands-on coding skills in Python or Java, and experience in automation, API testing and CI/CD.\n\nThe ideal candidate has exposure to AI/GenAI/LLM or Agentic AI application testing and brings a strong QA mindset - someone who naturally looks for gaps, edge cases and opportunities to improve the product and testing process.\n\nWhat You'll Do :\n\n- Design and develop scalable test automation frameworks for web, mobile, API and modern applications.\n\n- Perform functional, integration, regression and end-to-end testing.\n\n- Build automation using Python or Java and frameworks such as PyTest, Playwright, Selenium, TestNG or similar.\n\n- Integrate automated testing into CI/CD pipelines.\n\n- Test AI/GenAI/LLM-powered applications and Agentic AI workflows.\n\n- Evaluate AI outputs for correctness, relevance, consistency and quality.\n\n- Identify AI-specific risks including hallucinations, prompt injection, jailbreaks and unexpected behaviour.\n\n- Perform API and backend/data validation.\n\n- Work closely with Product and Engineering teams to identify quality risks early.\n\n- Continuously improve test coverage, automation, processes and overall product quality.\n\n- Quickly adapt to new technologies, products and business domains.\n\nMust-Have Skills :\n\n- 3 + years of QA / Software Testing / Automation experience\n\n- Strong understanding of Core QA concepts\n\n- Good programming skills in Python or Java\n\n- Strong problem-solving and logical reasoning skills\n\n- Hands-on automation experience with PyTest, Playwright, Selenium, TestNG or similar\n\n- API testing/automation experience\n\n- CI/CD experience\n\n- SQL/backend validation\n\n- Experience with AI/GenAI/LLM application testing is highly preferred\n\n- Experience with AI evaluation / LLM evaluation / RAG / AI Agent testing is a strong plus\n\nGood to Have :\n\n- Mobile application testing\n\n- Linux / Unix and shell scripting\n\n- RAGAS, DeepEval, LangSmith or similar AI evaluation tools\n\n- Conversational AI / chatbot testing\n\n- Agentic AI testing\n\n- Experience across multiple projects, products or domains\n\n- Product-based company experience\n\nWho Will Thrive Here?\n\nSomeone who doesn't simply ask: \"What should I test?\" - but asks: \"What could go wrong? What are we missing? How can we make this better?\"\n\nWe value strong engineering fundamentals, curiosity, ownership, adaptability and a continuous-improvement mindset.\n\nWhy Join LegacyLeap?\n\n- Growing startup - Be part of the journey from an early stage.\n\n- Work with AI - Get hands-on exposure to GenAI, Agentic AI and intelligent enterprise systems.\n\n- Build, don't just maintain - Your work will directly shape products and engineering practices.\n\n- High ownership - Opportunity to take responsibility and make an impact.\n\n- Learn & grow - Work alongside experienced engineers on challenging real-world problems.\n\n- Remote - Work with a distributed, collaborative team.\n\nIf you're excited about QA, automation and the future of AI-powered software, come build it with us.\nSkills\nAutomation Testing, API Testing, Python, Java, Selenium, PyTest, AI/ML Testing, TestNG, Application Testing, RAG","description_format":"text","description_chars":4038,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-09-25T18:04:06Z"}],"liveness":{"score":47,"band":"ok","label":"Likely open","p_open":0.85,"p_active":0.744,"p_room":0.75,"age_days":20,"expected_fill_days":28,"reasons":["seen:20","win:late"],"computed_at":"2026-10-01T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/legacyleap-qa-automation-engineer","json_url":"https://alion.io/job/legacyleap-qa-automation-engineer.json","meta":{"generated_at":"2026-10-01T09:46:30Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":517,"day_limit":5000,"remaining_today":4483,"minute_limit":60,"resets_at":"2026-10-02T00:00:00Z"}}}