{"id":3567535,"url":"https://alion.io/job/ciklum-senior-automation-qa-javascript-engineer","title":"Senior Automation QA (JavaScript) Engineer","company":{"id":181259,"name":"Ciklum","domain":"ciklum.com","url":"https://alion.io/company/ciklum","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Oracle","truth_index":{"grade":"B","score":75,"open_postings":12,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-11-04T06:34:25Z"}},"role":"QA","role_family":"QA","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":11500,"max_usd":29000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":35},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CI/CD","optional":false},{"name":"GitHub Actions","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"JavaScript","optional":false},{"name":"Langfuse","optional":false},{"name":"LLM","optional":false},{"name":"OpenTelemetry","optional":false},{"name":"OWASP","optional":false},{"name":"Playwright","optional":false},{"name":"RAG","optional":false},{"name":"SQL","optional":false},{"name":"Synthetic Data","optional":false},{"name":"Temporal","optional":false},{"name":"TypeScript","optional":false},{"name":"AI Agents","optional":true},{"name":"Arize Phoenix","optional":true},{"name":"DeepEval","optional":true},{"name":"GDPR","optional":true},{"name":"Go","optional":true},{"name":"k6","optional":true},{"name":"LangSmith","optional":true},{"name":"Locust","optional":true},{"name":"OCR","optional":true},{"name":"Promptfoo","optional":true},{"name":"SOC 2","optional":true}],"status":"live","first_seen_at":"2026-09-10T07:42:35Z","employer_posted_date":"2026-09-10","last_verified_at":"2026-11-04T04:32:24Z","board_verified":true,"closed_at":null,"days_open":55,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":55},"description":"Ciklum is looking for a Senior Automation QA (JavaScript) Engineer to join our team full-time in India.\nWe are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.\nAbout the role:\nAs a Senior Automation QA (JavaScript) Engineer, become a part of a cross-functional development team engineering experiences of tomorrow. Ciklum is seeking a Senior AI Automation QA Engineer to join the client project, an ambitious initiative to build an enterprise-grade Agent Development Platform (ADP) that our client will commercialize to their own customers. This is quality engineering for a system that is non-deterministic by nature, where \"expected output\" is a statistical claim rather than a string match, and where the platform's reliability guarantees no lost workflow runs, strict tenant isolation, graceful degradation under provider outages are contractual commitments, not aspirations. You will build the automation that proves those guarantees hold, release after release.\nYou will own the test automation that spans the whole platform: the Frontend and Backend that agent developers depend on, the long-running Temporal workflows that must survive worker crashes and provider failures, the multi-tenant isolation boundaries that protect one customer's data from another, and the performance and concurrency targets defined in the platform's NFRs. Much of your craft is adversarial and failure-first injecting worker kills, retry storms, and malformed documents to verify the system recovers exactly as specified, and negative-testing disallowed tool calls and egress paths to confirm the sandbox holds. Where agent behavior must be judged rather than asserted, you will partner closely with the evaluation function, contributing the test infrastructure, synthetic-data pipelines, and CI integration that make quality measurable and repeatable.\nThis is a high-visibility role where we establish the production-ready foundation the rest of the program is built on. Your automated suites become release gates, and the evidence they produce feeds directly into client milestone sign-offs so your work must be reproducible, trustworthy, and defensible to a sophisticated client. As the platform scales toward an \"agent-a-month\" delivery cadence, you will build the reusable test scaffolds and harnesses that let quality keep pace with delivery, ensuring that month twelve ships as safely as month one. You will work shoulder-to-shoulder with AI engineers, platform engineers, and the evaluation team, embedding quality from the design stage rather than inspecting for it at the end.\nResponsibilities:\nDesign, build, and maintain automated test suites for the platform, Frontend and Backend, including contract tests that protect the agent-developer experience as the SDK evolves\nBuild automated tests for long-running Temporal workflows including failure injection (worker kill, provider outage, retry storms) to verify durable-execution guarantees such as zero lost runs and correct compensation/saga behavior\nAutomate multi-tenant isolation verification cross-tenant data access, configuration bleed, and cost-attribution correctness executed per release as a platform acceptance criterion\nVerify agent execution sandboxing and egress controls through negative testing of disallowed tool calls and network destinations\nAI-Specific & Non-Deterministic Testing\nDesign test strategies for LLM-driven behavior: statistical assertions over repeated runs (pass^k consistency), semantic-similarity scoring, confidence-threshold validation, and flakiness quarantine that distinguishes model variance from genuine regression\nBuild and continuously extend adversarial test corpora document-borne prompt injection in lease PDFs, tool-call hijack, and data-exfiltration probes aligned to OWASP LLM Top 10 and recognized red-team taxonomies\nVerify Human-in-the-Loop (HITL) escalation behavior confidence thresholds fire correctly and no gated/irreversible action completes without authorization\nPartner with the evaluation function on golden-dataset-driven checks, contributing test infrastructure, synthetic-data (synthetic lease) pipelines, and CI integration that make agent quality measurable and repeatable\nPerformance, Reliability & NFR Verification\nAutomate verification of platform NFRs invocation overhead (p95), concurrency targets, queue backpressure behavior, and LLM provider failover time and surface trends per release\nUse tracing data (Langfuse / OpenTelemetry spans) as a first-class test asset: assert on trace completeness, token/cost-accounting accuracy, and alerting behavior for anomalous runs\nProcess, Evidence & Collaboration\nWire test suites into CI/CD as hard release gates with automated, per-metric regression flagging on pull requests\nProduce auditable, reproducible test-evidence packs that feed directly into client milestone sign-off\nEmbed with AI and platform engineers from the design stage making acceptance criteria, testability, and observability inputs to architecture, not afterthoughts\nMaintain test environments, mocked LLM/provider layers, and synthetic data generators that keep test runs fast, deterministic where possible, and affordable\nMentor mid-level QA engineers, codify AI testing patterns into reusable internal frameworks, and contribute to Ciklum's quality engineering practice and AI Academy\nRequirements:\n8+ years of test automation with API testing, and building test frameworks other engineers adopt, not just test cases\nHands-on experience testing LLM-powered or other non-deterministic systems statistical assertions, semantic scoring, and managing model variance (this is the differentiator; cite real examples)\nExperience testing asynchronous, event-driven systems failure injection, idempotency verification, eventual-consistency assertions; Temporal or a similar workflow engine a strong plus\nStrong CI/CD integration skills (GitHub Actions or equivalent) and the discipline to design release gates\nSolid SQL and data-validation skills; comfort building synthetic test-data pipelines and measuring dataset quality\nA security-testing and adversarial mindset; familiarity with prompt-injection techniques or a strong AppSec testing background with willingness to specialize fast\nDemonstrated judgment on what \"tested enough\" means under milestone pressure, and the ability to defend quality evidence to non-engineering stakeholders\nStrong proficiency in Playwright and TypeScript is mandatory for building automated test suites\nQA Automation Core: Extensive experience in building automated test frameworks (Playwright/Typescript-based) and integrating them into high-security CI/CD pipelines\nAI/LLM Literacy: Deep understanding of Large Language Model behaviors, prompt sensitivity, and the common failure modes of RAG (Retrieval-Augmented Generation) systems\nAnalytical Mindset: Strong capability in statistical analysis to interpret evaluation scores and provide actionable feedback to AI Engineers for prompt tuning\nDesirable:\nPerformance/load tooling (k6, Locust) for concurrency and latency NFR verification\nPrior testing of multi-tenant SaaS isolation\nExposure to eval/observability stacks (Langfuse, LangSmith, Promptfoo, DeepEval, Arize Phoenix)\nCompliance evidence experience (SOC 2, GDPR) or accessibility testing (Section 508 / WCAG)\nFamiliarity with Commercial Real Estate workflows (lease accounting, CAM reconciliation) or document-extraction systems (OCR, layout parsing)\nExperience using LLMs to generate test cases, adversarial payloads, or synthetic documents\nPerformance Testing: Experience testing high-concurrency background processing within agentic systems\nExperience with qTest for test management\nWhat’s in it for you?\nStrong community: Work alongside top professionals in a friendly, open-door environment\nGrowth focus: Take on large-scale projects with a global impact and expand your expertise\nTailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications\nEndless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies\nCare: We’ve got you covered with company-paid medical insurance, mental health support, and financial & legal consultations\nAbout us:\nAt Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you’ll work with cutting-edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress.\nIndia is a strategic innovation hub for Ciklum, with growing teams in Chennai and Pune leading advancements in EdgeTech, AR/VR, IoT, and beyond. Join us to collaborate on game-changing solutions and take your career to the next level.\nExplore, empower, engineer with Ciklum!\nInterested already? We would love to get to know you! Submit your application. We can’t wait to see you at Ciklum.","description_format":"text","description_chars":9274,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Health insurance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Outsourcing & Dedicated Teams","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-31T12:55:39Z"}],"visa":[],"liveness":{"score":18,"band":"cold","label":"Long shot","p_open":1,"p_active":0.491,"p_room":0.36,"age_days":54,"expected_fill_days":30,"reasons":["conf:2","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-11-04T06:34:25Z"},"pay":null,"html_url":"https://alion.io/job/ciklum-senior-automation-qa-javascript-engineer","json_url":"https://alion.io/job/ciklum-senior-automation-qa-javascript-engineer.json","meta":{"generated_at":"2026-11-04T13:16:34Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":20080,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-05T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":181259},"rest":"https://alion.io/mcp/rest/get_company?id=181259"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fciklum-senior-automation-qa-javascript-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fciklum-senior-automation-qa-javascript-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fciklum-senior-automation-qa-javascript-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ciklum-senior-automation-qa-javascript-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fciklum-senior-automation-qa-javascript-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3567535}},{"tool":"search_jobs","arguments":{"company":"ciklum.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3567535},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}