{"id":551996,"url":"https://alion.io/job/rail-delivery-group-qa-tech-analyst-12m-ftc","title":"QA Tech Analyst 12m FTC","company":{"id":6850,"name":"Rail Delivery Group","domain":"raildeliverygroup.com","url":"https://alion.io/company/rail-delivery-group","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":null},"role":"QA","role_family":"QA","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["London, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":44389,"max":45000,"currency":"GBP","period":"year","gross":null,"usd_annual":60191},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CI/CD","optional":false},{"name":"Confluence","optional":false},{"name":"GitHub","optional":false},{"name":"GitLab","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Robot Framework","optional":false},{"name":"Selenium","optional":false},{"name":"Waterfall","optional":false}],"status":"live","first_seen_at":"2026-09-08T00:00:00Z","employer_posted_date":"2026-09-08","last_verified_at":"2026-10-29T06:58:33Z","board_verified":true,"closed_at":null,"days_open":51,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":51},"description":"Closing Date for Applications\n22nd September 2026\nSalary Scale: £44,389 - £45,000 per annum\nWhat is the purpose of this job?\n\n RDG’s Quality Assurance Practice is looking for a Technical QA AI Analyst to join the Quasar team. This is a pivotal role blending traditional technical QA - building and documenting system knowledge in the format prescribed by Quasar, maintaining clear traceability between Architectural and QA components, and conducting technical and acceptance testing - with assurance of the AI-enabled solutions being adopted across RDG’s systems.\nThe role will define how AI solutions are tested and assured: validating LLM-based features, ML models and retrieval-augmented (RAG) pipelines, evaluating AI outputs for accuracy, relevance, consistency and safety, detecting hallucinations and bias, assuring data quality, and testing the robustness and guardrails that keep AI features safe for the railway and its customers.\nAs the rail industry undergoes considerable change, with transformational programmes across smart ticketing and digital services and a growing adoption of AI across RDG, this role is pivotal in ensuring both technical systems and AI solutions are rigorously assured before release. The role will liaise with Service Assurance, Architecture, CCI, data and technology teams, and technical and management teams from TOCs, suppliers and other industry stakeholders.\nWhat can I expect to do in this job?\n\nThis isn’t an exhaustive list, but things you can expect to be involved with include:\n· Build and document system knowledge in Confluence in the Quasar-prescribed format - process diagrams, mind maps and requirements that make system components, end-to-end data flows and dependencies clear to all team members.\n· Own requirement traceability for assigned systems - baseline and re-baseline traceability matrices, keep coverage accurate through ConnectALL mappings, and support sign-off of requirement acceptance for Quasar.\n· Develop and execute test strategies for AI-enabled functionality (LLM features, ML models, RAG pipelines), with acceptance criteria and test oracles suited to non-deterministic systems.\n· Evaluate AI outputs for accuracy, relevance, consistency and safety - identifying hallucinations, bias and fairness issues, and managing them through standard defect management.\n· Validate AI/ML performance using appropriate metrics (accuracy, precision, recall, F1), assure training and evaluation data quality, and monitor for data drift.\n· Conduct adversarial and robustness testing on AI features - red-teaming, prompt injection, edge cases - and validate guardrails and human-in-the-loop controls.\n· Contribute to AI governance evidence - risk assessments, explainability documentation, model validation records, and post-deployment monitoring of AI-enabled services.\n· Create and deliver all key QA deliverables - test plans, strategies, scope, test objective matrices, test cases, reports and defect management - across waterfall and agile projects.\n· Maintain and build functional and non-functional testing using approved automation tools - Selenium, Robot Framework, Python, ReadyAPI, SauceLabs, LoadRunner - automating regression to improve time to market.\n· Manage automation scripts and code bases through GitHub and GitLab, supporting testing in a CI/CD and DevOps model, and use AI tools to augment test generation, coverage and productivity.\n· Ensure supplier and third-party test delivery (including AI features) is in line with RDG policy and standards, working collaboratively with vendors for release and product quality.\n· Report daily testing status to the Test Manager and stakeholders, escalate delays proactively, and share knowledge across the team on technical and AI testing subjects.\nWho will my key contacts be?\nInternal:\n· RDG’s Service Assurance (QA and Accreditation) and Quasar teams.\n· RDG Architecture and CCI, including AI governance and data functions.\n· RDG Technology Services, RDG IT, and Programme and Project Management teams.\n· Internal functions including Audit, Customer Service, and Finance teams.\nExternal:\n· TOCs and other stakeholders.\n· Technology suppliers, service providers, and AI/ML solution providers.\n· Department for Transport.\n· Transport for London.\n· All related consultants and contracting arrangements within a project or programme of work.\nRequirements\nWhat experience, skills and knowledge do I need?\n\n· Proven experience of manual and automation testing of end-to-end solutions, estimation, reporting and defect management, in both waterfall and agile environments, with a strong acceptance test background.\n· Experience testing or assuring AI-enabled solutions - LLM features, ML models or RAG pipelines - including output evaluation, hallucination and bias detection, and guardrail validation.\n· A good understanding of AI/ML fundamentals: model training and evaluation metrics (accuracy, precision, recall, F1), data quality and drift, LLM concepts (context, prompts, grounding), and testing non-deterministic systems.\n· Working knowledge of test tools - JIRA, Confluence, ALM - and hands-on automation experience with PyCharm, Selenium, Robot Framework, Python, ReadyAPI, SauceLabs or LoadRunner.\n· Demonstrable knowledge of CI/CD and DevOps models and code management through GitHub and GitLab.\n· A keen understanding of system analysis - able to draft clear, testable requirements and acceptance criteria, create process diagrams and mind maps (MS Visio or equivalent), and analyse multiple data sets.\n· Ability to simplify and communicate technical requirements, AI behaviour and limitations to non-technical audiences.\n· Proficiency in a risk-based approach to testing, requirement traceability and static assurance across all testing stages.\n· Bachelor’s degree in Information Technology or related Engineering discipline, with ISTQB/ISEB certification; ISTQB Certified Tester - AI Testing (CT-AI) is highly desirable.\n· Most importantly, have an attitude and enthusiasm to drive change, teamwork, enjoy learning, be passionate about what you do, and be driven to grow the established practice into a stable and sustainable service.\nBenefits\nWhy Work for RDG?\nWe offer a highly competitive package, including:\n75% discount on rail travel (for work and leisure), plus international rail discounts\n30 Days annual leave (plus buy/sell options and additional leave for key life events)\nTwo Personal Development Days are granted to employees annually\nInterest-free Season Ticket Loan for commuting costs\nEnhanced family leave - 30 weeks full pay for maternity, adoption, surrogacy, and shared parental leave\nPension scheme - up to 8.64% employer contribution\nSubsidised Private Medical Insurance (Vitality PPP) and Health Cash Plan (Healthshield)\nAccess to our flexible benefits portal - a central hub for accessing retail discounts, shopping, dining, travel, and entertainment perks\nFlexible working arrangements available","description_format":"text","description_chars":6950,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Annual leave","Flexible schedule","Health insurance","Parental leave"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Transportation & Logistics","Public Transport","Rail Transport"],"lifecycle":[{"event":"open","at":"2026-09-08T16:32:13Z"}],"visa":[],"liveness":{"score":12,"band":"cold","label":"Long shot","p_open":1,"p_active":0.357,"p_room":0.35,"age_days":51,"expected_fill_days":20,"reasons":["conf:3","win:tail"],"computed_at":"2026-10-29T05:49:05Z"},"pay":{"stated_usd_annual":60191,"is_top_pay":false},"html_url":"https://alion.io/job/rail-delivery-group-qa-tech-analyst-12m-ftc","json_url":"https://alion.io/job/rail-delivery-group-qa-tech-analyst-12m-ftc.json","meta":{"generated_at":"2026-10-29T07:40:17Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":11675,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6850},"rest":"https://alion.io/mcp/rest/get_company?id=6850"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Frail-delivery-group-qa-tech-analyst-12m-ftc"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Frail-delivery-group-qa-tech-analyst-12m-ftc"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Frail-delivery-group-qa-tech-analyst-12m-ftc"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/rail-delivery-group-qa-tech-analyst-12m-ftc\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Frail-delivery-group-qa-tech-analyst-12m-ftc"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":551996}},{"tool":"search_jobs","arguments":{"company":"raildeliverygroup.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":551996},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}