{"id":816156,"url":"https://alion.io/job/newcode-qa-engineer","title":"QA Engineer","company":{"id":679268,"name":"Newcode","domain":"newcode.ai","url":"https://alion.io/company/newcode","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":{"grade":"D","score":54,"open_postings":13,"ghost_share":0.769,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-31T05:58:55Z"}},"role":"QA","role_family":"QA","seniority":null,"employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Oslo, Norway"],"countries":["NO"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"Python","optional":false}],"status":"live","first_seen_at":"2026-09-01T00:00:00Z","employer_posted_date":"2026-09-01","last_verified_at":"2026-10-31T23:09:12Z","board_verified":true,"closed_at":null,"days_open":60,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":60},"description":"About Newcode.ai\nNewcode.ai is a fast-growing legal tech and agentic AI company transforming how legal work is done. With teams across Norway, Sweden, Ireland, the US and growing we work at the intersection of law, technology, and intelligence. We move fast, think big, and take pride in doing things the right way.\nNote: We believe in being transparent about what it's like to work at Newcode. As a fast-growing startup, we're building and evolving every day. That means not every process, playbook, or framework is already in place, and priorities can shift quickly.\nThe people who thrive here are comfortable with ambiguity, take ownership, and don't wait for perfect direction. They are resourceful, proactive, and able to \"figure it out\"-solving problems, creating structure where needed, and helping build the company as they go. If you are good with this then, great! Keep reading to learn more.\nThe Role\nAs a QA Engineer, you will own the systems, processes, and technical frameworks we use to evaluate the quality of Newcode's AI products.\nYou will work closely with Software Engineering and Legal Engineering to understand how our AI performs in real-world legal workflows, identify where it falls short, build better evaluation methodologies, and turn those insights into measurable improvements.\nThis is not traditional QA. You will be working at the intersection of AI evaluation, software engineering, legal workflows, and product quality.\nKey Responsibilities:\nDesign and build automated and human-in-the-loop evaluation frameworks for AI-powered products and workflows. \n Develop metrics and benchmarks to measure accuracy, reliability, consistency, and overall AI quality. \n Build evaluation datasets, test cases, and regression suites for complex legal use cases. \n Analyze model outputs to identify failure modes, patterns, and opportunities for improvement. \n Work closely with Legal Engineers to translate real-world legal workflows into rigorous evaluation criteria. \n Partner with Software Engineers to integrate evaluations directly into product and development workflows. \n Establish automated testing and monitoring to identify quality regressions before they reach customers. \n Evaluate changes to models, prompts, retrieval systems, agents, and workflows. \n Develop tooling that makes AI quality measurable and visible across the organization. \n Investigate unexpected model behavior and determine root causes. \n Help establish standards for what \"good\" looks like across different legal use cases. \nRequirements\nStrong software engineering or technical background, with experience working on AI/ML systems. \n Experience building testing, evaluation, or quality frameworks for AI-powered products. \n Strong Python and/or similar programming experience. \n Understanding of LLMs, generative AI, retrieval systems, agents, and/or AI evaluation methodologies. \n Strong analytical and problem-solving skills. \n Ability to work with ambiguous problems and turn them into measurable technical frameworks. \n Strong attention to detail and a high bar for quality. \n Ability to communicate technical findings clearly to both technical and non-technical stakeholders. \n Comfort working cross-functionally with Engineering, Product, and Legal Engineering.\nBenefits\nWhy You’ll Love Working with Us\nCulture of trust and excellence: Be part of a team that values reliability, respect, and initiative, where everyone’s contribution matters and diversity drives creativity.\nCollaborative environment: Work with talented, driven peers on bleeding-edge legal engineering solutions with real-world impact.\nGrowth and ownership: Shape your role as we grow. Take ownership and drive outcomes from the start of your journey.\n Inclusive culture of excellence and trust: We reward initiative, respect, integrity, and teamwork, and are committed to building a global, inclusive team. Your drive, curiosity, and ideas matter more than your background\nReady to shape what’s next? Apply today and join us in building a smarter, more efficient world powered by AI.","description_format":"text","description_chars":4062,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Legal AI"],"lifecycle":[{"event":"open","at":"2026-09-12T11:14:22Z"}],"visa":[],"liveness":{"score":8,"band":"cold","label":"Long shot","p_open":1,"p_active":0.295,"p_room":0.28,"age_days":60,"expected_fill_days":30,"reasons":["conf:1","stale_co","win:tail","crowd:"],"computed_at":"2026-10-31T05:58:55Z"},"pay":null,"html_url":"https://alion.io/job/newcode-qa-engineer","json_url":"https://alion.io/job/newcode-qa-engineer.json","meta":{"generated_at":"2026-10-31T23:37:20Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":36984,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-01T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":679268},"rest":"https://alion.io/mcp/rest/get_company?id=679268"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnewcode-qa-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnewcode-qa-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnewcode-qa-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/newcode-qa-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnewcode-qa-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":816156}},{"tool":"search_jobs","arguments":{"company":"newcode.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":816156},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}