{"id":4333764,"url":"https://alion.io/job/primordial-labs-test-evaluation-lead","title":"Test & Evaluation Lead","company":{"id":2520797,"name":"Primordial Labs","domain":"primordial-labs.com","url":"https://alion.io/company/primordial-labs","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Schema","truth_index":null},"role":"Defense","role_family":"Defense","seniority":"lead","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["New Haven, United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":170000,"max":210000,"currency":"USD","period":"year","gross":null,"usd_annual":210000},"salary_estimate":null,"experience_years_min":6,"visa_sponsorship":true,"relocation_package":false,"has_equity":true,"technologies":[{"name":"Linux","optional":false},{"name":"Python","optional":false}],"status":"live","first_seen_at":"2026-11-13T23:36:53Z","employer_posted_date":"2026-11-13","last_verified_at":"2026-11-15T09:49:11Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"About Primordial Labs\nWe're building the next generation interface for commanding autonomous systems in the real world. Our core product, Anura, translates spoken or typed intent into structured actions across drones, sensors, and mission software-enabling faster, more intuitive control in high-stakes environments. We’re a distributed team of engineers, operators, and technologists focused on deploying reliable autonomy at the tactical edge.\nThe Mission\nAnura takes a spoken order and turns it into robot motion. Proving that it works, in software, in simulation, and on real vehicles in the field, is one of the hardest and most important problems we have. We’re looking for someone to own that proof, and to build much of it themselves.\nYou’ll lead our quality assurance and physical test functions, and you’ll be hands-on with test development and infrastructure. You’ll build the automated test and evaluation capability that qualifies a build before it reaches a range, while setting the strategy, standards, and readiness criteria that tell us whether it’s ready. Much of our testing runs in simulation and hardware-in-the-loop environments, so you’ll design an approach that leans on them heavily.\nWhen we tell a program office the system performs, the evidence behind that claim runs through you.\nWhat You'll Do\nSet the Strategy. Define how we test, from automated suites on every build through simulation and system-level tests on real platforms, and what has to be true at each stage before a build moves forward.\n\nBuild the QA Machinery. Design and build the automated test and evaluation capability, running on our simulation and HIL environments, along with the frameworks and standards our engineering teams test against. Range time is the most expensive test environment we have, and it should be confirming what you already know, not discovering it.\n\nScore the System. Build and maintain the end-to-end scenarios we measure system performance against, including hard cases designed to break things, from ambiguous commands and lost links to unexpected changes mid-mission. Measure whether the system did the right thing end to end, not just whether each component returned something plausible.\n\nOwn the KPIs. Develop and own the test KPIs that define whether the system works for operators, built from acceptance criteria and mission-level performance measures. Track them across builds, measure where defects slip past our gates, and report results to leadership and customers.\n\nOwn the Gates. Set the criteria a build must meet to enter physical test, and own the final sign-off on whether a build is ready to go to a customer, based on the evidence from QA and the range.\n\nClose the Loop. Turn field data from physical test into replayable regression cases and evaluation additions within days, not months.\n\nLead the Team. Lead our physical test engineers, overseeing test planning, field events, and results, and grow the team as we scale. Expect occasional travel to test ranges and field events.\n\nReport the Truth. Produce clear test reports and readiness evidence for leadership, customers, and program offices, including results nobody wants to hear.\n\nWork Across the Org. Partner with systems engineering on acceptance criteria, with mission engineering on the measures that matter operationally, with the people building our simulation environments, and with DevOps on how tests run in the pipeline.\n\nThe Split\nYou and your team build the tests, run them, and tell us precisely what broke and under what conditions. Engineering owns the fixes. Test stays independent of the teams it evaluates, and protecting that independence is part of your job.\nWho You Are\nBuilder First. You write real code, and you’d rather build the test framework yourself than describe it to someone else.\n\nSuspicious by Default. You assume it’s broken until something proves otherwise, and you’re drawn to the failure mode nobody else thought to look for.\n\nStatistically Literate. You know a probabilistic system doesn’t pass or fail, it performs at a rate, and you can tell the difference between a real regression and noise.\n\nIndependent and Credible. You can deliver an unwelcome result to engineering leadership or a customer and make it stick.\n\nPlayer-Coach. You lead by example, set clear standards, and grow engineers who would rather find the bug than defend the build.\n\nAt Home Everywhere Test Happens. You’re as comfortable in a code review or a simulation environment as you are on a test range.\n\nRequired Qualifications\nExperience. 6+ years in QA, test engineering, test automation, or systems test, including experience leading engineers or test efforts.\n\nQA and Test Automation. Deep, hands-on experience building automated test suites and frameworks for complex software, and keeping them fast and trustworthy.\n\nSoftware. Strong proficiency in Python, comfort in Linux, and hands-on experience with CI.\n\nTest Leadership. Demonstrated experience defining test strategy, standards, KPIs, and readiness criteria for complex systems.\n\nSystem-Level Test. Working knowledge of testing on real hardware or platforms, and how field testing fits into a broader test strategy.\n\nSimulation. Familiarity with simulation and hardware-in-the-loop testing, and how to use them to reduce what has to be discovered in the field.\n\nEducation. BS in Computer Science, Engineering, or a related technical field, or equivalent hands-on experience.\n\nNice to Have\nExperience building evaluation for ML models in production, including test set design, metric selection, and catching regressions that standard accuracy numbers hide\n\nExperience testing systems with ML components\n\nRobotics, unmanned systems, or autonomy test experience\n\nDefense test and evaluation experience, including test plans, TEMPs, and government deliverable reporting\n\nExperience building a test function at a startup or small company\n\nImportant Qualification Note: Due to the nature of our work and federal compliance requirements, this position strictly requires U.S. Citizenship and current residency within the United States. Please note that Permanent Residency (Green Card status) or visa sponsorship cannot satisfy these specific regulatory requirements.\nCompensation\nCompensation for this position includes a target base salary of $170,000 - $210,000 annually, with the specific figure determined by the candidate's experience level.\nWe’re committed to fair and equitable compensation and are happy to explain how we determine our salary ranges, just ask!\nOur Benefits\nBeyond a Competitive Salary, we provide a significant equity stake, aligning your growth with ours.\n\n100% Remote: This role is fully remote, open to residents across the US. We believe that talent knows no borders (well, except for the US in this case!).\n\nComprehensive Health Coverage: We provide comprehensive medical, dental, and vision plans so you and your family can stay healthy and worry free.\n\nRetirement Planning: Plan for tomorrow with our 401(k) package, complete with a generous 6% company match.\n\nGenerous DTO: Our generous Discretionary Time off (DTO) policy is all about helping you take the breaks you deserve and live your healthiest, most fulfilling life.\n\nElite Technology Package: Enjoy an elite technology package to make your work effortless and efficient.\n\nOur Interview Process\nOur interview process is designed to be thorough and respectful of your time. It typically includes:\nConversation with the People Team: Lets get to know one another first!\n\nScreener Interview: A 30-minute discussion about relevant concepts and your past experience.\n\nTechnical Challenge: We provide an at your own pace challenge focused on real life situations. After completion, you'll present your solutions in a follow-up call. This allows us to understand your thought processes and technical approach.\n\nTechnical Collaboration & Team Q&A: Walk through a recent code sample with the engineering team, discuss your design choices, and ask us anything about our stack, culture, and day to day work.\n\nWe are committed to a low-stress interview experience-no trick questions or brain teasers!\nPrimordial Labs is an equal opportunity employer, committed to creating a welcoming and respectful environment for everyone. Discrimination and harassment have no place here. We firmly believe that a diverse team enriches our problem-solving capabilities, sparks greater creativity, and ultimately leads to a better product and a more vibrant company.\nWe understand that great talent comes from various paths and that passion and transferable skills are invaluable. At Primordial Labs, what truly matters is your ability to make an impact, your dedication to our mission, and your capacity to thrive in a fast-paced, collaborative atmosphere. We are dedicated to fostering an inclusive workplace where you can contribute your unique talents, expand your skills, and learn continuously. If you’re driven to make a real impact, we encourage you to apply, even if your experience doesn’t perfectly align with every qualification.","description_format":"text","description_chars":9069,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":["Equity","Retirement plans"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["National Security","Defense AI"],"lifecycle":[{"event":"open","at":"2026-11-15T09:49:11Z"}],"visa":[{"country":"US","licensed_sponsor":false,"adverts_offering_sponsorship_24m":17,"sanctioned_now":false,"evidence":"Offered visa sponsorship in 17 of its adverts here in 24 months","filings_12m":0,"filings_prev_12m":0,"green_card_filings_12m":0,"median_offered_wage_usd":null,"route":null,"cap_exempt":false,"checked_at":"2026-11-15T09:21:55+00:00","sources":["Alion: sponsorship offered in the employer's own job adverts (24 months)"],"filings_for_role_12m":0}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":1,"expected_fill_days":162,"reasons":["conf:11","win:early"],"computed_at":"2026-11-15T20:56:07Z"},"pay":{"stated_usd_annual":210000,"is_top_pay":true},"html_url":"https://alion.io/job/primordial-labs-test-evaluation-lead","json_url":"https://alion.io/job/primordial-labs-test-evaluation-lead.json","meta":{"generated_at":"2026-11-15T20:56:07Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":15659,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-16T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2520797},"rest":"https://alion.io/mcp/rest/get_company?id=2520797"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fprimordial-labs-test-evaluation-lead"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fprimordial-labs-test-evaluation-lead"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fprimordial-labs-test-evaluation-lead"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/primordial-labs-test-evaluation-lead\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fprimordial-labs-test-evaluation-lead"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4333764}},{"tool":"search_jobs","arguments":{"company":"primordial-labs.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4333764},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}