{"id":3154680,"url":"https://alion.io/job/robots-pencils-testing-engineer","title":"Testing Engineer","company":{"id":7662,"name":"Robots & Pencils","domain":"robotsandpencils.com","url":"https://alion.io/company/robots-and-pencils","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":83,"open_postings":9,"ghost_share":0,"stale_share":0.667,"repost_share":0,"time_to_fill_p50_days":34,"computed_at":"2026-10-28T05:59:10Z"}},"role":"QA","role_family":"QA","seniority":"junior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["Bogotá, Colombia","Colombia"],"countries":["CO"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":2,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"Claude","optional":false},{"name":"Cursor","optional":false},{"name":"Cypress","optional":false},{"name":"GitHub Actions","optional":false},{"name":"GitLab CI","optional":false},{"name":"Hallucination","optional":false},{"name":"JavaScript","optional":false},{"name":"Jenkins","optional":false},{"name":"Jira","optional":false},{"name":"LLM","optional":false},{"name":"Playwright","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Selenium","optional":false},{"name":"TestRail","optional":false}],"status":"live","first_seen_at":"2026-10-23T13:26:39Z","employer_posted_date":"2026-10-23","last_verified_at":"2026-10-28T15:47:38Z","board_verified":true,"closed_at":null,"days_open":5,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":5},"description":"Testing Engineer \nLocation: Colombia \nCompany Overview \nRobots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operations and deliver measurable results for our clients. We're all in on AWS, combining deep UX capability with senior engineering talent to get AI into production fast and keep it there. \nWe’ve earned the trust of leaders across Consumer Products and Retail, Education, Energy, Financial Services, Healthcare, and Manufacturing and more, and earned a reputation as the nimble alternative to traditional global systems integrators. Founded in 2009, with delivery centers in Canada, the United States, Eastern Europe, and Latin America, we are smaller, faster, and more senior by design. Our teams average 15+ years of experience. We move fast, sweat the details, and build things that actually ship. \nPosition Overview \nWe’re looking for a Testing Engineer to build and maintain quality across software features and AI/ML systems. This role is ideal for an engineer who can confidently own testing responsibilities across automation and AI, contributes to quality strategy discussions, and is ready to take on real responsibility from day one. \nIn this role, you will work as a contributing member of a cross-functional team, writing automated tests, validating AI/ML pipelines and outputs, and integrating quality practices into the delivery process. You’ll be joining real, in-flight work where quality and delivery speed matter, collaborating with experienced engineers and growing the technical instincts that come from shipping things that matter. \nWhy This Role Matters \nAt Robots & Pencils, we design AI systems for a human world. Our name says it all. Robots and pencils means engineering paired with creativity, because every agent we ship has to work for real people in real workflows. That balance is baked into how we operate. \nEvery role here contributes directly to that mission. Here, you shape how AI systems integrate into enterprise operations, how teams move at real velocity, and how products create measurable impact for clients and the people they serve. We ship production-ready AI in 30 to 45 days. That pace demands people who take ownership, lead with craft, and care deeply about what they put their name on. \nWhat You’llDo \nCraft & Delivery \nWrite and maintain automated test scripts for UI, API, and integration testing (e.g., Selenium, Cypress, Playwright, PyTest) \nValidate ML model outputs including accuracy, consistency, and expected behavior against defined criteria \nTest data pipelines and AI workflows, performing dataset validation and data quality checks \nExecute automated test suites, analyze results, and identify, document, and track defects (e.g., Jira, TestRail) \nIntegrate automated tests into CI/CD pipelines to support continuous quality (e.g., GitHub Actions, GitLab CI, Jenkins) \nSupport model evaluation processes and assist in testing AI workflows end-to-end \nTest AI/ML systems, including LLM evaluation (accuracy, hallucination, toxicity, bias), RAG retrieval quality and grounding, model drift monitoring, prompt regression testing, and AI safety and red-teaming \nBring an AI-forward mindset to your daily work, using tools like Claude, Cursor, and other modern AI assistants to ship higher-quality work at pace \nCollaboration & Communication \nCollaborate closely with developers, ML engineers, and data scientists to align quality efforts with delivery goals \nParticipate in sprint ceremonies and contribute to quality strategy discussions \nProvide clear testing reports and communicate quality status to the team \nLeadership & Influence \nTake ownership of testing responsibilities end-to-end and follow through with consistency \nContribute to QA process improvements and identify opportunities for greater test coverage or automation \nBring intellectual curiosity to every problem - ask good questions, explore edge cases, and stay hungry to grow your craft \nWhat You’llBring \n2+ years of experience in test automation or AI/ML testing, with comfort in at least one track and working knowledge of the other \nProficiency in Python, JavaScript, Java, or similar, with the ability to write and maintain test code independently \nExperience with test automation frameworks for UI, API, or ML workflows \nUnderstanding of AI/ML concepts and the ML lifecycle, with the ability to validate model outputs against defined criteria \nExperience with CI/CD pipelines and version control \nWorking knowledge of API testing and data validation \nSolid understanding of SDLC/STLC and Agile methodologies \nProficiency with bug-tracking and test management tools \nFamiliarity with testing AI/ML systems, including LLM evaluation (accuracy, hallucination, toxicity, bias), RAG retrieval quality and grounding, model drift monitoring, prompt regression testing, and AI safety and red-teaming \nDemonstrable, day-to-day usage of AI-forward tools such as Claude and Cursor \nStrong problem-solving skills and the ability to work through ambiguous testing challenges with sound judgment \nExperience with mobile automation, performance testing, MLOps pipelines, or basic statistics is a plus \nYou’llDo Well Here if You Are \nA doer. You see something broken and fix it. You'd rather move on clarity than wait for certainty. \nA fast learner who knows you don't know everything. The AI landscape changes weekly. You're senior enough to know better and curious enough to keep learning anyway. \nDirect in a way that makes the work better. You give honest feedback. You'd rather have the hard conversation than blow smoke. \nObsessed with craft. You know genius is in the details. You ship exceptional, not perfect, and you don't put your name on work you wouldn't stand behind. \nBuilt for ownership. You honor commitments, admit mistakes fast, and back your teammates when a decision costs something. No handoffs, no finger-pointing. \nAll in. You treat clients' businesses like your own. You take the work seriously without taking yourself seriously. \nResourceful when the budget, timeline, or team is tight. Constraints don't slow you down. They sharpen you. \n Glad to be in the room with people who care as much as you do. Our teams average fifteen-plus years of experience. We hire people who push each other to do better work.","description_format":"text","description_chars":6379,"description_truncated":false,"requirements":{"experience_years_min":2,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Colombia","iso":"CO","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["UI/UX Design","Custom Software Development","AI Consulting & Integration"],"lifecycle":[{"event":"open","at":"2026-10-23T14:07:43Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":4,"expected_fill_days":34,"reasons":["conf:4","velocity","win:early","comp:junior"],"computed_at":"2026-10-28T05:59:10Z"},"pay":null,"html_url":"https://alion.io/job/robots-pencils-testing-engineer","json_url":"https://alion.io/job/robots-pencils-testing-engineer.json","meta":{"generated_at":"2026-10-28T18:34:52Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":25401,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-29T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":7662},"rest":"https://alion.io/mcp/rest/get_company?id=7662"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Frobots-pencils-testing-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Frobots-pencils-testing-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Frobots-pencils-testing-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/robots-pencils-testing-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Frobots-pencils-testing-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3154680}},{"tool":"search_jobs","arguments":{"company":"robotsandpencils.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3154680},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}