{"id":4338382,"url":"https://alion.io/job/caterpillar-senior-data-quality-assurance-engineer-data-annotation-services","title":"Senior Data Quality Assurance Engineer, Data Annotation Services","company":{"id":176554,"name":"Caterpillar","domain":"caterpillar.com","url":"https://alion.io/company/caterpillar","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":95,"open_postings":181,"ghost_share":0,"stale_share":0.177,"repost_share":0.017,"time_to_fill_p50_days":31,"computed_at":"2026-11-15T07:52:55Z"}},"role":"QA","role_family":"QA","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Irving, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":112710,"max":183140,"currency":"USD","period":"year","gross":null,"usd_annual":183140},"salary_estimate":null,"experience_years_min":3,"visa_sponsorship":true,"relocation_package":true,"has_equity":false,"technologies":[{"name":"CI/CD","optional":false},{"name":"Computer Vision","optional":false},{"name":"Docker","optional":false},{"name":"Great Expectations","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"Kubernetes","optional":false},{"name":"Machine Learning","optional":false},{"name":"MLFlow","optional":false},{"name":"Multimodal AI","optional":false},{"name":"ONNX","optional":false},{"name":"Physical AI","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Roboflow","optional":false},{"name":"Scrum","optional":false},{"name":"SQL","optional":false},{"name":"TensorFlow","optional":false},{"name":"Vision-Language-Action","optional":false},{"name":"Weights & Biases","optional":false}],"status":"live","first_seen_at":"2026-11-15T16:30:21Z","employer_posted_date":"2026-11-15","last_verified_at":"2026-11-15T16:30:21Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Career Area:\nTechnology, Digital and DataJob Description:\nYour Work Shapes the World at Caterpillar Inc.\nWhen you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.\nHelp Build the Future of Caterpillar\nAt Caterpillar, technology always has a purpose, which is to solve our customers' toughest challenges. Through Cat Technology, we are solving problems by building the intelligence layer that connects machines, data, and people to make jobsites safer, more productive, and more sustainable. By combining deep domain expertise in physical systems with software, connectivity, autonomy, and AI, we deliver solutions that work in the real world, on real jobsites, at global scale.\nYou'll build and deploy against one of the most unique data foundations, over 1.6 million connected assets generating real-world data daily. These data and platform capabilities are enabling the development of AI models, edge computing architectures, and software systems that scale across fleets, products, and industries. The result will be a new generation of machines that continuously learn, improve, and deliver performance at scale.\nBe Part of What's Next in Autonomous Construction Sites\nConstruction autonomy is one of the most complex challenges in applied AI, and at Caterpillar, advancements in physical AI, simulation, sensing, and edge computing are turning things that once felt impossible, intelligent machines operating in dynamic jobsites, into reality.\nOur connected ecosystem brings together massive volumes of high-quality data to create a foundation where engineers like you can build and deploy against.\nIf this work motivates you, we invite you to join our team. In this role, you'll work at the intersection of the physical and digital worlds. You'll help design and deliver intelligent systems that enable machines to perceive their environment, make informed decisions, and support safer, more productive operations.\nApply today to build the new era of construction autonomy at Caterpillar.\nJob Summary:\nWe are seeking a Senior Data QA Engineer to own the quality of training data used for robotics, autonomy, computer vision, and Vision-Language-Action (VLA) systems, working within a scrum team.\nThis role combines data quality engineering, test automation, and machine learning to define, measure, and continuously improve the accuracy of annotated and captioned datasets from real-world heavy equipment and construction environments. The successful candidate will build automated validation frameworks and quality metrics and partner with annotation providers, ML engineers, and platform teams to ensure the data feeding Caterpillar's AI models is accurate, consistent, and trustworthy. This position will also evaluate outputs from automated labeling and captioning technologies such as NVIDIA Cosmos Curator and Cosmos Reason.\nThis is a hands-on technical role focused on turning complex data quality challenges into scalable, automated, production-grade quality assurance solutions.\nWhat You Will Do:\nDefine, document, and maintain annotation guidelines, acceptance criteria, and quality standards for perception and VLA datasets.\nDesign and execute QA strategies for human, automated, and AI-assisted labeling and captioning, including sampling plans, audits, and golden-set validation.\nBuild automated data validation and test frameworks that verify labeling accuracy, consistency, completeness, schema conformance, and sensor synchronization across camera and LiDAR datasets.\nDevelop quality metrics, dashboards, and alerting capabilities (precision/recall, IoU, inter-annotator agreement, defect rates) to track dataset health and drive measurable quality improvements.\nIdentify, categorize, and root-cause labeling defects, partnering with annotation vendors, ML engineers, and domain experts to resolve issues and improve quality.\nBuild and validate quality gates within data pipelines supporting automated labeling, human review, quality validation, and dataset publication.\nEvaluate and benchmark auto-labeling and auto-captioning platforms such as NVIDIA Cosmos Curator and Cosmos Reason and help develop AI-driven QA capabilities that scale review processes.\nIntegrate QA workflows with Caterpillar data systems, external annotation providers, and human-in-the-loop processes while ensuring reliability, traceability, and observability.\nHelp establish and evolve quality standards for AI training data supporting computer vision, robotics, autonomy, and multimodal AI applications.\nWhat You Will Have:\nBachelor's degree in Computer Science, Software Engineering, Data Science, Artificial Intelligence, Machine Learning, Robotics, or a related technical field.\nExperience developing production-grade Python software for data validation, test automation, and data processing using modern software engineering practices including version control, code review, CI/CD, Docker, and Kubernetes.\nExperience designing and implementing automated data quality checks and testing frameworks for data pipelines, APIs, and datasets using tools such as Great Expectations, pytest, or similar technologies.\nWorking knowledge of machine learning evaluation methodologies and metrics, including precision, recall, F1 score, IoU, mAP, and error analysis.\nStrong analytical and problem-solving abilities with exceptional attention to detail and the ability to communicate findings effectively across technical teams.\n2+ years of experience working with camera and LiDAR sensor datasets for perception or machine learning applications, including data validation, ground truth generation, and data collection quality processes.\n3+ years of experience in data annotation and quality assurance supporting autonomous systems or computer vision projects, including development of annotation guidelines and execution of quality improvement initiatives.\nExperience using annotation and dataset management platforms such as Labelbox, Supervisely, RoboFlow, or similar solutions, including QA and review workflows.\nExperience with SQL and data analysis tools such as pandas and Jupyter notebooks to profile datasets, investigate defects, and create quality reporting.\nTop Candidates Will Have:\nExperience with computer vision, robotics, autonomy, Physical AI, or multimodal AI systems.\nExperience validating AI-assisted annotation workflows, auto-labeling systems, and machine learning data pipelines.\nExperience with machine learning frameworks and experiment tracking tools such as PyTorch, TensorFlow, ONNX, Weights & Biases, or MLflow.\nExperience with NVIDIA Cosmos Curator, Cosmos Reason, or similar AI automation platforms.\nExperience working with Vision-Language-Action (VLA) datasets and caption quality evaluation methodologies.\nExperience with camera, LiDAR, radar, and autonomous machine sensor data.\nExperience with cloud platforms, data observability tooling, MLOps, and data pipeline orchestration technologies.\nExperience building human-in-the-loop quality workflows, inter-annotator agreement frameworks, and large-scale quality automation systems.\nAdditional Details:\nThis position requires the candidate to work full-time onsite at the Irving, TX office (Dallas).\nDomestic relocation assistance is available for this position.\nVisa sponsorship is available for this position.\nWhy Caterpillar\nYou'll work on some of the most challenging applications of AI in the physical world, helping ensure the data that transforms vast amounts of machine and sensor data into the intelligence powering autonomous and AI-enabled equipment is accurate, reliable, and trusted. If you're excited about raising the bar on data quality for real-world machines operating in complex environments, we'd like to hear from you.\nSummary Pay Range:\n$112,710.00 - $183,140.00Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-relatedknowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.\nBenefits:\nSubject to plan eligibility, terms, and guidelines. This is a summary list of benefits.\nMedical, dental, and vision benefits*\n\nPaid time off plan (Vacation, Holidays, Volunteer, etc.)*\n\n401(k) savings plans*\n\nHealth Savings Account (HSA)*\n\nFlexible Spending Accounts (FSAs)*\n\nHealth Lifestyle Programs*\n\nEmployee Assistance Program*\n\nVoluntary Benefits and Employee Discounts*\n\nCareer Development*\n\nIncentive bonus*\n\nDisability benefits\n\nLife Insurance\n\nParental leave\n\nAdoption benefits\n\nTuition Reimbursement\n\n* These benefits also apply to part-time employees\nThis position requires working onsite five days a week.Relocation is available for this position.Visa sponsorship is available for eligible applicants.Posting Dates:\nAny offer of employment is conditioned upon the successful completion of a drug screen.\nCaterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.\nNot ready to apply? Join our Talent Community.","description_format":"text","description_chars":9438,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Life insurance","Parental leave","Relocation assistance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":true,"industries":["Industrial Machinery"],"lifecycle":[{"event":"open","at":"2026-11-15T16:30:21Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":45,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 343 · green card filings: 92","filings_12m":343,"filings_prev_12m":364,"green_card_filings_12m":92,"median_offered_wage_usd":114569,"route":null,"cap_exempt":false,"checked_at":"2026-11-15T09:21:55+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)","Alion: sponsorship offered in the employer's own job adverts (24 months)"],"filings_for_role_12m":7}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":31,"reasons":["conf:3","win:early","comp:brand"],"computed_at":"2026-11-15T19:38:48Z"},"pay":{"stated_usd_annual":183140,"is_top_pay":true},"html_url":"https://alion.io/job/caterpillar-senior-data-quality-assurance-engineer-data-annotation-services","json_url":"https://alion.io/job/caterpillar-senior-data-quality-assurance-engineer-data-annotation-services.json","meta":{"generated_at":"2026-11-15T19:38:48Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13461,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-16T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":176554},"rest":"https://alion.io/mcp/rest/get_company?id=176554"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcaterpillar-senior-data-quality-assurance-engineer-data-annotation-services"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcaterpillar-senior-data-quality-assurance-engineer-data-annotation-services"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcaterpillar-senior-data-quality-assurance-engineer-data-annotation-services"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/caterpillar-senior-data-quality-assurance-engineer-data-annotation-services\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcaterpillar-senior-data-quality-assurance-engineer-data-annotation-services"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4338382}},{"tool":"search_jobs","arguments":{"company":"caterpillar.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4338382},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}