{"id":1968499,"url":"https://alion.io/job/caterpillar-senior-data-specialist-2","title":"Senior Data Specialist","company":{"id":176554,"name":"Caterpillar","domain":"caterpillar.com","url":"https://alion.io/company/caterpillar","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":87,"open_postings":45,"ghost_share":0,"stale_share":0.711,"repost_share":0,"time_to_fill_p50_days":12,"computed_at":"2026-10-23T05:54:15Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":25000,"max_usd":50000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":71},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon S3","optional":false},{"name":"Anomaly Detection","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"AWS Lambda","optional":false},{"name":"AWS Step Functions","optional":false},{"name":"CI/CD","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":true},{"name":"Spark","optional":true}],"status":"closed","first_seen_at":"2026-10-06T18:16:19Z","employer_posted_date":"2026-10-06","last_verified_at":"2026-10-23T23:27:55Z","board_verified":false,"closed_at":"2026-10-23T23:27:55Z","days_open":17,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":17},"description":"Career Area:\nTechnology, Digital and DataJob Description:\nYour Work Shapes the World at Caterpillar Inc.\nWhen you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.\nAWS Data Engineer who will design, build, and maintain robust data pipelines and connectors across AWS and Coveo. This role will have a strong focus on data quality, reliability, and validation, ensuring that data ingested into Coveo and downstream systems is accurate, complete, and production-ready.\nThe engineer will work closely with search, data, and platform teams to support enterprise-scale ingestion pipelines, improve data quality frameworks, and enable high-quality search and content experiences.\nKey Responsibilities\nDesign, develop, and maintain scalable data pipelines on AWS (batch and near-real-time).\nOwn data quality validation across pipelines, including\nData completeness, freshness, consistency, and accuracy checks\nSchema validation and anomaly detection\nImplement automated data quality checks, alerts, and monitoring for pipeline failures or data issues.\nCollaborate with search and platform teams to ensure high-quality indexed data for Coveo sources.\nContribute to CI/CD pipelines and follow enterprise SDLC and security standards.\nProduce clear documentation for pipelines, data contracts, and quality rules.\nPerform in-depth analysis of search-indexed datasets to identify data quality issues to improve relevance, accuracy, and overall search performance.\nRequired Qualifications\nStrong experience as a Data Engineer working on AWS.\nHands-on experience building data pipelines using services such as:\nAWS Glue,BedRock,Lambda, Step Functions, S3, SNS/SQS (or similar)\nProficiency in Python (and/or PySpark) for data engineering and validation logic.\nStrong understanding of data quality concepts, frameworks, and best practices.\nExperience integrating data from multiple sources (APIs, databases, files).\nSolid knowledge of ETL/ELT patterns and data modeling fundamentals.\nExperience with logging, monitoring, and alerting for data pipelines.\nFamiliarity with CI/CD practices and version control (Git).\nPreferred / Nice-to-Have Skills\nExperience working with Coveo (sources, connectors, indexing, ingestion pipelines).\nPrior experience supporting search platforms or content indexing pipelines.\nExposure to data quality frameworks or rule-based validation approaches.\nKnowledge of Snowflake.\nExperience working in large enterprise or multi-team environments.\nSoft Skills\nStrong problem-solving and debugging skills.\nAbility to work cross-functionally with data, search, and platform teams.\nClear communication of data issues, risks, and remediation plans.\nHigh ownership mindset with attention to detail, especially around data correctness.\nPosting Dates:\nOctober 6, 2026 - October 12, 2026Caterpillar is an Equal Opportunity Employer. Qualified applicants of any age are encouraged to apply\nNot ready to apply? Join our Talent Community.","description_format":"text","description_chars":3311,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Energy & Utilities","Manufacturing","Fossil Fuels","Industrial Machinery"],"lifecycle":[{"event":"open","at":"2026-10-14T02:00:51Z"},{"event":"close","at":"2026-10-23T23:27:55Z"}],"visa":[],"liveness":null,"pay":null,"html_url":"https://alion.io/job/caterpillar-senior-data-specialist-2","json_url":"https://alion.io/job/caterpillar-senior-data-specialist-2.json","meta":{"generated_at":"2026-10-23T23:44:00Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":7282,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-24T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":176554},"rest":"https://alion.io/mcp/rest/get_company?id=176554"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcaterpillar-senior-data-specialist-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcaterpillar-senior-data-specialist-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcaterpillar-senior-data-specialist-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/caterpillar-senior-data-specialist-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcaterpillar-senior-data-specialist-2"}]}