{"id":478140,"url":"https://alion.io/job/caterpillar-senior-software-engineer-data-engineering","title":"Senior Software Engineer - Data Engineering","company":{"id":176554,"name":"Caterpillar","domain":"caterpillar.com","url":"https://alion.io/company/caterpillar","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":88,"open_postings":37,"ghost_share":0,"stale_share":0.486,"repost_share":0,"time_to_fill_p50_days":35,"computed_at":"2026-10-24T06:02:35Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Chennai, India","Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":22000,"max_usd":45000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":71},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Amazon Neptune","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"AWS Lambda","optional":false},{"name":"Azure DevOps","optional":false},{"name":"Git","optional":false},{"name":"LLM","optional":false},{"name":"Milvus","optional":false},{"name":"Neo4j","optional":false},{"name":"OpenSearch","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"SQL","optional":false},{"name":"Apache Kafka","optional":true},{"name":"AWS Step Functions","optional":true},{"name":"Azure","optional":true},{"name":"CUDA","optional":true},{"name":"cuDF","optional":true},{"name":"cuML","optional":true},{"name":"Knowledge Graph","optional":true},{"name":"RAPIDS","optional":true},{"name":"Spark","optional":true}],"status":"closed","first_seen_at":"2026-09-03T00:00:00Z","employer_posted_date":"2026-10-05","last_verified_at":"2026-10-23T23:27:55Z","board_verified":false,"closed_at":"2026-10-23T23:27:55Z","days_open":50,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":50},"description":"Career Area:\nTechnology, Digital and DataJob Description:\nYour Work Shapes the World at Caterpillar Inc.\nWhen you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.\nJob Summary\nWe are looking for a highly motivated and experienced Data Engineer to join our data engineering team. The ideal candidate will have a strong background in building scalable data pipelines using the AWS cloud stack and extensive hands-on experience with Snowflake. Proficiency in Python and SQL, along with graph and vector database technologies, is essential. This role requires strong problem-solving abilities and a proactive mindset to deliver efficient, scalable, and reliable data solutions.\nKey Responsibilities\nDesign, develop, and maintain scalable data pipelines on AWS using services such as S3, Glue, Lambda, Redshift, and EMR.\nBuild and optimize data warehousing solutions using Snowflake, including performance tuning and data modeling.\nWrite efficient and reusable code in Python and SQL for data transformation and processing.\nCollaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements.\nIntegrate vector databases with LLM-based applications and AI workflows.\nMonitor, troubleshoot, and improve pipeline performance and reliability.\nEnsure data quality, integrity, and security across all stages of the pipeline.\nParticipate in code reviews, architecture discussions, and continuous improvement initiatives.\nRequired Qualifications\n8+ years of experience in data engineering or related roles.\nStrong hands-on experience with AWS cloud services, including data and AI workloads.\nDeep understanding of Snowflake architecture, performance tuning, and best practices.\nAdvanced proficiency in Python and SQL for data pipelines, transformations, and services.\nHands-on experience with graph databases (e.g., Neo4j, Neptune) and vector databases (e.g., Milvus, Amazon OpenSearch).\nExperience with version control systems (e.g., Git) and Git workflows.\nExperience working with Azure DevOps (AzDO) boards for backlog management in Agile environments.\nExcellent analytical and problem-solving skills.\nStrong communication and collaboration abilities.\nBachelor’s or Master’s degree in Computer Science, Engineering, or a related field.\nNice to Have skills\nKnowledge of the NVIDIA ecosystem and its applications in data and AI.\nExposure to RAPIDS libraries (cuDF, cuML, cuGraph) or CUDA-based tooling for GPU-accelerated data processing, enabling faster transformation and optimization during large-scale ingestion workflows.\nHands-on expertise with vector databases, specifically Milvus, covering schema design, indexing, and optimizing write performance for large-scale embedding ingestion pipelines.\nProficiency in building Knowledge Graph (Neo4J) ingestion pipelines using Graph Databases - including entity extraction, relationship modelling, and populating nodes and attributes.\nPreferred Qualifications\nExperience with orchestration tools such as AWS Step Functions.\nFamiliarity with data governance and compliance practices.\nExposure to real-time data processing frameworks (e.g., Kafka, Spark Streaming).\nThis position requires working onsite five days a week.Relocation is available for this position.Posting Dates:\nOctober 5, 2026 - October 6, 2026Caterpillar is an Equal Opportunity Employer. Qualified applicants of any age are encouraged to apply\nNot ready to apply? Join our Talent Community.","description_format":"text","description_chars":3845,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":true,"industries":["Energy & Utilities","Manufacturing","Fossil Fuels","Industrial Machinery"],"lifecycle":[{"event":"open","at":"2026-09-06T15:28:26Z"},{"event":"close","at":"2026-09-06T21:16:29Z"},{"event":"open","at":"2026-10-14T02:00:51Z"},{"event":"close","at":"2026-10-23T23:27:55Z"}],"visa":[],"liveness":null,"pay":null,"html_url":"https://alion.io/job/caterpillar-senior-software-engineer-data-engineering","json_url":"https://alion.io/job/caterpillar-senior-software-engineer-data-engineering.json","meta":{"generated_at":"2026-10-24T21:17:18Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":31205,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-25T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":176554},"rest":"https://alion.io/mcp/rest/get_company?id=176554"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcaterpillar-senior-software-engineer-data-engineering"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcaterpillar-senior-software-engineer-data-engineering"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcaterpillar-senior-software-engineer-data-engineering"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/caterpillar-senior-software-engineer-data-engineering\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcaterpillar-senior-software-engineer-data-engineering"}]}