{"id":722940,"url":"https://alion.io/job/caterpillar-senior-data-specialist-lead-data-engineer","title":"Senior Data Specialist (Lead Data Engineer)","company":{"id":176554,"name":"Caterpillar","domain":"caterpillar.com","url":"https://alion.io/company/caterpillar","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":87,"open_postings":45,"ghost_share":0,"stale_share":0.711,"repost_share":0,"time_to_fill_p50_days":12,"computed_at":"2026-10-23T05:54:15Z"}},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":33000,"max_usd":71000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":20},"experience_years_min":10,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"ETL/ELT","optional":false},{"name":"Power BI","optional":false},{"name":"AWS","optional":true},{"name":"AWS Glue","optional":true},{"name":"Azure","optional":true},{"name":"CI/CD","optional":true},{"name":"Databricks","optional":true},{"name":"DataStage","optional":true},{"name":"Dimensional Modeling","optional":true},{"name":"GitHub Actions","optional":true},{"name":"Informatica","optional":true},{"name":"Oracle","optional":true},{"name":"PostgreSQL","optional":true},{"name":"Power Apps","optional":true},{"name":"Power Automate","optional":true},{"name":"Python","optional":true},{"name":"SharePoint","optional":true},{"name":"Snowflake","optional":true},{"name":"SQL","optional":true},{"name":"Teradata","optional":true}],"status":"live","first_seen_at":"2026-09-11T07:37:04Z","employer_posted_date":"2026-09-11","last_verified_at":"2026-10-23T07:21:32Z","board_verified":true,"closed_at":null,"days_open":42,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":42},"description":"Career Area:\nTechnology, Digital and DataJob Description:\nYour Work Shapes the World at Caterpillar Inc.\nWhen you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.\nYour Impact Shapes the World at Caterpillar Inc\nWhen you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.\nJob Summary\nWe are seeking a skilled Senior Data Specialist (Lead Data Engineer) join our Financial Systems Tech Support -CAT IT Division\nwho can operate as a strong hands-on individual contributor while providing technical leadership and guidance across enterprise data initiatives. This role is responsible for designing, developing, implementing, and supporting scalable data solutions, analytics platforms, and automation capabilities that enable data-driven decision making across the organisation.\nThe ideal candidate will possess deep expertise in Data Engineering, Power BI, Microsoft Power Platform, Database Technologies, Cloud Platforms, System Design, and Modern Data Architectures. This individual should be capable of independently solving complex technical challenges, driving solution design, evaluating emerging technologies, mentoring team members, and ensuring the successful delivery of high-quality data products.\nThe role requires a balance of strong technical execution, architectural thinking, debugging expertise, stakeholder collaboration, and continuous innovation.\nThe preference for this role is to be based out of Bangalore - Caterpillar PSN\nWhat you will do\nData Engineering & Platform Development\nHands-on Data Engineering\nDesign, develop, and maintain scalable, reliable batch, near real-time or streaming data pipelines.\nBuild and optimise ETL/ELT solutions that process large volumes of structured and unstructured data.\nDevelop reusable data integration frameworks, ingestion components, and orchestration workflows.\nDesign and implement enterprise-grade data warehouses, data lakes, and modern data platforms.\nIntegrate data from databases, APIs, enterprise applications, SaaS platforms, files, and external systems.\nEnsure data accuracy, consistency, reliability, and traceability across all data assets.\nDevelop scalable data models that support reporting, analytics, operational workloads, and future AI/ML initiatives.\nData Quality & Governance\nImplement data quality controls, validation frameworks, and reconciliation processes.\nEstablish monitoring, observability, lineage, metadata management, and auditing capabilities.\nEnsure compliance with data governance, privacy, security, and retention requirements.\nPartner with governance and business teams to improve trust and usability of enterprise data.\nVisualization Solutions (Good to have)\nPower BI Development\nDesign and develop enterprise-grade dashboards, reports, scorecards, and executive visualisations using Power BI.\nCreate intuitive, interactive, and business-focused visualisations that provide meaningful insights.\nDevelop and maintain semantic models, datasets, KPIs, metrics, and reporting frameworks.\nDesign star schemas and dimensional models to support reporting and analytics requirements.\nImplement advanced DAX calculations, measures, and performance optimisation techniques.\nBusiness Intelligence & Reporting\nCollaborate closely with business stakeholders to understand reporting requirements and translate them into scalable BI solutions.\nEstablish Power BI development standards, governance practices, and reporting best practices.\nOptimize report performance, data refresh processes, and dataset management.\nImplement Row-Level Security (RLS) and data access controls where required.\nPower Platform & Automation\nPower Automate\nDesign and implement automated business processes using Microsoft Power Automate.\nBuild workflows for approvals, notifications, data synchronisation, document processing, and operational automation.\nIntegrate Power Automate with SharePoint, Power BI, Dataverse, Microsoft 365, APIs, and enterprise systems.\nIdentify opportunities to automate manual business processes and improve operational efficiency.\nPower Platform\nContribute to the design and implementation of solutions using the Microsoft Power Platform ecosystem.\nSupport integration between Power Apps, Power BI, data platforms, and backend systems.\nEnsure solutions are scalable, maintainable, secure, and aligned with governance standards.\nSolution Design & Architecture\nSolution Ownership\nTranslate business requirements into scalable, secure, and maintainable technical solutions.\nDesign end-to-end architectures for data ingestion, transformation, storage, reporting, and automation solutions.\nDevelop high-level and low-level solution designs for complex technical initiatives.\nEvaluate architectural trade-offs related to performance, scalability, security, reliability, and cost.\nSystem Design\nDesign enterprise-scale data platforms and distributed systems.\nDevelop integration patterns for APIs, microservices, event-driven architectures, and cloud-native solutions.\nDefine non-functional requirements including:Scalability\nPerformance\nAvailability\nReliability\nSecurity\nMaintainability\nObservability\n\nParticipate in architecture reviews, design reviews, and technical governance activities.\nProblem Solving & Debugging Excellence\nComplex Problem Resolution\nLead analysis and resolution of complex technical challenges across data platforms and applications.\nApply strong analytical thinking and systems-thinking approaches to troubleshoot issues.\nTranslate ambiguous business problems into actionable technical solutions.\nDebugging & Root Cause Analysis\nInvestigate and resolve issues across Data Pipelines, Power BI Reports, Dashboards, Database Platforms, Cloud Services, APIs and Integrations, and ETL/ELT Processes.\nPerform root cause analysis (RCA) and implement long-term corrective actions.\nIdentify recurring issues and implement preventive engineering improvements.\nDevelop monitoring, alerting, and observability strategies to proactively identify potential failures.\nPerformance Optimisation\nOptimise SQL queries, ETL workloads, Power BI datasets, data models, and reporting solutions.\nImprove scalability, throughput, and performance of enterprise data platforms.\nIdentify opportunities for automation and efficiency improvements.\nCloud & Modern Data Technologies\nCloud Platforms\nDesign and develop cloud-based data solutions leveraging modern cloud technologies.\nSupport cloud migration, modernisation, and optimisation initiatives.\nImplement secure and scalable cloud-native data architectures.\nPreferred Cloud Knowledge\nAWS or Azure\nSnowflake\nDatabricks\nResponsibilities\nDesign highly available and fault-tolerant solutions.\nSupport infrastructure automation and cloud governance initiatives.\nImplement secure storage, processing, and access patterns.\nOptimise cloud cost, performance, and operational efficiency.\nTechnology Exploration & Innovation\nEmerging Technologies\nContinuously evaluate emerging technologies, tools, frameworks, and industry trends.\nResearch modern data engineering, analytics, automation, AI, and cloud platforms.\nConduct Proof of Concepts to assess business value and technical feasibility.\nInnovation\nExplore new tools, frameworks, and engineering practices that improve productivity and scalability.\nIdentify opportunities for automation, operational efficiency, and technical simplification.\nDrive continuous improvement initiatives across engineering teams.\nTeam Leadership & Collaboration\nTechnical Leadership\nProvide technical leadership and mentorship to Data Engineers.\nSupport design discussions, code reviews, troubleshooting sessions, and knowledge-sharing activities.\nPromote engineering standards, best practices, and consistent delivery approaches.\nTeam Collaboration\nWork closely with Product Owners, Architects, Business Analysts, Data Scientists, Infrastructure Teams, and Business Stakeholders.\nHelp prioritise work, remove technical blockers, and support successful project execution.\nFoster a culture of accountability, ownership, collaboration, and continuous learning.\nWhat you will have\nEducation and Experience\nBachelor’s degree in computer science, Information Technology, Data Science, or a related field.\n10-14 years of experience in data engineering, data analysis, or software development.\nTechnical Skills\nStrong experience on advanced SQL any Database. (Oracle, Teradata, snowflake).\nExperience in data integration area and hands on experience in any of the ETL tools like Datastage , Informatica , Snaplogic etc.\nAble to transform technical requirements into data collection query.\nShould be capable of working with business and other IT teams and convert the requirements into queries.\nGood understanding of ETL architecture and design.\nGood knowledge in Databases, SQL, or PL/SQL\nGood experience with CI/CD tools such as Github Actions (AzDO pipelines)\nGood to have knowledge on Unix commands\nGood to have an experience on AWS Glue\nGood to have knowledge on Qlik replication tool\nThis position requires candidate to work a 5-day -a -week schedule in the office.\nShift Timing: 01:00-10:00PM IST\nData Engineering\nAdvanced SQL and database development expertise.\nStrong hands-on experience with Python for data engineering and automation.\nDeep understanding of ETL/ELT architecture, data integration, and modern data engineering patterns.\nExperience with enterprise data platforms such as Snowflake, Oracle, SQL Server, PostgreSQL, Teradata, or similar technologies.\nExperience with integration platforms such as AWS Glue, SnapLogic, Informatica, DataStage, or equivalent tools.\nPower Platform & Analytics\nStrong experience developing Power BI reports, dashboards, and semantic models.\nExpertise in Power BI DAX, data modelling, report optimisation, and visualisation design.\nExperience with Power Automate workflow development and process automation.\nWorking knowledge of the broader Microsoft Power Platform ecosystem.\nArchitecture & Engineering\nExperience designing enterprise data platforms and distributed systems.\nStrong debugging, troubleshooting, and root cause analysis capabilities.\nKnowledge of API integration, microservices, and modern system design principles.\nUnderstanding of DevOps, CI/CD, source control, and deployment automation practices.\nCloud & Infrastructure\nExperience with AWS and/or Azure cloud platforms.\nKnowledge of cloud-native architecture patterns and modern data services.\nUnderstanding of security, governance, monitoring, and operational support best practices.\nLeadership & Professional Competencies\nStrong problem-solving and analytical thinking skills.\nExcellent communication and stakeholder management capabilities.\nAbility to independently lead technical initiatives with minimal supervision.\nStrong ownership mindset and accountability for outcomes.\nAbility to influence technical decisions and guide engineering teams.\nEffective mentoring, coaching, and knowledge-sharing abilities.\nPassion for learning, innovation, and continuous improvement.\nSuccess Measures\nDelivery of reliable, scalable, and secure data solutions.\nHigh-quality Power BI dashboards and business intelligence capabilities.\nIncreased automation and operational efficiency through Power Automate and Power Platform solutions.\nEffective resolution of production issues thr...","description_format":"text","description_chars":13493,"description_truncated":true,"requirements":{"experience_years_min":10,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Continuous learning","Professional development","Relocation assistance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":true,"industries":["Energy & Utilities","Manufacturing","Fossil Fuels","Industrial Machinery"],"lifecycle":[{"event":"open","at":"2026-10-14T02:00:51Z"}],"visa":[],"liveness":{"score":11,"band":"cold","label":"Long shot","p_open":1,"p_active":0.403,"p_room":0.28,"age_days":41,"expected_fill_days":12,"reasons":["conf:3","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-23T05:54:15Z"},"pay":null,"html_url":"https://alion.io/job/caterpillar-senior-data-specialist-lead-data-engineer","json_url":"https://alion.io/job/caterpillar-senior-data-specialist-lead-data-engineer.json","meta":{"generated_at":"2026-10-23T08:15:57Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13148,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-24T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":176554},"rest":"https://alion.io/mcp/rest/get_company?id=176554"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcaterpillar-senior-data-specialist-lead-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcaterpillar-senior-data-specialist-lead-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcaterpillar-senior-data-specialist-lead-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/caterpillar-senior-data-specialist-lead-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcaterpillar-senior-data-specialist-lead-data-engineer"}]}