Lead Data Engineer

Role Overview

We are looking for an experienced Lead Data Engineer to provide technical leadership in designing, developing, and optimizing scalable data platforms that power business intelligence, analytics, and AI-driven solutions.

The ideal candidate will have strong expertise in Python, SQL, AWS, Snowflake, data warehousing, and modern data engineering, along with proven experience in technical solutioning, architecture, estimation, team leadership, and end-to-end delivery.

Key Responsibilities

Technical Leadership & Solutioning

• Lead the technical solutioning and architecture of complex data engineering requirements.
• Translate business and product requirements into scalable, reliable, and maintainable technical solutions.
• Design and review data architectures, ETL/ELT pipelines, data models, integrations, and processing frameworks.
• Evaluate technical alternatives and make decisions considering scalability, performance, cost, maintainability, and timelines.
• Define and promote data engineering standards, best practices, and design patterns.
• Design and implement scalable data ingestion and integration frameworks for SaaS applications, APIs, databases, files, and other enterprise data sources.
  
  

Team Leadership & Delivery

• Provide technical leadership and guidance to a team of data engineers.
• Break down requirements into technical tasks, modules, dependencies, and deliverables.
• Lead effort estimation, resource planning, technical planning, and delivery tracking for data engineering initiatives.
• Conduct design and code reviews and ensure quality and engineering standards are followed.
• Mentor engineers and support their technical growth and development.
• Identify technical risks, bottlenecks, dependencies, and resource gaps and drive appropriate solutions.
  
  

Data & Cloud Engineering

• Design, develop, and optimize scalable ETL/ELT pipelines for structured and unstructured data, supporting both real-time/streaming and batch processing.
• Build and optimize data solutions using Python, SQL, AWS, and Snowflake.
• Work with AWS services including Redshift, S3, Athena, and Glue.
• Develop scalable data models, preferably using Kimball dimensional modeling.
• Drive data platform modernization and on-premises to cloud migration initiatives.
• Ensure data quality, reliability, security, performance, and scalability across data platforms.
• Implement and improve CI/CD, monitoring, testing, and automation practices.
  
  

Stakeholder Collaboration

• Partner with Product Managers, Data Scientists, Data Analysts, BI teams, and business stakeholders to understand requirements and deliver effective data solutions.
• Act as a key technical point of contact for data engineering initiatives.
• Communicate technical designs, estimates, risks, and trade-offs clearly to technical and non-technical stakeholders.
  
  

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 8+ years of experience in Data Engineering, with demonstrated experience in technical leadership.
• Strong hands-on expertise in Python and SQL (MSSQL/MySQL).
• Strong experience with AWS data services, particularly Redshift, S3, and Athena; AWS Glue is preferred.
• Experience with Snowflake, relational and NoSQL databases.
• Strong understanding of data warehousing, ETL/ELT, dimensional modelling, and modern data architectures.
• Experience with cloud migration and data platform modernization.
• Proven experience in technical solutioning, estimation, technical design, and leading engineering teams.
• Experience with code reviews, design reviews, mentoring, and technical delivery ownership.
• AWS Data Analytics/ML certification is a plus.
• Exposure to Media & Marketing Analytics, GCP, or BI tools is an advantage.
  
  

Key Competencies

• Strong technical solutioning and architectural thinking.
• Excellent estimation, planning, prioritization, and execution skills.
• Strong analytical and problem-solving capabilities.
• Ability to technically lead, mentor, and influence engineering teams.
• Strong ownership and focus on quality and delivery.
• Excellent communication and stakeholder management skills.
  
  

Location

• Mysuru or Bengaluru
• Willingness to collaborate with global teams across different time zones.
• Ability to work effectively in a fast-paced, agile product environment.
  
  

About MADTECH.AI

MADTECH.AI is the Decision Intelligence platform for mission-driven organizations and their partners.

Eliminate the burden of data wrangling, model building, data visualization, and optimization in one cost-effective AI-powered hub. By delivering sharper, on-demand insights, predictions, recommendations, and proactive problem-solving, the platform reduces data complexity empowering clients to make smarter, data-driven decisions faster and more affordably.

Headquartered in St. Petersburg, Florida, U.S.A. with global capability centers in Mysuru and Bengaluru, Karnataka, India, MADTECH.AI proudly offers platform support and Professional Services staffed with proven specialists who save clients money, time and achieve transparent, accountable performance while delivering extraordinary value.