Tech Lead - Software Engineer -Python Pyspark

Job Description

• Skill Set :

  Python,pyspark

• Total Experience :

  7.00 to 10.00 Years

• No of Openings :

  1

• Job Post Date :

  10/09/2026

• Job Expiry Date :

  03/11/2026

• Domain :

  IT

• Location :

  CHENNAI [India]

• Job Reference No :

  4106650

Job Summary

Job Title: Data Engineer

Location: TechM Chennai ELCOT

Years of Experience: 7 10 Years

Job Summary:

We are seeking a highly skilled Data Engineer with a strong background in Python to join our dynamic team. The ideal candidate will have 7 10 years of experience in data engineering, with a proven track record of designing, building, and maintaining scalable data pipelines and architectures. You will play a crucial role in transforming raw data into actionable insights, enabling data driven decision making across the organization.

Responsibilities:

• Design, develop, and maintain robust data pipelines and ETL processes to support data ingestion and transformation.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high quality data solutions.
• Implement data models and architectures that support analytics and reporting needs.
• Optimize data storage and retrieval processes for performance and scalability.
• Ensure data quality and integrity through rigorous testing and validation processes.
• Monitor and troubleshoot data pipeline performance, implementing improvements as necessary.
• Document data engineering processes, architectures, and best practices for future reference.
• Stay updated with industry trends and emerging technologies in data engineering and analytics.

Mandatory Skills:

• Strong proficiency in Python, with experience in data manipulation libraries such as Pandas and NumPy.
• Experience with data warehousing solutions and ETL tools.
• Solid understanding of SQL and experience with relational databases.
• Familiarity with big data technologies such as Hadoop, Spark, or similar frameworks.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
• Strong analytical and problem solving skills.

Preferred Skills:

• Experience with data visualization tools (e.g., Tableau, Power BI).
• Knowledge of machine learning concepts and frameworks.
• Familiarity with containerization technologies (e.g., Docker, Kubernetes).
• Experience with version control systems (e.g., Git).
• Strong communication skills and ability to work collaboratively in a team environment.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 7 10 years of experience in data engineering or a related role.
• Proven experience in building and maintaining data pipelines and architectures.
• Strong understanding of data modeling, data warehousing, and data governance principles.

If you are a passionate Data Engineer with a strong foundation in Python and a desire to work in a fast paced environment, we encourage you to apply and join our innovative team at TechM Chennai ELCOT.