Python Spark Apache Iceberg - Chennai/ Bangalore Location

Job Description

• Skill Set :

  Python

• Total Experience :

  4.00 to 10.00 Years

• No of Openings :

  1

• Job Post Date :

  02/10/2026

• Job Expiry Date :

  31/12/2026

• Domain :

  IT

• Location :

  BENGALURU [India]

• Job Reference No :

  4110422

Job Summary

Job Title: Data Engineer

Location: TechM Blr ECITY

Years of Experience: 5 7 Years

Job Summary:

We are seeking a skilled Data Engineer with a strong background in Python to join our dynamic team at TechM. The ideal candidate will have 5 7 years of experience in data engineering, with a proven track record of designing, building, and maintaining scalable data pipelines and architectures. You will play a crucial role in transforming raw data into actionable insights, enabling data driven decision making across the organization.

Responsibilities:

• Design, develop, and maintain robust data pipelines to support data ingestion, transformation, and storage.
• Collaborate with data scientists and analysts to understand data requirements and deliver high quality datasets.
• Implement data models and architectures that ensure data integrity, availability, and security.
• Optimize data processing workflows for performance and scalability.
• Monitor and troubleshoot data pipeline issues, ensuring timely resolution.
• Document data engineering processes, architectures, and best practices.
• Stay updated with industry trends and emerging technologies in data engineering.

Mandatory Skills:

• Strong proficiency in Python, with experience in data manipulation libraries such as Pandas and NumPy.
• Experience with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
• Familiarity with ETL tools and frameworks (e.g., Apache Airflow, Talend).
• Solid understanding of SQL and experience with relational databases (e.g., MySQL, PostgreSQL).
• Knowledge of cloud platforms (e.g., AWS, Azure, GCP) and their data services.

Preferred Skills:

• Experience with big data technologies (e.g., Hadoop, Spark).
• Familiarity with data visualization tools (e.g., Tableau, Power BI).
• Understanding of machine learning concepts and frameworks.
• Experience with version control systems (e.g., Git).
• Strong problem solving skills and attention to detail.

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5 7 years of experience in data engineering or a related role.
• Proven ability to work collaboratively in a team environment.
• Excellent communication skills, both verbal and written.

If you are passionate about data and have the required skills, we invite you to apply for this exciting opportunity to contribute to our data driven initiatives at TechM.