Bigdata Engineer - Spark SQL, PySpark, Python, Devops

Job Description

• Skill Set :

  Python,DevOps,Spark,pyspark

• Total Experience :

  10.00 to 15.00 Years

• No of Openings :

  1

• Job Post Date :

  11/09/2026

• Job Expiry Date :

  31/12/2026

• Domain :

  IT

• Location :

  BENGALURU [India]

• Job Reference No :

  4106777

Job Summary

Job Title: Data Engineer

Location: TechM Blr ECITY

Years of Experience: 10- 15 Years

Job Summary:

We are seeking a highly skilled Data Engineer with a strong background in Python to join our dynamic team at TechM. The ideal candidate will have 10-15 years of experience in data engineering, with a proven track record of designing, building, and maintaining scalable data pipelines and architectures. You will play a crucial role in transforming raw data into actionable insights, enabling data driven decision making across the organization.

Responsibilities:

• Design, develop, and maintain robust data pipelines and ETL processes to support data ingestion and transformation.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high quality data solutions.
• Implement data models and architectures that support analytics and reporting needs.
• Optimize data storage and retrieval processes to ensure high performance and scalability.
• Monitor and troubleshoot data pipeline performance, ensuring data quality and reliability.
• Document data engineering processes, architectures, and best practices for future reference.
• Stay updated with industry trends and emerging technologies in data engineering and analytics.

Mandatory Skills:

• Strong proficiency in Python, with experience in data manipulation and analysis libraries such as Pandas and NumPy.
• Extensive experience with SQL and relational databases (e.g., PostgreSQL, MySQL).
• Hands on experience with data warehousing solutions and ETL tools.
• Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
• Strong problem solving skills and attention to detail.

Preferred Skills:

• Experience with data visualization tools (e.g., Tableau, Power BI).
• Knowledge of machine learning concepts and frameworks.
• Familiarity with containerization technologies (e.g., Docker, Kubernetes).
• Experience with version control systems (e.g., Git).

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 7 10 years of experience in data engineering or a related role.
• Proven ability to work collaboratively in a team environment and communicate effectively with technical and non technical stakeholders.

If you are a passionate Data Engineer with strong Python skills and a desire to work in a fast paced environment, we encourage you to apply and join our innovative team at TechM.