Data Engineer - ETL/Data Pipeline

Job Summary :

We are looking for an experienced Data Engineer with 5+ years of hands-on experience in building and maintaining scalable data pipelines and data processing solutions. The candidate should have strong expertise in Python, SQL, ETL/ELT, cloud platforms, and data warehousing.

Key Responsibilities :

- Design, develop, and maintain scalable ETL/ELT data pipelines.

- Develop complex and optimized SQL queries for data transformation and processing.

- Use Python for data engineering, automation, and data processing.

- Work with cloud platforms such as AWS, Azure, or GCP.

- Build and maintain data warehouses, data lakes, and data models.

- Perform data validation, quality checks, reconciliation, and troubleshooting.

- Monitor data pipelines and resolve data processing failures.

- Optimize queries and pipelines for performance, scalability, and reliability.

- Work with relational and cloud databases such as SQL Server, PostgreSQL, MySQL, Snowflake, or similar.

- Collaborate with developers, analysts, data scientists, and business stakeholders.

- Follow best practices for data quality, security, documentation, and version control.

Required Skills:

- 5+ years of Data Engineering experience

- Strong SQL and Python skills

- Hands-on experience with ETL/ELT

- Strong understanding of data warehousing and data modeling

- Experience with at least one cloud platform: AWS / Azure / GCP

- Experience with databases and large-scale data processing

- Good knowledge of Git/version control

- Strong problem-solving and analytical skills

- Good communication and stakeholder management skills

Nice to Have :

- Databricks / Apache Spark / PySpark

- Airflow

- Snowflake

- Kafka

- dbt

- CI/CD

- Power BI or Tableau

Skills

Python, SQL, ETL, Data Warehousing, Cloud, Git, Apache Spark, Kafka, Tableau, Snowflake DB, Data Pipeline