Data Engineer

We are seeking an experienced Data Engineer with 5-8 years of experience in designing, developing, and maintaining scalable data pipelines and data platforms. The ideal candidate should have strong expertise in data integration, ETL/ELT processes, cloud data services, and database technologies. The role involves working closely with business stakeholders, data analysts, and data scientists to deliver reliable and high-quality data solutions.

Key Responsibilities

• Design, develop, and optimize scalable data pipelines and workflows. Build and maintain ETL/ELT processes for structured and unstructured data.
• Develop and manage data integration solutions across multiple source systems. Implement data quality, validation, and governance standards.
• Work with large-scale datasets in cloud and on-premises environments. Optimize database performance and data storage solutions.
• Collaborate with Data Scientists and Business Analysts to support analytics and reporting requirements.
• Monitor, troubleshoot, and resolve data pipeline issues. Implement security and compliance requirements for data platforms.
• Participate in code reviews and follow best practices for development. Required Skills Strong proficiency in SQL and database concepts.
• Experience with ETL/ELT tools and data integration platforms. Hands-on experience with Azure Data Factory, Databricks, Synapse Analytics, or similar cloud technologies.
• Strong knowledge of Python, PySpark, or Scala. Experience with data warehousing concepts and dimensional modeling.
• Knowledge of Big Data technologies such as Spark and Hadoop. Experience with Azure Cloud, AWS, or GCP. Understanding of CI/CD, Git, and DevOps practices. Strong analytical and problem-solving skills.

Skills

• Preferred Skills Experience with Snowflake, Delta Lake, or Lakehouse architecture.
• Exposure to AI/ML data preparation and feature engineering.
• Knowledge of data governance and data security standards.
• Relevant cloud certifications (Azure Data Engineer Associate, AWS Data Analytics, etc.). Qualifications Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. 5-8 years of experience in Data Engineering and Data Integration.