Data Engineer - ETL/ELT - IT Services

We are looking for an experienced Data Engineer with strong expertise in ETL/ELT development, Informatica, SQL, Python, and cloud-based data platforms.

The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, managing data integration processes, and supporting enterprise data warehousing initiatives.

The role involves working with Informatica PowerCenter, IICS/IDMC, Snowflake, Oracle, Microsoft SQL Server, and AWS services to build reliable data solutions.

The candidate will collaborate with cross-functional teams to ensure efficient data processing, integration, transformation, and delivery while leveraging modern AI-assisted development practices to improve engineering productivity.

Key Responsibilities:

- Design, develop, and maintain ETL/ELT pipelines using Informatica PowerCenter, Informatica Intelligent Cloud Services (IICS), and Informatica Intelligent Data Management Cloud (IDMC).

- Develop and optimize data extraction, transformation, and loading processes to support enterprise data integration requirements.

- Write, maintain, and optimize complex SQL and PL/SQL queries, stored procedures, and database operations.

- Work with Oracle and Microsoft SQL Server databases to manage data extraction, transformation, validation, and integration.

- Develop and maintain data warehouse solutions using Snowflake.

- Implement data loading strategies, data transformations, and data integration workflows within Snowflake environments.

- Utilize AWS services, including EC2, S3, IAM, Lambda, and EFS, to support cloud-based data processing and storage requirements.

- Develop Python scripts for data processing, transformation, automation, and validation using Pandas, NumPy, and DataFrames.

- Perform data profiling, cleansing, validation, and quality checks to ensure accuracy, consistency, and reliability.

- Monitor data pipeline performance, troubleshoot failures, and optimize workflows to improve efficiency and scalability.

- Maintain source code and collaborate with development teams using GitHub and version control practices.

- Leverage AI-assisted development tools and technologies, including LLMs, RAG, embeddings, AI agents, and prompt engineering, to enhance development productivity and automation.

- Collaborate with business analysts, architects, and technical teams to understand data requirements and deliver effective data engineering solutions.

- Prepare technical documentation covering data mappings, transformation logic, pipeline workflows, and integration processes.

- Follow software development best practices, coding standards, testing procedures, and deployment guidelines.

Required Skills and Qualifications:

- Strong experience in Data Engineering and enterprise data integration.

- Hands-on experience with ETL/ELT development using Informatica PowerCenter, IICS, or IDMC.

- Strong knowledge of SQL and PL/SQL.

- Experience working with Oracle and Microsoft SQL Server databases.

- Good understanding of Snowflake Cloud Data Warehouse and its data processing capabilities.

- Working knowledge of AWS services, including EC2, S3, IAM, Lambda, and EFS.

- Proficiency in Python for data processing and automation.

- Experience with Python libraries such as Pandas and NumPy.

- Understanding of data warehousing, data modelling, data transformation, and pipeline development.

- Experience with GitHub and version control repositories.

- Knowledge of data validation, troubleshooting, performance optimization, and data quality practices.

- Strong analytical, problem-solving, and communication skills.

- Ability to work effectively with cross-functional teams and manage development responsibilities independently.

Good to Have:

- Exposure to AI-assisted software development and engineering workflows.

- Familiarity with Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), embeddings, and AI agents.

- Understanding of prompt engineering and AI-driven automation.

- Experience working with cloud-based data engineering and modernization initiatives.

Education:

- B. Tech / B. E. in any specialization or an equivalent qualification.

Skills

Analytics, Data Analytics, Data Modeling, SQL, Python, Data Management, Data Warehousing, Large Language Model, Artificial Intelligence