Senior Data Engineer

Responsibilities:

• Lead the architecture, design, and development of data warehousing solutions.
• Provide technical guidance and mentorship to the data engineering team.
• Ensure best practices in data warehousing, ETL/ELT processes, and data integration.
• Design, develop, and optimize ETL/ELT pipelines using industry-standard tools.
• Ensure data accuracy, integrity, and consistency across data sources.
• Monitor and troubleshoot ETL/ELT processes to ensure timely and accurate data loading.
• Implement and manage data warehousing solutions using Snowflake.
• Utilize AWS Glue for data integration and ETL/ELT tasks.
• Optimize data storage and retrieval processes to enhance performance.
• Apply AI/ML concepts to extract insights from large datasets.
• Integrate AI solutions like Cortex AI/AWS Bedrock into the data warehousing environment.
• Leverage knowledge in Finance, Accounts, and Manufacturing to understand business requirements.
• Develop data solutions that address specific needs within these domains.
• Collaborate with stakeholders to gather and analyze business requirements.

Requirement:

• Overall, 3 to 5 years' experience, including 2+ years of experience in Data Analytics and Digital solutions with exposure to Lakehouse architecture.
• BTech in Computer Science or IT.
• Technical expertise with data models, data mining, and segmentation techniques.
• Knowledge of programming languages (e.g. Java and Python) and hands-on experience with SQL database design.
• Exposure to Cortex AI, AWS Bedrock, Copilot Studio (good to have).
• Strong analytical and problem-solving skills. Strong influencing and communication skills (written, verbal, presentation) with the ability to be a thought partner/coach to the internal team.
• Should have exposure to Cloud ETL/ELT, Cloud DWH, AI, and ML tools.
• Domain expertise in Finance, Accounts, and Manufacturing.
• Exposure to agile software development and/or development management.
• Positive attitude and motivation to deliver and ensure the highest quality deliverables. Able to respond positively and calmly to shifting priorities, demands, and timelines.

Skills

AI, DWH, Data Warehousing, ETL, Java, Lakehouse, ML, Python, SQL, Snowflake