AWS Data Engineer

Job Summary

We are seeking a skilled Sr. Developer with 6 to 9 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in AWS DevOps Amazon Redshift Python AWS Glue Amazon S3 and Apache Spark. This role involves designing developing and optimizing scalable solutions to meet business needs while ensuring high performance and reliability.

Responsibilities

• Design and implement scalable data pipelines using AWS Glue and Apache Spark to process large datasets efficiently.
• Develop and maintain data storage solutions leveraging Amazon S3 and Amazon Redshift to ensure secure and optimized data management.
• Collaborate with cross-functional teams to gather requirements and translate them into technical solutions that align with business objectives.
• Optimize existing workflows and processes to enhance system performance and reduce operational overhead.
• Provide technical expertise in Python programming to develop robust scripts and applications for data processing and automation.
• Monitor and troubleshoot issues in AWS DevOps environments to ensure seamless deployment and operation of applications.
• Conduct regular code reviews and implement best practices to maintain high-quality standards in development.
• Create and maintain comprehensive documentation for all development processes ensuring clarity and accessibility for team members.
• Stay updated with the latest advancements in AWS technologies and incorporate them into projects to improve efficiency and innovation.
• Ensure compliance with security standards and protocols while handling sensitive data within cloud environments.
• Collaborate with stakeholders to deliver solutions that align with organizational goals and contribute to overall business success.
• Provide mentorship and guidance to junior developers fostering a culture of continuous learning and improvement.
• Drive innovation by identifying opportunities to leverage emerging technologies for enhanced system capabilities.

Qualifications

• Possess strong expertise in AWS DevOps including deployment automation and infrastructure management.
• Demonstrate proficiency in Amazon Redshift for data warehousing and analytics solutions.
• Exhibit advanced skills in Python programming for developing scalable and efficient applications.
• Have hands-on experience with AWS Glue for ETL processes and Apache Spark for big data processing.
• Show a deep understanding of Amazon S3 for secure and optimized data storage solutions.
• Display excellent problem-solving skills and the ability to troubleshoot complex technical issues effectively.
• Possess strong communication skills to collaborate with cross-functional teams and stakeholders.
• Have a proven track record of delivering high-quality solutions within deadlines and budget constraints.
• Demonstrate a commitment to continuous learning and staying updated with industry trends and technologies.
• Exhibit a proactive approach to identifying and addressing potential risks and challenges in projects.
• Showcase the ability to work independently and take ownership of tasks while contributing to team success.
• Bring a customer-centric mindset to ensure solutions meet end-user needs and expectations.
• Possess a strong understanding of cloud security principles and best practices.

Certifications Required

AWS Certified DevOps Engineer AWS Certified Solutions Architect Apache Spark Certification