Data Engineer

Job Description:

• Design and develop data processing and data persistence software components for solutions handling data at scale
• Provide strong development leadership for team members and take responsibility for codebase quality and alignment with user needs
• Take responsibility for development of whole components or subsystems, including design, coding, testing and defect resolution
• Perform hands-on design and development using open source and commercial platforms
• Define and enforce development best practice and coach team members
• Work with project architects on non-functional ETL/ELT pipeline needs such as robustness and performance
• Own unit and integration testing standards and execution within the team
• Take responsibility for software product due diligence and integration
• Lead troubleshooting and tuning activities
• Work with Operations teams to ensure application software is operationally ready
• Work with Security Architects and accreditors to ensure compliance with legal and security requirements
• Advise customers, managers and team members on estimated effort and technical implications of user stories and journeys
• Contribute to technical proposals during the sales process
• Manage, coach and develop a small number of staff, focusing on performance and career development
• Provide direction for the team while solving problems collaboratively

Requirements:

• Experience of leading a team of engineers in the implementation of data-intensive system components
• Experience of applying standards for design (patterns), development (style guides) and operational readiness (automation, deployment)
• Proficient software development experience in one of Java, Scala, or Python
• Strong commercial experience of working with Palantir
• Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks
• Expert in SQL or SQL extensions for analytical use case
• Expert understanding of distributed data stores and data processing frameworks
• Ability to simply and clearly communicate technical design both written and verbally
• Proficient in designing analytical and operational data models
• Comfortable with Data Warehouse methods and techniques
• AWS/Azure/GCP Certified in Data Services
• Expertise in continuous improvement and sharing input on data best practice
• Participation in development and/or technology communities

Benefits:

• Diversity, equity and inclusion commitment
• Accommodations or adjustments during the recruitment process
• Recruitment process tailored to individual needs through private conversation