Data Engineer

About YellowIpe

Our mission is to inspire the connection between technology and people. We nurture the best in our professionals through our expertise in finding and attracting top talent for the best projects. People Focus, Collaboration, and Commitment are the pillars that guide us on this journey.

Join the yellow team as our new Data Engineer!

Responsibilities:

• Design, build, and operate enterprise-grade ETL and ELT pipelines supporting AI, analytics, reporting, and agentic workflow use cases.

• Develop clean, documented, and reusable data products using operational, customer, logistics, sales, and other enterprise data sources.

• Implement data quality checks, monitoring, lineage, metadata, and reliability patterns, ensuring datasets are trustworthy and production-ready.

• Support integrations between Azure-based AI services, Snowflake, APIs, file-based data sources, and AWS data services when required.

• Collaborate with business and AI teams to translate use case requirements into effective data models, pipelines, and serving layers.

• Work closely with Data Scientists, AI Engineers, Cloud Engineers, business stakeholders, and local IT teams to deliver scalable data solutions.

• Support the onboarding of new data sources while ensuring compliance with data protection, access control, and governance requirements.

• Continuously improve the reliability, scalability, and reusability of enterprise data pipelines and data products.

Requirements:

• Strong hands-on experience with Python and SQL.

• Solid experience with data modelling and ETL/ELT development, including production-grade data pipelines.

• Experience with cloud-native data engineering, ideally within the Azure ecosystem.

• Experience with Snowflake or comparable cloud data platforms.

• Good understanding of data quality, orchestration, observability, access management, and data governance in enterprise environments.

• Experience integrating multiple data sources, APIs, and enterprise systems.

• Ability to collaborate effectively with Data Scientists, AI Engineers, business stakeholders, and IT teams in international environments.

• Familiarity with GenAI-assisted software engineering tools such as GitHub Copilot, Cursor, or OpenCode.

Nice to have:

• Experience with Apache Iceberg, AWS Glue, Spark, Databricks, or similar data engineering technologies.

• Previous experience working with logistics, parcel operations, customer feedback, route, depot, or sales data.

• Exposure to AI feature stores, vector databases, retrieval pipelines, or data preparation for Generative AI applications.

Important information:

• International and collaborative work environment.

• Worktime flexibility.

Candidatura: Ver a vaga e candidatar-me na YellowIpe