Data Scientist / Full Stack Data Engineer

About YellowIpe

Our mission is to inspire the connection between technology and people. We nurture the best in our professionals through our expertise in finding and attracting top talent for the best projects. People Focus, Collaboration, and Commitment are the pillars that guide us on this journey.

Join the yellow team as our new Data Scientist / Full Stack Data Engineer!

Responsabilities:

• Develop end-to-end data functionalities on an AWS Big Data platform, ensuring quality and scalability;

• Actively participate in strategic discussions around solution architecture, data flows, and required processes, contributing both technical and business insights;

• Create, maintain, and optimize data processing and analytics applications, integrating data engineering and data science methodologies;

• Create proofs of concept to validate innovative approaches and technologies that meet project requirements;

• Develop production-ready solutions following DevOps practices, including automated testing and secure deployments across development, quality assurance, and production environments;

• Monitor implemented solutions, supporting debugging activities and driving continuous improvements to ensure performance and security;

• Work with relational and NoSQL databases, implementing efficient queries to optimize data access;

• Support data extraction and perform exploratory data analysis to identify relevant patterns and insights;

• Contribute to deploying models into production environments and managing their lifecycle;

• Maintain accurate and up-to-date technical documentation covering workflows and solutions in use;

• Manage and track the technical debt backlog, prioritizing issues that impact operational efficiency;

• Support infrastructure change requests, ensuring alignment between data requirements and system architecture.

Requirements:

• Up to 5 years of experience in a relevant role, preferably within data and software engineering environments;

• Bachelor’s degree in Software Engineering, Computer Engineering, or a similar field;

• Strong experience with Python, particularly for data manipulation and processing using libraries such as Pandas and NumPy;

• Strong understanding of SQL and the ability to write complex queries for data analysis and integration;

• Experience with programming and debugging in software development environments;

• Experience with relational databases such as PostgreSQL or MySQL and NoSQL databases such as MongoDB or DynamoDB;

• Experience deploying models into production environments and managing their lifecycle using tools such as MLflow or Kubeflow;

• Genuine interest in Data Science and its practical applications;

• Good written and verbal communication skills, with the ability to explain technical concepts to non-technical audiences;

• Ability to work independently and proactively, demonstrating initiative when solving problems;

• Ability to work effectively in collaborative environments and with global teams, adding value to technical discussions;

• Strong critical thinking and problem-solving skills to address complex challenges;

• Knowledge of Agile methodologies and tools such as Jira and Confluence;

• Strong commitment to the quality of delivered work;

• Fluent English (mandatory).

Nice to have:

• Experience with AWS services such as S3, Lambda, Athena, EC2, Glue, CDK / CloudFormation, Step Functions, Batch, or Fargate, applying them to Big Data solutions;

• Practical knowledge of Spark / PySpark for large-scale data processing;

• Familiarity with version control systems such as Git for effective team collaboration;

• Experience with Jupyter Notebooks, supporting interactive development and code sharing;

• Experience developing applications or working in production environments, understanding the importance of collaboration between development and operations;

• Knowledge of the Energy and Utilities sector, bringing domain insights to the solutions developed;

• Understanding of GDPR regulations and their application to Data Science projects;

• Portuguese language skills are valued;

• Proactive and autonomous mindset, with a willingness to learn new skills and technologies;

• Strong team spirit and a collaborative approach focused on collective success.

Important information:

• Contract type: Full-time

• Location: Portugal - Lisbon - Lisbon

• Work model: Hybrid

• Language(s) required: English — Advanced (C1)

• Level: Middle

Candidatura: Ver a vaga e candidatar-me na YellowIpe