DevOps Engineer

We're seeking an experienced full-stack developer / DevOps Engineer to join our team. As a key member of our technology department, you will be responsible for designing, building, and maintaining scalable data pipelines using Python and managing them in a continuous integration environment. Additionally, you will work closely with our development teams to ensure the smooth deployment of web applications developed with PHP frameworks (Yii and Laravel) and other technologies. This is not an exhaustive list of duties or functions and might not necessarily comprise all the essential functions of the position. The employee may perform other related duties as negotiated to meet the ongoing needs of the organisation.

Responsibilities:

• Design, develop, and maintain data pipelines using Python (e. g., Pandas, NumPy, scikit-learn) for processing and analysing large datasets.
• Manage data pipelines in a continuous integration environment (e. g., Jenkins, CircleCI) to ensure automated testing, deployment, and monitoring of data processing jobs.
• Collaborate with development teams to deploy web applications developed with PHP frameworks (Yii and Laravel) and other technologies using CI/CD tools (Jenkins, CircleCI).
• Ensure software quality by writing unit/functional/acceptance tests using Codeception, Pytest, and other testing frameworks.
• Manage dependencies and packages using Composer (PHP) and Pip (Python).
• Develop and maintain automation scripts to streamline tasks, such as data processing, deployment, and testing.
• Troubleshoot issues with data pipelines, applications, and CI/CD workflows.
• Stay up-to-date with industry trends and best practices in DevOps, data engineering, and software development.

Requirements:

• Bachelor's degree in Computer Science, Data Science, or a related field.
• 3+ years of experience in DevOps and data engineering with Python.
• Experience with managing data pipelines in a continuous integration environment (e. g., Jenkins, CircleCI).
• Strong understanding of PHP frameworks (Yii and Laravel) and software testing with Codeception, Pytest.
• Experience with data technologies (e. g., SQL, NoSQL databases).
• Familiarity with CI/CD tools (Jenkins, CircleCI) and version control systems (Git, Github, SVN).
• Knowledge of package and dependency management using Composer (PHP) and Pip (Python).
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.
• Knowledge of cloud platforms (e. g., AWS, Azure, Google Cloud) and containerization (e. g., Docker, Podman).
• Experience with Linux-based operating systems and shell scripting.

Skills

CI/CD, CircleCI, ETL, Jenkins, Python, data engineering, data pipelines, devops