Data Engineer
Andersen is hiring aData Engineer for a project developing and optimizing scalable data solutions to support reliable analytics, reporting, and business decision-making.
The customer is a large technology-driven company operating in a rapidly developing market. It provides a broad range of digital services for consumers and businesses through an integrated technology platform. The company serves a significant customer base, works with an extensive network of partners, and continues to invest in technology, infrastructure, and service development to support its ongoing growth.
The project is focused on developing and optimizing data marts in Greenplum based on business requirements and analytical prototypes. It aims to ensure efficient data processing, high performance, and reliable data availability for analytics and reporting.
Responsibilities:
Developing ETL/ELT pipelines for data ingestion and transformation based on SA specifications.
Implementing data mart prototypes in Greenplum for production: refactoring SQL, implementing incremental loading, and ensuring idempotency.
Optimizing queries and data marts in Greenplum: selecting distribution keys, implementing partitioning, analyzing query plans (EXPLAIN ANALYZE), mitigating data skew and broadcast/redistribute motion, and configuring resource queues/groups.
Configuring pipeline orchestration, monitoring, and alerting.
Performing data quality checks and ensuring SLAs for data mart freshness.
Must-haves:
Experience working as a Data Engineer for 3+ years.
Strong SQL skills, including complex queries, window functions, and working with large tables; advanced Python proficiency.
Extensive experience with Greenplum, including a strong understanding of distributed architecture and MPP systems, distribution keys and partitioning, query optimization and execution plan analysis, VACUUM/ANALYZE, and working with append-optimized and column-oriented tables.
Experience working with DWH systems and a solid understanding of data modeling principles, including Data Vault and star/snowflake schemas.
Experience working with orchestration tools such as Airflow or similar solutions and processing large volumes of data.
Experience working with Git and CI/CD pipelines and participating in code reviews.
Ability to read and analyze source system documentation and effectively collaborate with source system owners.
Ability to write clear, well-structured, and unambiguous technical specifications.
Level of English - from Intermediate and above.
Reasons why this job would be interesting to you:
Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc..
The opportunity to change the project and/or develop expertise in an interesting business domain.
Job conditions - you can work both fully remotely and from the office or can choose a hybrid variant.
Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee.
The opportunity to earn up to an additional 1,000 EUR per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities.
Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated.
Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies).
Certification compensation (AWS, PMP, etc).
Referral program.
Private health insurance and sports compensation, depending on the type of employment.
Your personal data is protected in accordance with GDPR regulations. Learn more:
https://andersenlab.com/privacy-policy
Join us!