Data Engineer Lead - Databricks - Eng

What We Do

• Leveraging our expertise, we build modern Machine Learning systems for demand planning and budget forecasting.
• Developing scalable data infrastructures, we enhance high-level decision-making, tailored to each client.
• Offering comprehensive Data Engineering and custom AI solutions, we optimize cloud-based systems.
• Using Generative AI, we help e-commerce platforms and retailers create higher-quality ads, faster.
• Building deep learning models, we enhance visual recognition and automation for various industries, improving product categorization, quality control, and information retrieval.
• Developing recommendation models, we personalize user experiences in e-commerce, streaming, and digital platforms, driving engagement and conversions.

Our Partnerships

• Amazon Web Services
• Astronomer
• Databricks

Our Values

• We are Data Nerds
• We are Open Team Players
• We Take Ownership
• We Have a Positive Mindset

Curious about what we’re up to? Check out our case studies and dive into ourblog post to learn more about our culture and the exciting projects we’re working on!

Responsibilities

• Lead end-to-end data migration initiatives, ensuring a smooth, secure, and business-aligned transition.
• Define and communicate data architecture decisions, evaluating impacts, risks, and performance considerations across cloud data platforms such as AWS Redshift, Databricks, and related technologies.
• Coordinate the discovery and documentation of dependencies, schema inventories, data flows, and critical processes involved in migration efforts.
• Own migration and cutover planning, ensuring all activities, validations, and contingency measures are properly defined and executed.
• Serve as the primary liaison between engineering, analytics, product, and business stakeholders, facilitating clear communication and alignment throughout the project lifecycle.
• Translate technical changes in data pipelines, data warehouses, and platform architecture into clear business impact assessments.
• Define and document assumptions, requirements, and acceptance criteria to ensure successful migration outcomes.
• Oversee data validation processes to guarantee the accuracy, consistency, and integrity of migrated datasets against source-of-truth systems.
• Proactively identify, assess, and mitigate migration-related risks, escalating blockers and dependencies when necessary to maintain project timelines and quality standards.
• Drive problem-solving and decision-making in fast-paced, ambiguous environments, helping cross-functional teams stay focused on priorities and deliverables.
• Create, maintain, and improve project documentation, including migration runbooks, testing strategies, rollback plans, and operational procedures.
• Provide regular project status updates to technical and executive stakeholders, ensuring transparency around progress, risks, and next steps.
• Promote data governance, quality, and operational best practices throughout the migration lifecycle.
• Align engineers, analysts, and product stakeholders around priorities, timelines, and delivery expectations to ensure successful project execution.

Required Skills

• Experience in Data Engineering, including building and optimizing data pipelines.
• Experience working with Databricks, Python, and Spark, building batch and streaming.
• Advanced English Level.
• Familiarity with a BI visualization tool like Looker or Tableau.

Perks

• Remote-first culture - work from anywhere!
• AWS, DBT, Google Cloud, Azure & Databricks certifications fully covered
• In-Company English Lessons.
• Birthday off + an extra vacation week (Mutt Week! )
• Referral bonuses - help us grow the team & get rewarded!
• Maslow: Monthly credits to spend in our benefits marketplace.
• Annual Mutters' Trip - an unforgettable getaway with the team.
• Monthly Childcare Reimbursement - Because supporting families matters too