Big Data Solutions Architect

We are looking for an experienced Data / Solution Architect to lead the design of a migration from a custom reporting platform to Databricks. The role combines architecture ownership with hands-on technical work and close collaboration with the client.

During the initial phase, you will define the migration approach, including tool inventory, sequencing, regression strategy, and rollback planning, as well as develop an external data strategy with a clear build-versus-buy recommendation.

Zakres obowiązków

• Design the migration from the existing custom reporting platform to Databricks
• Define migration sequencing, regression testing, and rollback approaches
• Ensure migration is delivered with no functional regression compared with current reporting outputs
• Design the architecture for acquiring and processing external data
• Define approaches for crawl reliability, rate governance, and compliance with source terms of use
• Optimize LLM-related costs, model selection, processing deduplication, and right-sizing
• Develop a build-versus-buy assessment for external data acquisition, including commercial comparison with data providers
• Work hands-on with the technical solution and collaborate closely with engineering teams
• Communicate architecture decisions and recommendations directly to client stakeholders

Wymagania

• Strong experience architecting reporting products built on custom platforms rather than traditional BI stacks
• Proven experience designing migrations from legacy replication solutions to a lakehouse architecture, ideally Databricks
• Experience defining migration strategies with strict functional-regression requirements
• Strong knowledge of external data acquisition architecture, including crawling, rate governance, reliability, and data-processing optimization
• Experience with LLM cost optimization, model selection, right-sizing, and processing deduplication
• Ability to conduct build-versus-buy assessments, including technical and commercial evaluation of external data providers
• Strong hands-on technical capabilities
• Excellent client-facing English communication skills
• Willingness and ability to travel
• Knowledge of SAP procurement data is a plus
• Exposure to commodity or market-index data is a plus

Tech stack

• Big Data
• Databricks
• SQL
• LLM
• Architecture