Cloud Data & AI Engineer (m/f/d) - Databricks

Your mission

We are looking for a Cloud Data & AI Engineer with a focus on Databricks to design, implement, and evolve modern Data & AI platforms on Azure or AWS. Working alongside our team and our clients, you will mergedata engineering, cloud technologies, and AI-driven topics into solutions that are both functionally impactful and technically robust.

Your Impact:

• Architecting Solutions: You develop modern Data & AI solutions powered by Databricks.

• Pipeline Engineering: You build robust batch and streaming pipelines using Python, SQL, Spark, and PySpark.

• Lakehouse Evolution: You contribute to the design and implementation of Lakehouse architectures for Analytics, Machine Learning, and Generative AI (GenAI) use cases.

• Mastering the Stack: You leverage core Databricks components, including Delta Lake, Unity Catalog, Workflows, MLflow, Model Serving, and Vector Search.

• Advancing AI: You support the implementation and further development of ML, LLM, and GenAI use cases.

• AI Operations: You work on critical areas such as Serving, Retrieval (RAG), Evaluation, Monitoring, and Governance for AI applications.

• Data Integration: You connect diverse source systems, including APIs, databases, ERP, and CRM systems.

• Quality & Standards: You assist in implementing requirements for Data Quality, Security, Governance, and Observability.

Your profile

Must-haves:

• Initial to several years of hands-on experience in Data Engineering, Machine Learning Engineering, AI Engineering, or a comparable role.

• Strong proficiency in working with the Databricks platform.

• Solid knowledge of Python, SQL, Spark, and PySpark.

• Practical experience with at least one major cloud platform, ideally Azure or AWS.

• Experience in building or evolving modern cloud-based data platforms.

• Experience with MLflow, Model Serving, and Vector Search, preferably within the Databricks ecosystem.

• A fundamental to strong understanding of modern AI/LLM concepts, such as RAG, retrieval, evaluation, serving, and production-grade GenAI applications.

• Deep understanding of Lakehouse architectures, data modeling, and production data processes.

• Initial experience in the areas of Data Governance, Data Quality, Security, and Monitoring.

• Confident use of Git and ideally initial experience with CI/CD and Infrastructure as Code.

• A degree in Business Informatics, Computer Science, Data Science, or a related field of study.

• A structured, independent, and solution-oriented way of working.

• Fluency in German and good proficiency in English.

Nice-to-Haves:

• Experience with Terraform or OpenTofu.

• Experience with Kafka, CDC, or event-driven architectures.

• Familiarity with Airflow, dbt, or similar tools.

• Experience in integrating diverse source systems.

• A passion for collaborating with clients and interdisciplinary teams.

• Relevant certifications for Databricks, Azure, or AWS.

Why us?

Do you want to develop modern data and AI platforms in the cloud and take on responsibility in real-world projects? Do you enjoy working hands-on, thinking structurally, and building solutions that are scalable, maintainable, and production-ready?

Then this could be the perfect fit:

We are looking for a Cloud Data & AI Engineer with a focus on Databricks to design, implement, and evolve modern Data & AI platforms on Azure or AWS. Working alongside our team and our clients, you will merge data engineering, cloud technologies, and AI-driven topics into solutions that are both functionally impactful and technically robust.

What awaits you: High-end tech & genuine appreciation

• Engineering Excellence: You build modern Cloud Data & AI platforms. We value clean engineering, quality, and pragmatism - no quick-and-dirty hacks.

• Steep Learning Curve toward Core Expertise: We support your growth from specialist to Trusted Advisor. Certifications (Databricks, Azure, AWS) are fully covered by us!

• Your Playing Field: From agile startups to DAX corporations. You consult as a peer and turn innovative concepts into reality.

• Best-in-Class Setup: Work with state-of-the-art cloud technologies and premium equipment.

• Genuine Team Culture: International exchange and flat hierarchies in the heart of the Ruhr area. We celebrate successes together - whether after work or at our team events.

• Work-Life Balance: Flexibility is a standard for us, not just a benefit. Home office and individual models ensure that your job fits your life.