Data Engineer (Databricks + GenAI)

This role supports a large-scale BI modernization initiative that transforms legacy reporting platforms into a modern cloud-based analytics ecosystem. You will design scalable data solutions, build AI-powered insights, and support the migration of reporting assets into an enterprise analytics platform. You will work closely with business stakeholders, data engineers, analytics teams and product owners.

Our client is a leading global provider of data analytics and AI-driven solutions in the computer software industry. They serve large enterprises across banking, cards, retail banking and financial services. The organization is known for a culture of innovation, scale and continuous modernization of its technology platforms.

Responsibilities

• Design and develop scalable data pipelines using Python, SQL and Databricks.
• Build and optimize data models for analytics and reporting.
• Develop Power BI semantic models, datasets, dashboards and executive reporting solutions.
• Implement AI and machine learning solutions to enhance business insights and decision-making.
• Work with Azure AI/OpenAI services to build intelligent analytics capabilities.
• Support migration from legacy BI platforms to Power BI.
• Collaborate with business teams to define KPIs, metrics and reporting requirements.
• Ensure data quality, governance, lineage and compliance standards are met.
• Optimize performance of large-scale reporting and analytical workloads.
• Participate in Agile ceremonies and contribute to solution architecture discussions.

Requirements

• 8+ years of experience in Data Engineering, Analytics Engineering or AI Engineering.
• Strong hands-on experience with Python and SQL.
• Experience developing solutions in Databricks using PySpark.
• Strong experience with Power BI, DAX and semantic modeling.
• Experience building ETL/ELT pipelines and cloud data platforms.
• Understanding of Machine Learning and AI concepts.
• Experience with Azure cloud services.
• Strong analytical and problem-solving skills.
• Excellent communication and stakeholder management skills.
• Graduate in Computer Science, Data Science or a related discipline. Internal candidates are welcome to apply.

Skills

Python, SQL, Databricks, PySpark, Power BI, DAX, Semantic Modeling, ETL/ELT Pipelines, Azure Cloud Services, Machine Learning and AI concepts, Azure OpenAI, Microsoft Copilot, Generative AI solutions, Tableau-to-Power BI migration, Collibra, Microsoft Purview, Metric lineage and KPI frameworks, Banking/Cards/Retail Banking/Financial Services domain