Sr. Data Engineer

Center for Creative Leadership (CCL) is a US-based, world-renowned provider of leadership research, coaching, and consulting with over 50 years of experience, dedicated to advancing the understanding, practice, and development of leadership for the benefit of society worldwide. CCL has a Global Capability Center in India which hosts roles across CCL’s Global locations and has grown into a multi-function hub that increasingly owns and runs global processes end to end. Within CCL, the Global Technology Team (GTT) designs, builds, and supports the enterprise platforms, applications, and data assets that power CCL’s client programs, digital learning, and internal operations across the Americas, EMEA, and APAC, and is now investing in a modern, AI-ready data platform built on Microsoft Fabric and Azure.

Within GTT, the Senior Data Engineer is focused on designing, building, and running CCL’s enterprise data platform and data products, acting as the senior technical anchor for data engineering and a trusted partner to global business and technology stakeholders; the role leads the consolidation of a legacy Azure Synapse, Data Factory, and SSIS estate onto Microsoft Fabric, delivers governed and well-documented data products for Finance, Revenue Operations, analytics, and AI use cases, and holds overall responsibility for engineering standards, data quality, security, production reliability, and the mentoring of engineers as the GCC’s data capability scales.

Principal Duties & Responsibilities:

• Data platform engineering & modernization - Designs, builds, and supports scalable production pipelines using Microsoft Fabric (Data Factory, notebooks, Lakehouse, Warehouse), Spark/PySpark, SQL, and Python on a Bronze-Silver-Gold (medallion) architecture, and leads the migration of Azure Synapse, Data Factory, and SSIS workloads to Fabric while retiring duplication and technical debt.
• Data modeling, analytics & AI enablement - Designs dimensional and relational models, reusable datasets, and Power BI semantic models (including Direct Lake) with consistent, business-owned definitions, and prepares governed, well-documented data assets that can safely ground Copilot Studio agents and other AI solutions on CCL’s Microsoft estate.
• Finance & business data products - Partners with Finance, Revenue Operations, and GCC process and data analysts to translate requirements into certified data products, including turning Dynamics 365 Finance & Operations and project data into trusted reporting that reconciles what is sold, contracted, delivered, and invoiced.
• Data quality, governance & security - Embeds automated testing, reconciliation, monitoring, and alerting into every pipeline; applies access, privacy, and security controls (row- and object-level security, Key Vault-managed secrets) to protect sensitive client and participant data; and maintains metadata, lineage, business rules, and ownership using Microsoft Purview.
• DevOps, production support & operational excellence - Uses Git, peer reviews, CI/CD, and Fabric deployment pipelines across development, test, and production; maintains runbooks, alerting, and support documentation; monitors and cost-optimizes Fabric capacity; and leads root-cause analysis so production issues, especially during finance-critical cycles such as month-end close, do not recur.
• Technical leadership & global collaboration - Leads the technical design of complex data solutions as a senior individual contributor, establishes reusable engineering standards and design-review practices, mentors engineers and analysts in India, and communicates options, risks, and recommendations clearly to US and global stakeholders across time zones.

Key Competencies:

• Technical Depth & Engineering Judgment - Brings hands-on mastery of modern data engineering and makes sound, pragmatic choices on architecture, simplicity, cost, and maintainability; knows when a quick fix is acceptable and when a durable solution is required and takes ownership of the outcome.
• End-to-End Ownership & Accountability - Owns solutions from design through production support rather than handing off at deployment; holds self and others accountable to engineering standards, surfaces risks early, and builds trust by delivering what was committed.
• Operational Discipline & Data Stewardship - Treats data quality, security, governance, and documentation as part of the job, not an afterthought; brings a calm, structured, root-cause approach to incidents and continuously hardens the platform.
• Global Communication & Stakeholder Influence - Explains complex technical concepts in clear business language, listens well, and influences senior global stakeholders (including pushing back when needed); builds strong working relationships across cultures, functions, and time zones.
• Learning Agility & Multiplier Mindset - Keeps pace with a fast-evolving Microsoft Fabric and AI landscape, experiments responsibly, and raises the capability of the people around them through mentoring, code reviews, and shared standards.

Education and Experience:

• Education & Experience - Bachelor’s or Master’s degree (B.E./B.Tech/MCA/M.Tech) in Computer Science, Information Technology, Engineering, Data Analytics, or a related discipline, along with 12-18 years of professional experience in data and technology, including 7+ years of hands-on data engineering and 3+ years designing solutions on Azure data platforms (Synapse, Data Factory, Databricks, or Fabric).
• Global / MNC Exposure - Sustained experience (typically 5+ years) in multinational environments such as a Global Capability Center, global product company, or international consulting practice, working directly with US or European stakeholders.
• Technical Proficiency - Strong command of SQL, Spark/PySpark, Python, Delta Lake, query optimization, data architecture, and data modeling; production experience with Microsoft Fabric (OneLake, Lakehouse, Warehouse, Data Factory, deployment pipelines) and Power BI semantic models; working knowledge of Azure SQL, Data Lake Storage, Cosmos DB, Logic Apps, Key Vault, SSIS, and Git/Azure DevOps.
• Certifications & Domain Exposure (Preferred) - Microsoft Certified Fabric Data Engineer Associate or Fabric Analytics is a plus; In addition to this , Experience delivering data products on Dynamics 365 Finance & Operations or Project Operations, enterprise governance with Microsoft Purview, and preparing data for generative AI and retrieval-based solutions is an added advantage.

Other Requirements/Experience:

• Willingness to work in India afternoon business hours with a regular 3-4-hour overlap with US Eastern Time for stakeholder meetings and production support.
• Occasional travel may be required, primarily to CCL’s India locations and, where needed, global CCL offices.
• Strong written and spoken English, with the confidence to present to senior global audiences, is essential.

Benefits:

• Employer-paid insurance
• Flexi Benefit

Paid time off and paid holidays