CAP Intelligence Platform Databricks Engineer

Job Description

As a Senior Specialist, Intelligence Platform Engineer reporting to the AVP of Enterprise Architecture, you'll play a critical role in administering, governing, and scaling Nasdaq's centralized Databricks Lakehouse environment - the CAP Intelligence Platform - which serves multiple business units across the Capital Access Platforms organization.

You'll thrive in this position if you're detail-oriented, technically strong, and energized by building platforms that bring data governance, compliance, and operational efficiency together at scale.

Key Responsibilities

• Administer and support a multi-workspace Databricks environment, including Unity Catalog governance, service principal management, and enterprise integrations, ensuring platform reliability and operational standards across all business units.
• Own platform-wide governance by monitoring compliance with catalog structure, metadata standards, naming conventions, and tagging requirements - producing scorecards, audit reports, and driving remediation where needed.
• Deliver monthly cost and usage reporting across workspaces, compute clusters, serverless workloads, and storage resources, identifying optimization opportunities and providing business unit-level consumption transparency.
• Partner with workspace administrators and data stewards across six business units to enable self-service administration, develop operational documentation, and serve as the escalation point for complex platform issues.
• Support Infrastructure-as-Code implementations using Terraform to automate provisioning, governance validation, and reporting - contributing to a scalable, efficient platform.

Required Qualifications

• Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent practical experience.
• 5+ years of experience in data platform administration, cloud infrastructure, or a comparable technical discipline.
• Hands-on experience administering Databricks at scale, including Unity Catalog, workspace configuration, and compute management.
• Proven ability to deliver governance frameworks, compliance reporting, and cost management in a complex, regulated environment.
• Strong communicator who works effectively across technical and business teams in matrixed, cross-functional environments.

Preferred Qualifications

• Databricks Certified Professional certification or equivalent cloud certifications (e.g., AWS).
• Experience in financial services, fintech, or regulated industries, including familiarity with compliance requirements such as Reg SCI.
• Background in FinOps principles, identity lifecycle management, or large-scale platform rollouts.

This position offers the opportunity for a hybrid work environment at least 3 days a week in-office, subject to change, providing flexibility and accessibility for qualified candidates.

Come as You Are

Nasdaq is an equal opportunity employer. We welcome applications from candidates of all backgrounds and identities.

We are committed to fostering an inclusive workplace where diverse perspectives, experiences, and identities are valued and celebrated.

We ensure that individuals with disabilities are provided with reasonable accommodation throughout the hiring process.

What We Offer

We’re proud to offer a competitive rewards package that is meaningful, recognizes the unique needs of our employees and their families and incentivizes employees for their contribution to Nasdaq’s overall success.