DataBricks Administrator - Officer
Job Summary:
The DataBricks Administrator is responsible for the administration, Governance, Security, Performance optimization and operational support of the DataBricks Platform. The role involves managing workspaces, clusters, Unity catalog, access controls, monitoring, automation and cost optimization while supporting data engineering, Data science and analytics teams.
Key Responsibilities:
- Administer and maintain DataBricks workspaces, clusters, cluster policies, jobs, and notebooks.
- Manager user provisioning , groups, service principals, SCIM Integration, and role based access control.
- Monitor platform health, performance, resource utilization and troubleshoot production issues.
- Knowledge on AWS S3, IAM roles, key Vault and networking components
- Automate platform administration using Terraform, Harness and CI/CD pipelines.
- Support backup, recovery, disaster recovery and platform upgrades.
- Optimize and tune Databricks job performance, including query optimization, resource management, and scaling strategies
- Address data issues, environment issues, performing impact analysis, root cause analysis, corrective, adaptive and perfective maintenance
- Responsible for all aspects of the software development lifecycle, including design, coding, integration testing, deployment, and documentation
Key Skills:
- DataBricks
- Unity Catalog
- Terraform
- AWS/Azure
- IAM and Security Controls
- CICD
- Monitoring and troubleshooting
About State Street
Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.
We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.
As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.
Discover more information on jobs at StateStreet.com/careers
Read our CEO Statement