Databricks Architect

Newt Global is seeking a Databricks Architect to support its Data Services portfolio. The role designs, develops, optimizes, and supports enterprise-scale data platforms, pipelines, and analytics solutions using Databricks Lakehouse and AWS, while collaborating with architecture, application, business, and platform teams.

Responsibilities

• Design develop and maintain scalable data pipelines using Databricks Pyspark Spark SQL and Delta Lake
• Build and support enterprise data lake and Lakehouse solutions on AWS
• Develop batch and Realtime ingestion frameworks from multiple source systems
• Implement data transformation enrichment cleansing and validation processes
• Optimize Spark workloads for performance scalability and cost efficiency
• Design and implement data models supporting reporting analytics and downstream applications
• Integrate Databricks with AWS services including S3 Glue Lambda Redshift EventBridge and IAM
• Support data migration and modernization initiatives from traditional data warehouses to Databricks Lakehouse
• Implement CICD pipelines and Infrastructure as Code IaC using Terraform and Gitbased repositories
• Collaborate with security teams to ensure compliance with client governance risk and data security standards
• Troubleshoot production incidents and provide L3 operational support
• Participate in architecture reviews code reviews and technical governance activities

Skills

• Databricks
• Databricks Lakehouse Architecture
• Databricks Workflows
• Delta Lake
• Unity Catalog
• Databricks SQL
• Auto Loader
• Structured Streaming
• Databricks Performance Tuning
• Medallion Architecture
• AWS
• Amazon S3
• AWS Glue
• AWS Lambda
• AWS IAM
• Amazon Redshift
• AWS CloudWatch
• SNS SQS
• Event Bridge
• KMS
• Secrets Manager
• Data Engineering
• Pyspark
• Apache Spark
• Python
• SQL
• Data Warehousing Concepts
• ETLELT Design
• Data Modeling
• Data Quality Frameworks
• Batch RealTime Processing
• Bachelors or Masters degree in Computer Science Engineering Information Systems or related discipline
• Snowflake
• Microsoft Fabric
• GCP Big Query
• Kafka
• Airflow
• Dbt
• Terraform
• Docker
• Kubernetes OpenShift
• Informatica
• Collibra
• Data Vault Modeling
• Dimensional Data Modeling
• Banking Domain Experience
• Strong experience within Banking and Financial Services
• Understanding of enterprise data governance regulatory reporting risk compliance and audit requirements
• Experience working in large global organizations with stringent security and operational standards
• Databricks Certified Data Engineer
• AWS Certified Data Analytics or AWS Solution Architect

Company Overview

Company H1B Sponsorship