Location
In office (Pune)
Seniority
Staff
Confirmed on the employer's own hiring board on Nov 18, 2026. First seen by Alion on Nov 16, 2026. UST scores B on the Alion truth index.
Overview
Company
Impact
Profile match
UST is an American IT services and digital transformation company headquartered in Aliso Viejo, California. Founded in 1999 by Stephen Ross as UST Global, it provides software engineering, cloud and infrastructure services, cybersecurity, data and AI, and business process services to large enterprises in healthcare, retail, banking and other industries. It employs about 30,000 people, with large delivery centres in Thiruvananthapuram, Kochi, Bengaluru, Chennai and Hyderabad.
Required skills for Senior Data Engineer (Azure Databricks)
- Spark and PySpark
- 5+ years building batch and/or streaming pipelines with Spark
- Deep understanding of Spark fundamentals: lazy evaluation, transformations vs. actions, parti tions, shuffles, joins, and caching
- (Nice to have) Performance tuning: broadcast joins, AQE, skew mitigation, shuffle optimization
- (Nice to have) Structured Streaming and Auto Loader for incremental ingestion
- Databricks platform on Azure
- Unity Catalog: catalogs/schemas/tables, permissions, external locations, storage credentials, lineage
- Databricks Jobs/Workflows: task orchestration, cluster policies, retries, parameters
- Git integration (Repos), CI/CD, and environment promotion
- (Nice to have) Declarative pipelines with Delta Live Tables (DLT): expectations, CDC, quality rules, event logs
- Cloud storage and access (Azure)
- Secret management via Databricks secret scopes and Key Vault integration
- (Nice to have) ADLS Gen2: ABFS access, ACLs vs. RBAC, mounts vs. direct access, OAuth/ service principals/managed identity
- Delta Lake
- ACID transactions, time travel, MERGE/UPDATE/DELETE
- Schema enforcement and evolution
- (Nice to have) OPTIMIZE, ZORDER, VACUUM and retention policies
- (Nice to have) Compaction and smallfiles mitigation strategies
- SQL and data querying
- Complex SQL with CTEs and window functions
- (Nice to have) Query optimization and execution plan analysis in Databricks SQL
- Data modeling and architecture
- Medallion (bronze/silver/gold) patterns for data lakes
- Partitioning and file layout to match read patterns
- Designing tables for CDC and incremental processing
- (Nice to have) Lakehouse design tradeoffs and table constraints
- Largescale data processing
- Cluster sizing, autoscaling, and cost optimization (spot, pools)
- Observability: Spark UI, metrics, event logs, Delta logs
- (Nice to have) Handling TBscale datasets, throughput vs. latency tradeoffs
- Governance, security, and compliance
- (Nice to have) Privilege model in Unity Catalog; table, row, and columnlevel security patterns
- (Nice to have) PII handling, masking/anonymization, auditability, lineage
- Software engineering practices
- Python packaging, code quality, testing (pytest, chispa), code reviews
- CI/CD for Databricks (Repos, asset bundles/wheels), artifact versioning
- Documentation and stakeholder communication
- Nice to have (optional)
- Scala, dbt, Kafka/Event Hubs, ADF/Airflow, Terraform, Power BI, data mesh concepts, SCD patterns
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,365,226 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Free forever. No card. Under a minute.
Your match
How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.
Recommended for you based on this role
Data Science
Similar stack
Same company
Pune
Data Referral
1 hour ago
In office · 10+ years exp · Pune
Python
SQL
Databases
Snowflake
Databricks
Google BigQuery
AI/ML
Vertex AI
DevOps
GCP
CI/CD
IAM
Cybersecurity
GDPR
Analytics
ETL/ELT
Management
Agile
Apply
Senior Data Architect
1 hour ago
In office · Full-Time · 10+ years exp · Bengaluru
Python
SQL
Python
pySpark
Databases
MySQL
PostgreSQL
AI/ML
Spark
Analytics
ETL/ELT
Apply
Technical Delivery Lead - AI & Data Engineering
2 hours ago
Hybrid · 12+ years exp · Bengaluru · Hyderabad · Gurgaon · Mumbai
Python
SQL
Databases
Snowflake
AI/ML
LangGraph
LangChain
dbt
AI Agents
LangSmith
AWS Bedrock
RAG
AWS Bedrock AgentCore
Knowledge Graph
LLM Guardrails
DevOps
CI/CD
AWS
AWS Lambda
Incident Management
AWS Step Functions
Analytics
ETL/ELT
Informatica
Apply
Hybrid · 12+ years exp · Bengaluru · Gurgaon · Hyderabad · Mumbai
Python
Databases
Snowflake
AI/ML
LangGraph
LangChain
dbt
AI Agents
LangSmith
AWS Bedrock
RAG
AWS Bedrock AgentCore
Knowledge Graph
LLM Guardrails
DevOps
CI/CD
AWS
AWS Lambda
Incident Management
AWS Step Functions
Analytics
ETL/ELT
Informatica
Apply
Technology Data Architect, AVP
2 hours ago
In office · Full-Time · Bachelor's Degree · Bengaluru
SQL
DevOps
Incident Management
Analytics
Tableau
Power BI
ETL/ELT
SAP BusinessObjects
Management
ServiceNow
ITSM
Apply
Data Architect
1 day ago
In office · 15+ years exp · Pune
Python
SQL
Databases
Snowflake
Databricks
Apache Kafka
Google BigQuery
AI/ML
MLFlow
TensorFlow
PyTorch
Amazon SageMaker
DevOps
GCP
Azure
AWS
Analytics
Tableau
Power BI
Informatica
Azure Data Factory
Looker
Apply
Apply
In office · Contractor · 5+ years exp · Pune
Python
SQL
Databases
Google BigQuery
AI/ML
AI Agents
Analytics
Power BI
ETL/ELT
Looker
Apply
Software Engineer II
1 day ago
Hybrid · Full-Time · 2+ years exp · Pune
Python
JavaScript
Java
TypeScript
SQL
Java
Maven
Gradle
Databases
MySQL
Frontend
Angular
Bootstrap
Mobile
JUnit
DevOps
GCP
Azure
CI/CD
Git
AWS
GitHub
Management
Confluence
Agile
Scrum
QA
Selenium
SoapUI
Apply
Senior AI Software Engineer
1 day ago
≈ $15k – $34k per year (Estimated) · Hybrid · Part-Time · 5+ years exp · Bachelor's Degree · Hyderabad · Pune
Python
Java
Databases
Snowflake
Databricks
AI/ML
AutoGen
LangChain
LlamaIndex
Embeddings
Prompt Engineering
AI Agents
Semantic Kernel
AWS Bedrock
CrewAI
RAG
OpenAI
Anthropic
Semantic Search
Machine Learning
DevOps
Rest API
Azure DevOps
Azure
CI/CD
AWS
GitHub
Apply
This is one of many
2,365,226 more open roles from verified company boards, updated every day.

