Data Engineer

UST is a mission-driven technology company that creates transformative experiences and human-centered solutions for clients and partners. The Lead II - Data Engineering role focuses on designing, developing, and supporting scalable data pipelines and enterprise data platforms using GCP, Airflow, Java/Spark, and SQL. The position also involves optimizing data processing, ensuring data quality and governance, and collaborating with analysts, scientists, and application teams.

Responsibilities

• Develop reusable data processing frameworks and components ensuring data quality, consistency, and reliability across data platforms. o high-volume data integration and migration initiatives
• Optimize Spark jobs for performance, scalability, and cost efficiency
• Code reviews, testing, deployment, and production support activities of monitoring & troubleshooting airflow workflow and production pipelines
• Should have experience in query performance through indexing, portioning and data model optimization
• Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources into data warehouses and data lakes
• Build and optimize data solutions using SQL, Python, Spark, and cloud technologies such as Azure, AWS, or GCP
• Develop and manage data integration workflows using tools like Azure Data Factory, Databricks, Airflow, or Informatica
• Ensure data quality, integrity, security, and governance through validation, monitoring, and compliance best practices
• Collaborate with business stakeholders, data analysts, and data scientists to deliver reliable, analytics-ready datasets
• Monitor, troubleshoot, and optimize data pipelines and database performance to support high-volume data processing and reporting requirements
• The role is expected to Work closely with business analysts, data scientists, and application teams across the globe with a mix of associates and suppliers

Skills

• UST is looking for a skilled Data Engineer with 6+ years of experience in designing, developing, and supporting scalable data pipelines and enterprise data platforms
• The ideal candidate will have strong expertise in Google Cloud Platform (GCP), Apache Airflow DAGs, Java/Spark development, and SQL-based data engineering to support large-scale analytics and data transformation initiatives
• Experience range: 7-10 Years
• Mandatory: BigQuery, Apache Airflow, Spark/Java/ PySpark
• Should have 6+ years of experience in Data Engineering with demonstrated hands on experience of 4+ years of experience in Design, develop, and maintain scalable data pipelines on Google Cloud Platform (GCP 3+ years of recent experience in Develop, schedule, and manage workflows using Apache Airflow DAGs
• 3+ years of experience in Build and optimize batch and streaming data processing solutions using Java and Apache Spark
• 4+ years of experience with writing complex and optimized SQL queries for data extraction, transformation and reporting
• Should have Implement ETL/ELT processes for ingesting, transforming, and loading large-scale datasets
• Nice to have: GCP, GCS, Relational Databases Data Modeling, Kafka , Terraform

Benefits

• Full-time, regular employees accrue a minimum of 10 days of paid vacation per year.
• Full-time, regular employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
• Full-time, regular employees receive 10 paid holidays.
• Full-time, regular employees are eligible for paid bereavement leave and jury duty.
• Full-time, regular employees are eligible to participate in the Company’s 401(k) Retirement Plan with employer matching.
• Full-time, regular employees and their dependents residing in the US are eligible for medical, dental, and vision insurance.
• Full-time, regular employees receive Company-paid basic life insurance, accidental death and disability insurance, and short- and long-term disability benefits for employees only.
• Regular employees may purchase additional voluntary short-term disability benefits.
• Regular employees may participate in a Health Savings Account (HSA) and a Flexible Spending Account (FSA) for healthcare, dependent child care, and/or commuting expenses as allowable under IRS guidelines.
• Part-time employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
• Part-time employees are eligible to participate in the Company’s 401(k) Retirement Plan with employer matching.
• Full-time temporary employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
• Full-time temporary employees are eligible to participate in the Company’s 401(k) program with employer matching.
• Full-time temporary employees and their dependents residing in the US are eligible for medical, dental, and vision insurance.
• Part-time temporary employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
• All US employees who work in a state or locality with more generous paid sick leave benefits than specified here will receive the benefit of those sick leave laws.

Company Overview