{"id":4456842,"url":"https://alion.io/job/ust-lead-ii-data-engineering-7","title":"Lead II - Data Engineering","company":{"id":1774626,"name":"UST","domain":"ust.com","url":"https://alion.io/company/ust-com","size_band":"5000+","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"RippleHire","truth_index":{"grade":"B","score":76,"open_postings":105,"ghost_share":0,"stale_share":0.971,"repost_share":0,"time_to_fill_p50_days":33,"computed_at":"2026-11-17T05:47:56Z"}},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Hyderabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"pySpark","optional":false},{"name":"Scala","optional":false},{"name":"SQL","optional":false},{"name":"Agile","optional":true},{"name":"CI/CD","optional":true},{"name":"Dimensional Modeling","optional":true},{"name":"GCP","optional":true},{"name":"Git","optional":true},{"name":"Power BI","optional":true},{"name":"Python","optional":true},{"name":"Spark","optional":true},{"name":"SSIS","optional":true}],"status":"live","first_seen_at":"2026-11-11T00:00:00Z","employer_posted_date":"2026-11-17","last_verified_at":"2026-11-17T22:07:57Z","board_verified":true,"closed_at":null,"days_open":7,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":7},"description":"Who we are:\nAt UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact-touching billions of lives in the process. Visit us at UST.com.\nSummary:\nWe are looking for an experienced Senior Data Engineer with 8-12 years of experience in designing, developing, and delivering scalable enterprise data solutions. The candidate should have strong hands-on expertise in Databricks, PySpark, AWS, Scala, ETL, SQL, and Data Warehousing, along with the ability to provide technical leadership and drive end-to-end data engineering solutions.\nMandatory Skills\nDatabricks PySpark AWS Scala ETL / ELT SQL Data Warehousing Optional / Good-to-Have Skills\nPower BI SSIS Data Governance GCP\nKey Responsibilities\nLead the design and development of scalable enterprise data platforms using Databricks, PySpark, Scala, SQL, and AWS.\nDesign and implement robust ETL/ELT pipelines for high-volume structured and semi-structured datasets.\nDefine technical solutions and contribute to Data Lake, Lakehouse, and Data Warehouse architecture.\nArchitect reusable data ingestion, transformation, validation, orchestration, and processing frameworks.\nDrive performance optimization of Spark workloads, Databricks jobs, SQL queries, and data pipelines.\nDesign effective data models, including dimensional models, data marts, and analytical data structures. Implement best practices for data quality, security, governance, lineage, monitoring, and observability.\nConduct technical reviews, code reviews, and solution/design reviews. Provide technical leadership and mentor junior and mid-level Data Engineers.\nCollaborate with architects, product owners, business analysts, BI teams, and other stakeholders to translate business requirements into scalable technical solutions.\nDrive engineering best practices around CI/CD, automated testing, Git/version control, deployment, and production support.\nTroubleshoot complex production issues and lead root-cause analysis and resolution.\nEvaluate technical approaches and recommend improvements for scalability, reliability, maintainability, and cost optimization.\nTake ownership of technical deliverables and ensure solutions meet agreed quality and performance standards.\nRequired Qualifications\n8-12 years of overall experience in Data Engineering, Data Warehousing, or related areas.\nStrong hands-on experience with Databricks, Apache Spark, PySpark, and Scala.\nStrong expertise in SQL, including complex query development and performance tuning.\nStrong experience designing and developing ETL/ELT pipelines.\nHands-on experience with AWS-based data engineering solutions and cloud data platforms.\nStrong understanding of Data Warehousing, dimensional modeling, Data Lakes, and Lakehouse architecture.\nExperience designing scalable data processing solutions for large datasets. Good understanding of Spark optimization, partitioning, distributed processing, and performance tuning.\nStrong understanding of data quality, security, lineage, and governance principles.\nExperience with Agile delivery, Git, CI/CD, automated testing, deployment, and production support.\nAbility to provide technical leadership, perform design/code reviews, and mentor engineering teams.\nStrong analytical, troubleshooting, stakeholder management, and communication skills.\nPreferred Qualifications\nPower BI for data visualization and analytical reporting. SSIS for ETL and legacy data integration.\nExperience with Data Governance, metadata management, lineage, and data quality frameworks.\nExposure to GCP and multi-cloud data engineering solutions.\nWhat we believe:\nWe’re proud to embrace the same values that have shaped UST since the beginning. Since day one, we’ve been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion and to place people at the centre of everything we do.\nHumility:\nWe will listen, learn, be empathetic and help selflessly in our interactions with everyone.\nHumanity:\nThrough business, we will better the lives of those less fortunate than ourselves.\nIntegrity:\nWe honour our commitments and act with responsibility in all our relationships.\nEqual Employment Opportunity Statement\nUST is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation.\nAll employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.\nUST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.\nTo support and promote the values of UST.\nComply with all Company policies and procedures","description_format":"text","description_chars":5263,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams"],"lifecycle":[{"event":"open","at":"2026-11-17T12:19:11Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":7,"expected_fill_days":33,"reasons":["conf:3","win:early","comp:brand"],"computed_at":"2026-11-18T01:22:45Z"},"pay":null,"html_url":"https://alion.io/job/ust-lead-ii-data-engineering-7","json_url":"https://alion.io/job/ust-lead-ii-data-engineering-7.json","meta":{"generated_at":"2026-11-18T01:22:45Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2626,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1774626},"rest":"https://alion.io/mcp/rest/get_company?id=1774626"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fust-lead-ii-data-engineering-7"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fust-lead-ii-data-engineering-7"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fust-lead-ii-data-engineering-7"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ust-lead-ii-data-engineering-7\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fust-lead-ii-data-engineering-7"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4456842}},{"tool":"search_jobs","arguments":{"company":"ust.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4456842},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}