{"id":3387306,"url":"https://alion.io/job/ust-lead-i-data-engineering-4","title":"Lead I - Data Engineering","company":{"id":1774626,"name":"UST","domain":"ust.com","url":"https://alion.io/company/ust-com","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"RippleHire","truth_index":{"grade":"B","score":75,"open_postings":105,"ghost_share":0,"stale_share":0.99,"repost_share":0,"time_to_fill_p50_days":34,"computed_at":"2026-10-29T05:49:05Z"}},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":23000,"max_usd":50000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":20},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Airflow","optional":false},{"name":"Amazon Aurora","optional":false},{"name":"Amazon EC2","optional":false},{"name":"Amazon ECS","optional":false},{"name":"Amazon EKS","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"API Gateway","optional":false},{"name":"AWS","optional":false},{"name":"AWS Lambda","optional":false},{"name":"AWS Step Functions","optional":false},{"name":"DynamoDB","optional":false},{"name":"Hadoop","optional":false},{"name":"Linux","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Scrum","optional":false},{"name":"Spark","optional":false},{"name":"Bitbucket","optional":true},{"name":"CI/CD","optional":true},{"name":"Copilot","optional":true},{"name":"Cursor","optional":true},{"name":"Databricks","optional":true},{"name":"Docker","optional":true},{"name":"Git","optional":true},{"name":"GitHub","optional":true},{"name":"GitLab","optional":true},{"name":"Gradle","optional":true},{"name":"Java","optional":true},{"name":"Jenkins","optional":true},{"name":"Kubernetes","optional":true},{"name":"RAG","optional":true}],"status":"live","first_seen_at":"2026-10-22T00:00:00Z","employer_posted_date":"2026-10-28","last_verified_at":"2026-10-29T19:14:03Z","board_verified":true,"closed_at":null,"days_open":7,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":7},"description":".\nWho we are:\nAt UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact-touching billions of lives in the process. Visit us at UST.com.\nSummary:\nwe have a opening for big data developer.\nRoles and Responsibilities:\n1.Design, develop, test, and deploy scalable Big Data solutions on AWS Cloud.\n2. Build and maintain batch and streaming data pipelines using Scala, Python, Spark, and PySpark.\n3. Analyze, process, and transform large volumes of structured and unstructured data.\n4. Develop and support distributed data processing frameworks and data ingestion platforms.\n5. Integrate new data sources and tools into existing big data ecosystems. 6. Optimize performance of Spark, Hadoop, EMR, and distributed computing workloads.\n7. Design and implement cloud-native APIs and microservices supporting data products and operational platforms.\n8. Collaborate with product owners, architects, QA teams, and business stakeholders throughout the software development lifecycle.\n9. Automate data workflows, deployments, monitoring, and operational processes.\n10. Evaluate emerging Big Data, AI, and cloud technologies and prototype innovative solutions.\n11. Ensure adherence to security, governance, reliability, and software engineering best practices.\nRequired Qualifications\n1. Bachelor's degree in Computer Science, Computer Engineering, Information Technology, or equivalent experience.\n2. 5-8 years of experience in software engineering and Big Data application development.\n3. Strong hands-on experience with: Scala Python Apache Spark / PySpark Hadoop ecosystem (HDFS, MapReduce, Hive) Kafka or similar event-streaming technologies\n4. Strong AWS experience with services such as: EMR S3 EC2 ECS/EKS Airflow (MWAA preferred) Step Functions API Gateway Lambda DynamoDB and/or Aurora/RDS\n5. Experience building and supporting large-scale batch and API-based data processing solutions in AWS.\n6. Strong Linux and shell scripting skills.\n7. Experience with data ingestion, transformation, data modeling, schema design, and data lifecycle management.\n8. Strong understanding of performance tuning for Spark, Hadoop, EMR, and distributed systems.\n9.. Experience with Agile/Scrum development methodologies.\n10. Understanding of secure software development practices and cloud security fundamentals.\n11. Strong analytical, troubleshooting, and problem-solving skills.\n12. Excellent written and verbal communication skills.\nPreferred Qualifications\n1. Experience with Generative AI, AI-assisted development tools (GitHub Copilot, Amazon Q, Cursor, etc.), and AI-driven automation.\n2. Understanding of Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Vector Databases, and AI/ML solution integration.\n3. Experience building AI-enabled data platforms and data pipelines supporting ML workloads.\n4. Experience with DevOps and CI/CD tools such as Git, GitHub, GitLab, Bitbucket, Jenkins, Maven, Gradle, and Artifactory.\n5. Experience with containerization technologies such as Docker and Kubernetes.\n6. Knowledge of automated testing frameworks and data quality validation tools.\n7. Experience working in enterprise-scale cloud environments.\n8. AWS certification(s) and/or Databricks certification(s) are a plus.\nWhat we believe:\nWe’re proud to embrace the same values that have shaped UST since the beginning. Since day one, we’ve been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion and to place people at the centre of everything we do.\nHumility:\nWe will listen, learn, be empathetic and help selflessly in our interactions with everyone.\nHumanity:\nThrough business, we will better the lives of those less fortunate than ourselves.\nIntegrity:\nWe honour our commitments and act with responsibility in all our relationships.\nEqual Employment Opportunity Statement\nUST is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation.\nAll employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.\nUST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.\nTo support and promote the values of UST.\nComply with all Company policies and procedures","description_format":"text","description_chars":4939,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Information Technology","IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams"],"lifecycle":[{"event":"open","at":"2026-10-28T08:16:12Z"}],"visa":[],"liveness":{"score":68,"band":"ok","label":"Likely open","p_open":1,"p_active":0.683,"p_room":1,"age_days":7,"expected_fill_days":34,"reasons":["conf:0","stale_co","wave","velocity","win:early","comp:brand"],"computed_at":"2026-10-29T05:49:05Z"},"pay":null,"html_url":"https://alion.io/job/ust-lead-i-data-engineering-4","json_url":"https://alion.io/job/ust-lead-i-data-engineering-4.json","meta":{"generated_at":"2026-10-29T21:58:36Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":32418,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1774626},"rest":"https://alion.io/mcp/rest/get_company?id=1774626"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fust-lead-i-data-engineering-4"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fust-lead-i-data-engineering-4"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fust-lead-i-data-engineering-4"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ust-lead-i-data-engineering-4\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fust-lead-i-data-engineering-4"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3387306}},{"tool":"search_jobs","arguments":{"company":"ust.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3387306},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}