{"id":1900491,"url":"https://alion.io/job/the-vanguard-group-data-engineer-specialist-4","title":"Data Engineer, Specialist","company":{"id":253,"name":"The Vanguard Group","domain":"vanguard.com","url":"https://alion.io/company/vanguard","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":80,"open_postings":70,"ghost_share":0.057,"stale_share":0.571,"repost_share":0.157,"time_to_fill_p50_days":27,"computed_at":"2026-10-19T05:45:15Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["Hyderabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":23000,"max_usd":46000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":59},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"AWS Lambda","optional":false},{"name":"AWS Step Functions","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"Incident Management","optional":false},{"name":"PagerDuty","optional":false},{"name":"Pandas","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Delta Lake","optional":true},{"name":"IAM","optional":true}],"status":"closed","first_seen_at":"2026-10-05T10:42:16Z","employer_posted_date":"2026-10-14","last_verified_at":"2026-10-19T04:01:09Z","board_verified":false,"closed_at":"2026-10-19T04:01:09Z","days_open":13,"trust":{"level":"ok","repost_count":1,"flags":[],"days_open":12},"description":"About Vanguard\nFounded in 1975, Vanguard is one of the world's leading investment management companies. The firm offers investments, advice, and retirement services to tens of millions of individual investors around the globe-directly, through workplace plans, and through financial intermediaries.\nVanguard India\nVanguard’s office in India is a significant milestone in our global expansion. We are committed to establishing an enduring technology center in Hyderabad, Telangana and are excited to be adding talent who will focus on Artificial Intelligence (AI), mobile, and cloud-based technologies that drive our business outcomes and deliver a world-class experience for our clients.\nResponsibilities:\nBuild and operate production data pipelines on AWS - Glue (PySpark), Step Functions, Lambda, Athena, SNS, and S3 - from ingestion through transformation to reconciled, reportable output.\nOwn operational support for production data pipelines, including monitoring, incident management, PagerDuty response, root cause analysis, and driving timely resolution of production issues while continuously improving platform reliability and observability.\nDevelop and refactor transformation logic in PySpark, including migrating legacy Pandas/SQL logic and performance-tuning large-scale Spark jobs.\nImplement data reconciliation and sign-off - design recon checks (including parity between old and new implementations), investigate discrepancies to root cause, and produce the evidence the business needs to trust a run.\nTranslate complex business and financial logic (asset classification, valuation and pricing rules, methodology calculations) into correct, testable, well-documented code.\nTake features through production readiness - pre-checks, access/role setup, environment promotion, and clear runbooks for ongoing support.\n Contribute to our cloud lakehouse migration - modelling refined tables, building repeatable ETL, and lifting reporting workloads onto a modern Delta/Databricks platform.\nKeep running pipelines healthy - monitor scheduled jobs, triage failures (partitioning, schema/data-type issues, backfills), and keep periodic (month-end / quarter-end) processing on time.\nWhat we're looking for\nMust have\n5+ years in data engineering with strong Python and SQL.\nHands-on PySpark / Spark for large-scale data transformation, including debugging and performance tuning.\nProduction experience with AWS data services - Glue, Athena, S3, Lambda, Step Functions (or close equivalents on another major cloud).\nSolid data modelling skills and a rigorous, reconciliation-first approach to data quality.\nAbility to read a business or technical specification and turn it into correct, maintainable pipeline logic.\nComfortable with Git-based workflows, CI/CD, and infrastructure-as-code.\nNice to have\nDatabricks / lakehouse (Delta Lake) experience.\nBackground in financial services - custody, fund accounting, unit pricing, or regulatory/financial reporting.\nExperience with access governance and IAM (e.g. role provisioning) and writing operational runbooks.\nTrack record migrating legacy reporting or ETL onto modern cloud data platforms.\nLocation\nThis role is based in Hyderabad, Telangana at Vanguard India. Only qualified external applicants will be considered.\nOur mission\nVanguard adheres to a simple purpose: To take a stand for all investors, to treat them fairly, and to give them the best chance for investment success.\nOur commitment to you\nVanguard takes the same long-term view of your success-at work and in life-with Benefits and Rewards packages that reflect what you care about, throughout all the phases and stages of your life. Our Total Rewards programs provide you and your loved ones with wellness support for key areas in your life:\nFinancial wellness\nWe're committed to enabling your financial success and provide competitive offers and programs.\nPhysical wellness\nWe're committed to providing benefits that support your physical health and wellness.\nPersonal wellness\nWe're committed to providing resources that help support the full scope of your life.\nHow we work\nVanguard has implemented a hybrid working model for most of our employees (crew members), designed to capture the benefits of enhanced flexibility while enabling in-person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.","description_format":"text","description_chars":4467,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":false,"languages":[]},"benefits":["Hybrid work"],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Wealth Management & Financial Advisors","Asset Management & Funds","Online Brokerage & Trading Platforms"],"lifecycle":[{"event":"open","at":"2026-10-05T10:42:16Z"},{"event":"close","at":"2026-10-10T09:11:22Z"},{"event":"reopen","at":"2026-10-14T14:59:32Z"},{"event":"close","at":"2026-10-19T04:01:09Z"}],"visa":[],"liveness":null,"pay":null,"html_url":"https://alion.io/job/the-vanguard-group-data-engineer-specialist-4","json_url":"https://alion.io/job/the-vanguard-group-data-engineer-specialist-4.json","meta":{"generated_at":"2026-10-19T14:38:27Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":10668,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":253},"rest":"https://alion.io/mcp/rest/get_company?id=253"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fthe-vanguard-group-data-engineer-specialist-4"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fthe-vanguard-group-data-engineer-specialist-4"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fthe-vanguard-group-data-engineer-specialist-4"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/the-vanguard-group-data-engineer-specialist-4\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fthe-vanguard-group-data-engineer-specialist-4"}]}