{"id":3681112,"url":"https://alion.io/job/citi-senior-data-engineer-2","title":"Senior Data Engineer","company":{"id":7841,"name":"Citi","domain":"citi.com","url":"https://alion.io/company/citi","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":98,"open_postings":557,"ghost_share":0.009,"stale_share":0.206,"repost_share":0.068,"time_to_fill_p50_days":9,"computed_at":"2026-11-07T05:47:08Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Chennai, India","Pune, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Hadoop","optional":false},{"name":"Platform Engineering","optional":false},{"name":"pySpark","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Python","optional":true}],"status":"live","first_seen_at":"2026-11-03T13:09:23Z","employer_posted_date":"2026-11-03","last_verified_at":"2026-11-07T23:17:40Z","board_verified":true,"closed_at":null,"days_open":4,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":4},"description":"We are looking for a highly skilled Senior Data Engineer to contribute to the engineering, modernization, and continuous evolution of data processing platform on Databricks on AWS. While supporting the transition from the legacy Cloudera Hadoop platform to Databricks on AWS, this role will continue to play a key part in enhancing performance, simplifying pipelines, and delivering new capabilities on the Databricks platform over the long term.\nThe ideal candidate is a strong hands-on Spark engineer with solid design experience, capable of contributing to architectural decisions while leading complex implementation and optimization efforts.\nResponsibilities:\n1. Platform Engineering & Modernization\nRefactor and modernize existing Spark pipelines to Databricks native architectures\nEliminate legacy Hadoop dependencies and adopt cloud native AWS patterns\nEnhance and extend existing processing logic using optimized Spark (ScalaSpark) on Databricks\n2. Databricks Native Development\nBuild and optimize solutions using Databricks features, including Delta Lake, Databricks Workflows for orchestration and Auto scaling and job clusters\n3. Design & Solution Engineering\nContribute to low and mid level architecture and design\nTranslate high level architecture into detailed technical designs\nDefine data models, pipeline patterns, and reusable components\nEnsure solutions are scalable, maintainable, and production ready\n4. Performance Optimization & Simplification\nAnalyze, improve Spark job performance and simplify complex or over engineered pipelines into standardized, efficient patterns\n5. Engineering Standards & Best Practices\nFollow and contribute to Databricks and Spark engineering standards\nWrite clean, modular, and testable code\nContribute to shared frameworks, reusable libraries, and quality standards\n6. Collaboration & Stakeholder Engagement\nWork closely with senior architects, platform teams, and DevOps engineers\nProvide technical inputs, troubleshooting support, and implementation guidance\nParticipate in design discussions and technical decision making\n7. Testing & Quality Assurance\nDevelop unit, integration, and data validation tests\nSupport production releases and post deployment validation\nQualifications:\nCore Technical Skills:\n8+ years in data engineering or distributed systems\nStrong expertise in Apache Spark (ScalaSpark/ JavaSpark / PySpark), Databricks on AWS, and Delta Lake\nExperience on SQL\nExperience with AWS services and large-scale distributed data processing\nModernization & Optimization Experience\nExperience modernizing or refactoring legacy data platforms into cloud-based architectures\nStrong background in Spark performance tuning and large-scale batch optimization\nDesign Capability\nAbility to translate architecture into implementable designs\nUnderstanding of data modeling and pipeline orchestration patterns\nBehavioral Competencies\nStrong problem-solving mindset for complex distributed systems\nComfortable working in time-bound, high-impact environments\nProactive, accountable, and collaborative\nClear communication skills across global teams\nEducation:\nBachelor’s degree/University degree and equivalent experience\n------------------------------------------------------\nJob Family Group:\nTechnology------------------------------------------------------\nJob Family:\nApplications Development------------------------------------------------------\nTime Type:\nFull time------------------------------------------------------\nMost Relevant Skills\nPlease see the requirements listed above.------------------------------------------------------\nOther Relevant Skills\nFor complementary skills, please see above and/or contact the recruiter.------------------------------------------------------\nCiti is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.\nIf you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.\nView Citi’s EEO Policy Statement and the Know Your Rights poster.","description_format":"text","description_chars":4260,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Cards & Card Issuing","Wealth Management & Financial Advisors","Payment Processing & Gateways","Investment Banking & M&A Advisory"],"lifecycle":[{"event":"open","at":"2026-11-03T13:09:23Z"}],"visa":[],"liveness":{"score":81,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.899,"p_room":0.9,"age_days":3,"expected_fill_days":9,"reasons":["conf:3","velocity","win:mid","comp:brand"],"computed_at":"2026-11-07T05:47:08Z"},"pay":null,"html_url":"https://alion.io/job/citi-senior-data-engineer-2","json_url":"https://alion.io/job/citi-senior-data-engineer-2.json","meta":{"generated_at":"2026-11-08T01:21:05Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2937,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-09T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":7841},"rest":"https://alion.io/mcp/rest/get_company?id=7841"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fciti-senior-data-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fciti-senior-data-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fciti-senior-data-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/citi-senior-data-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fciti-senior-data-engineer-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3681112}},{"tool":"search_jobs","arguments":{"company":"citi.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3681112},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}