{"id":2789912,"url":"https://alion.io/job/flair-labs-senior-data-engineer-financial-services","title":"Senior Data Engineer – Financial Services","company":{"id":4442683,"name":"Flair Labs","domain":"flairlabs.com","url":"https://alion.io/company/flair-labs-2","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Keka","truth_index":{"grade":"D","score":40,"open_postings":10,"ghost_share":1,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-23T05:54:15Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Mumbai, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":21000,"max_usd":42000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":71},"experience_years_min":15,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon Kinesis","optional":false},{"name":"Apache Hudi","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Flink","optional":false},{"name":"GitHub Actions","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"Terraform","optional":false},{"name":"Machine Learning","optional":true}],"status":"live","first_seen_at":"2025-11-03T10:49:51Z","employer_posted_date":"2025-11-03","last_verified_at":"2026-10-23T06:46:53Z","board_verified":true,"closed_at":null,"days_open":353,"trust":{"level":"ghost","repost_count":0,"flags":["stale","company_stale"],"days_open":353},"description":"Job Title: Senior Data Engineer - Financial Services (Data Lakehouse & Real-Time Systems)\nAbout the Role\nWe are seeking seasoned Data Engineering and architecture leaders to architect and deliver a next-generation data lake/house platform for a leading financial services client. This engagement will involve thorough data architecture and engineering components, analysis of complex data and its ecosystem and integrating real-time trade, crypto, securities and fixed income data, analytics, and risk systems for various use-cases. The ideal candidate combines deep domain experience in retail brokerage with hands-on expertise in AWS, MS- Azure Databricks, Spark, and modern data lake/house architectures, and can balance delivery under pressure with architectural foresight and team mentorship. This role requires a deep skill-set in real-time architectural systems and pipelines, adept with financial services specifically, investment domain and a hands-on engineer with a knack of innovative insight on integration of various data architecture/s within the cloud ecosystem.\nKey Responsibilities\nArchitect and lead the design, implementation, and optimization of large-scale data lake/house systems on Azure Databricks using Spark, Delta Lake, and Python. (advanced)\nBuild and optimize streaming pipelines for real-time ingestion, processing, and analytics of trade and market data across asset classes (FX, equities, futures, options, bonds, and crypto). (intermediate)\nCollaborate closely with the CTO and data architects to evolve the end-to-end application architecture for scalability, resilience, and low-latency performance. (advanced)\nMentor and guide junior and mid-level engineers, establishing best practices in data modelling, orchestration, and operational monitoring.\nEnsure data integrity, lineage, and governance within regulatory and compliance frameworks. (advanced)\nPartner cross-functionally with business and technology teams to align data infrastructure with business KPIs and capital markets product goals.\nDrive automation and CI/CD for data pipelines using Terraform, GitHub Actions, and cloud-native DevOps practices. (advanced)\nDeliver under tight timelines, managing sprint-level execution and ensuring production readiness within a short time-line for GO-LIVE.\nRequired Skills and Qualifications:\n15+ years of professional experience, with at least 10 years in financial services and 8+ years in data engineering leadership roles.\nProven track record building real-time, high-throughput data platforms at enterprise scale.\nStrong proficiency in Azure Databricks, Apache Spark, and Python (PySpark, Panda).\nSolid experience with streaming technologies (Kafka, Kinesis, Event Hubs, or Flink).\nDeep understanding of data lake/house design principles (Cloud Engineering and architecture, AWS, Delta Lake, Iceberg, or Hudi) and data modelling for analytics and ML pipelines.\nStrong background in retail brokerage and trading systems, including exposure to FX, equities, futures, options, bonds, and crypto.\nExperience building or integrating risk management systems, trade surveillance, or crypto exchanges.\nPractical knowledge of data governance, lineage, and metadata management tools (e.g., Azure Purview).\nProven ability to design scalable, cost-efficient pipelines on Azure using Data Factory, Synapse, and related services.\nExcellent communication, collaboration, and documentation skills, with the ability to influence senior stakeholders.\nPreferred Qualifications\nExperience working with microservices-based or event-driven architectures supporting capital markets workloads.\nFamiliarity with machine learning pipelines for predictive risk and trading analytics.\nExposure to Shopify-like multi-tenant or marketplace data architectures.\nCloud certifications: Microsoft Certified: Azure Data Engineer Associate or equivalent.\nPrevious experience in start-up or fast-paced delivery environments with adaptability and velocity.\nCore Attributes\nStrong sense of ownership, reliability, and confidentiality in managing critical financial data.\nAbility to balance delivery urgency with architectural integrity.\nA collaborative mentor who uplifts engineering standards across the team.\nStrategic mindset with hands-on execution capability.\nEngagement Details\nNumber of Positions: 3\nLocation: Mumbai\nEngagement Type: Full-Time / Contract-to-Hire\nTimeline: Immediate start; production launch targeted for January\nReports To: Engagement Lead in conjunction with Client CTO.","description_format":"text","description_chars":4497,"description_truncated":false,"requirements":{"experience_years_min":15,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Blockchain & Crypto","Design & Creative","Digital Design","AI Consulting & Integration"],"lifecycle":[{"event":"open","at":"2026-10-17T18:58:40Z"}],"visa":[],"liveness":{"score":4,"band":"cold","label":"Long shot","p_open":1,"p_active":0.143,"p_room":0.28,"age_days":353,"expected_fill_days":27,"reasons":["conf:3","stale_co","ghost","win:tail","crowd:"],"computed_at":"2026-10-23T05:54:15Z"},"pay":null,"html_url":"https://alion.io/job/flair-labs-senior-data-engineer-financial-services","json_url":"https://alion.io/job/flair-labs-senior-data-engineer-financial-services.json","meta":{"generated_at":"2026-10-23T08:28:37Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13590,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-24T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4442683},"rest":"https://alion.io/mcp/rest/get_company?id=4442683"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fflair-labs-senior-data-engineer-financial-services"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fflair-labs-senior-data-engineer-financial-services"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fflair-labs-senior-data-engineer-financial-services"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/flair-labs-senior-data-engineer-financial-services\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fflair-labs-senior-data-engineer-financial-services"}]}