{"id":2931641,"url":"https://alion.io/job/cmart-solutions-senior-data-engineer","title":"Senior Data Engineer","company":{"id":4454512,"name":"CMart Solutions","domain":"cmartsolutions.com","url":"https://alion.io/company/cmart-solutions","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":22000,"max_usd":46000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":71},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Kafka","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"Power BI","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Delta Lake","optional":true}],"status":"live","first_seen_at":"2026-10-20T14:35:45Z","employer_posted_date":null,"last_verified_at":"2026-10-20T14:35:45Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"We are seeking an experienced Senior Data Engineer to design, build, and maintain scalable data pipelines and analytics solutions using Azure and Databricks ecosystems, and to help set technical direction for our Data Engineering team.\n\nResponsibilities: \nOwn architecture and technical design decisions for client data platforms, and represent those solutions directly in client conversations.\nSet engineering standards for code review, testing, and CI/CD practices across the pipeline codebase, and mentor junior data engineers.\nDesign and implement robust data pipelines using Azure Data Factory (ADF) and Databricks.\nDevelop scalable ETL/ELT processes to ingest, transform, and load data from various sources.\nWrite clean, efficient, and reusable Python code for data processing and automation.\nOptimise and manage SQL queries for data extraction, transformation, and reporting.\nCollaborate with business stakeholders to understand data requirements and deliver solutions aligned with business goals.\nEnsure data quality, integrity, and security across all data platforms.\nMonitor and troubleshoot data pipelines to ensure high availability and performance.\nImplement logging, alerting, and error-handling mechanisms for proactive issue resolution.\nApply domain knowledge of trading and financial markets to enhance data models and analytics capabilities.\n\nRequirements: \n8+ years of experience in Data Engineering or related roles.\nStrong, hands-on experience with the Azure and Databricks tech stack: Azure Data Factory, Azure Databricks, Delta Lake, and Unity Catalogue.\nStrong programming skills in Python for data engineering tasks.\nStrong SQL skills and a solid understanding of relational databases.\nStrong communication and collaboration abilities, including the confidence to work directly with business and client stakeholders.\nDemonstrated experience owning architecture decisions and providing technical direction on data engineering projects.\nProduction experience with real-time data processing frameworks (e. g., Spark Streaming, Kafka).\nExperience in maintaining and supporting production-grade data pipelines.\nHands-on experience with Power BI, including data modelling, DAX, and building interactive dashboards.\nExperience with version control systems (e. g., Git) and CI/CD pipelines.\nExcellent problem-solving skills and attention to detail.\n\nGood to have (not mandatory): \nPrior experience in ETRM/CTRM, energy, or commodity trading platforms, including market data, trade lifecycle, and financial instruments.\nRelevant certifications (e. g., Databricks Certified Data Engineer Associate/Professional, or current Microsoft Azure data engineering certification).\nSkills\nadf, azure, azure data factory, azure databricks, data engineer, data engineering, databricks, kafka, power bi, python, spark, sql","description_format":"text","description_chars":2824,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-20T14:35:45Z"}],"visa":[{"country":"GB","licensed_sponsor":true,"evidence":"Licensed UK visa sponsor (Skilled Worker, Senior or Specialist Worker)","filings_12m":null,"filings_prev_12m":null,"green_card_filings_12m":null,"median_offered_wage_usd":null,"route":"Skilled Worker; Global Business Mobility: Senior or Specialist Worker","cap_exempt":false,"checked_at":"2026-10-21T06:25:45+00:00","sources":["UK Home Office: register of licensed sponsors (workers)"],"filings_for_role_12m":0}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":27,"reasons":["seen:0","win:early"],"computed_at":"2026-10-21T05:46:15Z"},"pay":null,"html_url":"https://alion.io/job/cmart-solutions-senior-data-engineer","json_url":"https://alion.io/job/cmart-solutions-senior-data-engineer.json","meta":{"generated_at":"2026-10-21T06:51:10Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":9663,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4454512},"rest":"https://alion.io/mcp/rest/get_company?id=4454512"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcmart-solutions-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcmart-solutions-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcmart-solutions-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/cmart-solutions-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcmart-solutions-senior-data-engineer"}]}