{"id":3149772,"url":"https://alion.io/job/shuru-senior-data-engineer","title":"Senior Data Engineer","company":{"id":419,"name":"Shuru","domain":"shurutech.com","url":"https://alion.io/company/shuru","size_band":null,"is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["India"],"countries":["IN"],"hiring_countries":["IN"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":21000,"max_usd":42000,"period":"year","method":"role_seniority_country_cell","sample_n":81},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"GDPR","optional":false},{"name":"MariaDB","optional":false},{"name":"pySpark","optional":false},{"name":"SQL","optional":false},{"name":"Agile","optional":true},{"name":"CI/CD","optional":true},{"name":"dbt","optional":true},{"name":"Git","optional":true},{"name":"Python","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-10-23T11:35:15Z","employer_posted_date":null,"last_verified_at":"2026-10-23T11:35:15Z","board_verified":false,"closed_at":null,"days_open":8,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":8},"description":"The Senior Data Engineer is a hands-on builder dedicated to a specific business line, responsible for developing, testing, and running the data pipelines and models that turn that line's raw source data into reliable, governed datasets on Azure Databricks.\n\nThe role works day-to-day with the Forward Deployed Data Lead for that business line to translate scoped requirements into production pipelines, and with the Lead Data Engineer to make sure what's built follows the platform's shared standards rather than becoming a one-off, line-specific solution. This is an execution-focused role: less about setting architecture direction and more about building it well, reliably, and on time, with a clear growth path toward Lead Data Engineer for those who want to take on cross-line or platform-wide ownership.\n\nThe candidate will have responsibilities across the following functions: \n\nPipeline Development: \nBuild, test, and maintain data pipelines on Azure Databricks for the assigned business line, using PySpark and SQL.\nImplement bronze, silver, and gold layer transformations using Delta Lake, following the platform's established lakehouse standards.\nIngest structured and semi-structured data from sources such as MariaDB, Azure Event Hubs, APIs, and file systems.\n\nData Modelling: \nDesign and build data models (dimensional models, gold-layer tables) for the business line's use cases, in line with patterns set by the Lead Data Engineer.\nFlag where a business line's data model needs a shared, cross-line solution rather than a local one, and raise it to the Lead Data Engineer.\n\nQuality and Reliability: \nImplement automated testing, data validation, and pipeline monitoring for everything owned.\nRespond to and troubleshoot pipeline incidents and data quality issues for the assigned business line, escalating where needed.\nFollow the platform's cataloguing, lineage, and metadata practices so the data produced is discoverable and trustworthy.\n\nCollaboration and Delivery: \nWork directly with the Forward Deployed Data Lead to turn scoped business requirements into build plans and delivery timelines.\nPartner with analysts and, where relevant, data scientists and AI engineers consuming the pipelines built, to make sure outputs meet their needs.\nParticipate in code reviews and platform standards discussions led by the Lead Data Engineer.\n\nCompliance: \nEnsure pipelines and datasets meet data security, privacy, and regulatory requirements (e. g., GDPR, PII handling) relevant to the business line.\n\nRequirements: \nWorking experience with Delta Lake and lakehouse (bronze/silver/gold) architecture.\nSolid understanding of data modelling, including dimensional modelling.\nExperience implementing automated data validation, testing, and monitoring for pipelines.\nFamiliarity with data cataloguing, lineage, and metadata concepts.\nExposure to Structured Streaming or real-time processing is a plus.\nFamiliarity with dbt and Git-based CI/CD workflows is a plus.\n\nCollaboration and Communication: \nSpeaks with clarity and confidence, able to discuss initiatives with Business and Leads with full end-to-end context\nComfortable working directly with a business-facing lead (Forward Deployed Data Lead) to clarify requirements and scope.\nAble to explain technical trade-offs clearly to both engineering peers and less technical stakeholders.\n\nExperience: \n5-8 years of experience in data engineering, including hands-on work with cloud data platforms.\nExperience building pipelines on Azure Databricks, Delta Lake, or comparable lakehouse/cloud-native tools.\nExposure to version control (Git), Agile methodologies, and CI/CD practices.\nExperience in fintech, broking, or trading platforms is a plus, not required.\nBachelor's degree in Computer Science, Engineering, or a related field.\nSkills\ndatabricks, delta lake, lakehouse, pyspark, spark","description_format":"text","description_chars":3851,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Outsourcing & Dedicated Teams","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-23T11:35:15Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":7,"expected_fill_days":40,"reasons":["seen:7","velocity","win:early"],"computed_at":"2026-10-31T05:58:55Z"},"pay":null,"html_url":"https://alion.io/job/shuru-senior-data-engineer","json_url":"https://alion.io/job/shuru-senior-data-engineer.json","meta":{"generated_at":"2026-11-01T03:41:26Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":5770,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-02T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":419},"rest":"https://alion.io/mcp/rest/get_company?id=419"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fshuru-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fshuru-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fshuru-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/shuru-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fshuru-senior-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3149772}},{"tool":"search_jobs","arguments":{"company":"shurutech.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3149772},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}