{"id":4082036,"url":"https://alion.io/job/symphoni-hr-ai-data-engineer-azure","title":"AI Data Engineer – Azure","company":{"id":3800108,"name":"Symphoni HR","domain":"symphonihr.com","url":"https://alion.io/company/symphoni-hr","size_band":"201-500","is_staffing_agency":true,"employer_type":"agency","is_intermediary":false,"listed_via":null,"ats_vendor":"Schema","truth_index":{"grade":"A","score":93,"open_postings":43,"ghost_share":0,"stale_share":0,"repost_share":0.465,"time_to_fill_p50_days":45,"computed_at":"2026-11-11T05:49:22Z"}},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"AI Agents","optional":false},{"name":"Apache Kafka","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Claude","optional":false},{"name":"Cursor","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"Hadoop","optional":false},{"name":"Model Context Protocol","optional":false},{"name":"OpenAI Codex","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-11-11T17:43:25Z","employer_posted_date":"2026-11-11","last_verified_at":"2026-11-11T17:44:37Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"This role centres on designing, building and operating scalable data pipelines and AI-enabled data platforms on Microsoft Azure. You will work with modern lakehouse and big data technologies to deliver reliable, well-modelled data for analytics and AI use cases. The position also involves applying agentic AI patterns and AI-powered development tools to accelerate engineering delivery. The role is based in Bengaluru with a hybrid working model.\nOur client is a leading global professional services firm in the accounting and finance sector, serving organisations across multiple industries worldwide. They are known for large-scale digital transformation work and for investing heavily in data, analytics and artificial intelligence. The culture emphasises collaboration, continuous learning and delivering high-quality solutions to complex business challenges.\nResponsibilities\nDesign, develop and maintain end-to-end ETL and ELT data pipelines using Azure Databricks, Azure Data Factory and Apache Spark.\nBuild and optimise data models (normalised and denormalised) across OLTP and OLAP environments to support analytics and reporting.\nIntegrate data warehouses and BI tools, ensuring data quality, performance and reliability across the platform.\nDevelop and manage data storage solutions using Azure Data Lake Storage, Azure Blob Storage and Azure Synapse Analytics.\nIngest and process streaming and batch data using tools such as Kafka, PySpark and Hadoop where appropriate.\nImplement CI/CD practices using Azure DevOps and version control with Git within Agile delivery teams.\nApply applied AI/ML frameworks and agentic AI patterns, including creating custom MCP skills and agents, to enhance data solutions.\nLeverage AI-powered development tools such as OpenAI Codex, Claude and Cursor to improve engineering productivity and code quality.\nCollaborate with architects, analysts and business stakeholders to translate requirements into robust technical solutions.\nRequirements\n4-7 years of hands-on experience in data engineering, including building production data pipelines.\nStrong proficiency in SQL and Python, with working knowledge of PySpark and Apache Spark.\nPractical experience with Databricks and Azure Databricks, Azure Data Factory, and core Azure data services.\nSolid understanding of data modelling (normalisation and denormalisation), data warehousing and OLTP/OLAP concepts.\nExperience with Git, Azure DevOps for CI/CD and Agile delivery methodologies.\nFamiliarity with Kafka, Hadoop and big data ecosystems is desirable.\nExposure to applied AI/ML frameworks, MCP (Model Context Protocol) and agentic AI patterns is highly valued.\nStrong problem-solving skills, clear communication and the ability to work effectively in a hybrid team environment.\nSkills\nSQL, Python, PySpark, Databricks, Azure Databricks, Azure Data Factory, Apache Spark, Azure Blob Storage, Azure Data Lake Storage, Data modeling (normalization and denormalization), Data warehousing and BI tools integration, Git, ETL pipeline development, Applied AI/ML frameworks, MCP (Model Context Protocol), Agentic AI patterns, AI-powered development tools (OpenAI Codex, Claude, Cursor), OLTP and OLAP environments, Kafka, Hadoop, Azure Synapse Analytics, Azure DevOps for CI/CD, Agile delivery methodologies, Creating custom MCP skills and agents","description_format":"text","description_chars":3334,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Continuous learning","Hybrid work"],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-11-11T17:43:25Z"}],"visa":[],"liveness":{"score":52,"band":"ok","label":"Likely open","p_open":1,"p_active":0.516,"p_room":1,"age_days":0,"expected_fill_days":45,"reasons":["conf:1","agency","win:early","comp:brand"],"computed_at":"2026-11-11T19:14:18Z"},"pay":null,"html_url":"https://alion.io/job/symphoni-hr-ai-data-engineer-azure","json_url":"https://alion.io/job/symphoni-hr-ai-data-engineer-azure.json","meta":{"generated_at":"2026-11-11T19:14:18Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":37091,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-12T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3800108},"rest":"https://alion.io/mcp/rest/get_company?id=3800108"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsymphoni-hr-ai-data-engineer-azure"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsymphoni-hr-ai-data-engineer-azure"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsymphoni-hr-ai-data-engineer-azure"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/symphoni-hr-ai-data-engineer-azure\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsymphoni-hr-ai-data-engineer-azure"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4082036}},{"tool":"search_jobs","arguments":{"company":"symphonihr.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4082036},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}