{"id":4364242,"url":"https://alion.io/job/asrah-technologies-senior-data-ai-engineer","title":"Senior Data & AI Engineer","company":{"id":3802006,"name":"Asrah Technologies","domain":"asrahindia.com","url":"https://alion.io/company/asrah-technologies","size_band":null,"is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pune, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Docker","optional":false},{"name":"ETL/ELT","optional":false},{"name":"FastAPI","optional":false},{"name":"Flask","optional":false},{"name":"LangChain","optional":false},{"name":"LangGraph","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Model Context Protocol","optional":false},{"name":"Platform Engineering","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-11-16T10:36:29Z","employer_posted_date":null,"last_verified_at":"2026-11-16T10:36:29Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"Job Summary:\n\nWe are looking for a Senior Data Engineer to design, build, and operate our enterprise data platform on Azure and Databricks, with strong hands-on skills in GenAI/LLM application engineering. This role owns the full lifecycle of data pipelines and AI-powered applications from ingestion and orchestration to governance, API development, and deployment.\n\nKey Responsibilities:\n\nGenAI & LLM Application Engineering:\n\n- Design and build RAG pipelines, including embedding-based and graph/metadata-grounded retrieval approaches.\n\n- Orchestrate multi-step and multi-agent LLM workflows using LangGraph and LangChain.\n\n- Build and integrate tools/agents using MCP for structured tool-calling and context management.\n\n- Develop backend APIs for AI applications using FastAPI and Python Flask.\n\n- Build and manage LLM/agent workflows using Azure AI Foundry, and implement semantic + vector search using Azure AI Search indexes.\n\n- Implement prompt engineering, structured outputs, guardrails, and LLM evaluation/observability practices.\n\nData Engineering & Pipeline Development:\n\n- Design and build scalable ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks (PySpark, Spark SQL).\n\n- Develop and maintain Databricks Lakeflow (Delta Live Tables) pipelines across bronze/silver/gold medallion layers.\n\n- Use Databricks Autoloader for incremental, schema-evolving file ingestion into Delta Lake.\n\n- Build reusable, config-driven ingestion frameworks supporting multiple heterogeneous source systems.\n\n- Implement CDC, SCD Type 1/2, and incremental loading strategies.\n\n- Package and deploy Databricks workflows using Databricks Asset Bundles (DABs).\n\nPlatform, Infrastructure & DevOps:\n\n- Own infrastructure provisioning and deployment using Terraform for Databricks, ADF, and related Azure resources.\n\n- Build and maintain Azure DevOps CI/CD pipelines for automated testing, deployment, and release management.\n\n- Deploy and manage applications on Azure Container Apps, using Docker for containerization.\n\n- Develop and support Databricks Apps for internal data tooling.\n\nGovernance, Security & Reliability:\n\n- Implement and maintain data governance using Databricks Unity Catalog.\n\n- Design and enforce security policies across managed tables.\n\n- Build monitoring, alerting, and SLA dashboards to ensure pipeline reliability and data quality.\n\n- Perform Spark/Databricks performance tuning, cluster sizing, partitioning, and cost optimization.\n\nCollaboration:\n\n- Partner with data architects, analysts, and business stakeholders to translate requirements into scalable data and AI solutions.\n\n- Document architecture, pipelines, and operational runbooks.\n\n- Mentor junior engineers on Databricks, Python development, and platform engineering best practices.\n\nPreferred Candidate Profile:\n\n- Strong hands-on experience with Azure Data Factory, Databricks (PySpark, Spark SQL, Delta Lake, Autoloader, Lakeflow, DABs), and Unity Catalog.\n\n- Proficiency in Databricks Apps, Azure Container Apps, Docker, and Terraform.\n\n- Strong Python development skills, including API development with FastAPI and Flask.\n\n- Hands-on experience with LLM application engineering (RAG, LangGraph, LangChain, MCP).\n\n- Experience with Azure AI Foundry, Azure AI Search, and vector databases.\n\n- Experience with CI/CD using Azure DevOps and API integration.\n\nSkills\nData Engineering, Generative AI, Databricks, Python, Azure, LLM, PySpark, Terraform, LangChain, FastAPI","description_format":"text","description_chars":3462,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation"],"lifecycle":[{"event":"open","at":"2026-11-16T10:40:27Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":30,"reasons":["seen:0","win:early"],"computed_at":"2026-11-16T13:35:37Z"},"pay":null,"html_url":"https://alion.io/job/asrah-technologies-senior-data-ai-engineer","json_url":"https://alion.io/job/asrah-technologies-senior-data-ai-engineer.json","meta":{"generated_at":"2026-11-16T13:35:37Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":20927,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3802006},"rest":"https://alion.io/mcp/rest/get_company?id=3802006"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fasrah-technologies-senior-data-ai-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fasrah-technologies-senior-data-ai-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fasrah-technologies-senior-data-ai-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/asrah-technologies-senior-data-ai-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fasrah-technologies-senior-data-ai-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4364242}},{"tool":"search_jobs","arguments":{"company":"asrahindia.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4364242},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}