{"id":1945506,"url":"https://alion.io/job/core-edge-solutions-principallead-microsoft-fabric-data-engineer","title":"Principal/Lead Microsoft Fabric Data Engineer","company":{"id":3809024,"name":"Core Edge Solutions","domain":"coreedgesolutions.com","url":"https://alion.io/company/core-edge-solutions","size_band":null,"is_staffing_agency":true,"employer_type":"agency","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":30000,"max_usd":64000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":20},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Copilot","optional":false},{"name":"DLP","optional":false},{"name":"GDPR","optional":false},{"name":"Git","optional":false},{"name":"GitHub Actions","optional":false},{"name":"HIPAA","optional":false},{"name":"ISO 27001","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"Power BI","optional":false},{"name":"PowerShell","optional":false},{"name":"Python","optional":false},{"name":"SOC 2","optional":false}],"status":"live","first_seen_at":"2026-10-06T06:20:41Z","employer_posted_date":null,"last_verified_at":"2026-10-06T06:20:41Z","board_verified":false,"closed_at":null,"days_open":21,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":21},"description":"Principal/Lead Microsoft Fabric Data Engineer\n\nLocation : Bangalore (On-site preferred)\n\nExperience Level : 8+ years (with 3+ years in leadership/architect roles)\n\nAbout the Role :\n\nWe are seeking a highly experienced Principal/Lead Microsoft Fabric Data Engineer to spearhead our enterprise-wide initiative to modernize our legacy BI platform to Microsoft Fabric. This is a strategic, greenfield implementation requiring a technical leader who can architect enterprise-scale data solutions, define best practices, lead technical teams, and drive the overall data modernization roadmap leveraging the complete Microsoft Fabric ecosystem.\n\nKey Responsibilities :\n\nTechnical Leadership & Strategy : \n\n- Lead the overall technical vision for Microsoft Fabric adoption and enterprise data architecture\n\n- Define architectural standards, design patterns, and best practices for the Fabric platform\n\n- Evaluate and recommend Fabric components, configurations, and integration patterns for optimal performance\n\n- Drive technical decision-making across data engineering, analytics, and BI teams\n\n- Mentor and coach junior and mid-level data engineers on Fabric technologies and best practices\n\n- Act as the subject matter expert (SME) for Microsoft Fabric across the organization\n\nEnterprise Architecture & Solution Design :\n\n- Design enterprise-scale Lakehouse and Data Warehouse architectures using Microsoft Fabric\n\n- Architect multi-workspace, multi-domain data mesh patterns with proper governance boundaries\n\n- Define and implement medallion architecture (Bronze, Silver, Gold) with enterprise data standards\n\n- Design capacity planning strategies and optimize Fabric compute and storage resources\n\n- Create reference architectures and technical blueprints for different use cases\n\n- Establish data integration patterns for complex enterprise systems and real-time analytics\n\n- Design disaster recovery, high availability, and business continuity strategies for Fabric\n\nLegacy Platform Migration & Modernization :\n\n- Lead the assessment of current legacy BI/DW platforms and create comprehensive migration roadmap\n\n- Define migration strategies (lift-and-shift, re-architecture, hybrid approaches) for different workload types Architect transition states to ensure zero-downtime migrations and backward compatibility\n\n- Establish migration frameworks and accelerators for repeatable migration patterns\n\n- Oversee pilot migrations and validate architectural approaches before full-scale rollout\n\n- Define success metrics and KPIs for migration quality, performance, and user adoption\n\nAdvanced Data Engineering & Optimization :\n\n- Architect and oversee development of complex data pipelines using Fabric Data Factory, Dataflows Gen2, and Notebooks\n\n- Design real-time and near-real-time analytics solutions using Eventstreams, KQL Database, and Real-Time Intelligence\n\n- Implement advanced optimization techniques: partition pruning, Z-ordering, liquid clustering, data skipping Establish performance benchmarking frameworks and optimize query performance across the platform\n\n- Design incremental processing patterns, CDC mechanisms, and SCD implementations at scale\n\n- Architect data quality frameworks with automated validation, profiling, and monitoring\n\nData Governance, Security & Compliance :\n\n- Design and implement enterprise data governance frameworks using Microsoft Purview integration\n\n- Establish comprehensive security models: workspace security, item-level permissions, RLS, OLS, CLS\n\n- Define data classification taxonomies, sensitivity labels, and DLP policies Ensure compliance with GDPR, HIPAA, SOC2, ISO 27001, and industry-specific regulations Implement data lineage tracking, impact analysis, and metadata management\n\n- Design auditing and monitoring frameworks for security and compliance reporting\n\n- Establish data retention and archival policies\n\nDevOps, Automation & CI/CD :\n\n- Architect and implement CI/CD pipelines for Fabric artifacts using Azure DevOps or GitHub Actions\n\n- Establish Git integration patterns and branching strategies for Fabric development\n\n- Design deployment automation using Fabric APIs, PowerShell, and Python\n\n- Implement infrastructure-as-code (IaC) for Fabric workspace and resource provisioning\n\n- Create monitoring and alerting frameworks using Azure Monitor, Log Analytics, and custom dashboards\n\n- Establish incident response and troubleshooting procedures\n\nStakeholder Management & Collaboration :\n\n- Partner with senior leadership, architects, and business stakeholders to align technical solutions with business objectives Translate business requirements\n\ninto scalable technical architectures and roadmaps Present architectural designs and technical strategies to executive stakeholders\n\n- Lead cross-functional teams including data engineers, Power BI developers, analysts, and business users Conduct architecture review boards and technical design reviews\n\n- Build centers of excellence (CoE) for Fabric adoption and best practices Drive change management initiatives and user adoption strategies\n\nInnovation & Continuous Improvement :\n\n- Stay current with Microsoft Fabric roadmap and emerging features\n\n- Evaluate and pilot new Fabric capabilities (Copilot, AI/ML integrations, new connectors)\n\n- Identify opportunities for automation, optimization, and innovation\n\n- Establish feedback loops for continuous platform improvement Drive technical thought leadership\n\nthrough documentation, presentations, and knowledge sharing\n\nRequired Skills & Experience :\n\n- Microsoft Fabric Leadership (Must-Have)\n\n- 3+ years hands-on experience with Microsoft Fabric (including preview/early adoption experience)\n\n- Deep expertise in Fabric architecture : Lakehouse, Data Warehouse, Data Factory, Real-Time Analytics\nSkills\nData Engineering, Business Intelligence, Azure Data Factory, Data Governance, Microsoft Purview, DataLake, Data Warehousing","description_format":"text","description_chars":5900,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-06T06:29:15Z"}],"visa":[],"liveness":{"score":32,"band":"fade","label":"Fading","p_open":0.85,"p_active":0.499,"p_room":0.75,"age_days":20,"expected_fill_days":27,"reasons":["seen:20","agency","velocity","win:late"],"computed_at":"2026-10-27T05:46:45Z"},"pay":null,"html_url":"https://alion.io/job/core-edge-solutions-principallead-microsoft-fabric-data-engineer","json_url":"https://alion.io/job/core-edge-solutions-principallead-microsoft-fabric-data-engineer.json","meta":{"generated_at":"2026-10-28T01:37:02Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2068,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-29T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3809024},"rest":"https://alion.io/mcp/rest/get_company?id=3809024"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcore-edge-solutions-principallead-microsoft-fabric-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcore-edge-solutions-principallead-microsoft-fabric-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcore-edge-solutions-principallead-microsoft-fabric-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/core-edge-solutions-principallead-microsoft-fabric-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcore-edge-solutions-principallead-microsoft-fabric-data-engineer"}]}