Lead Fabric Data Engineer Consultants | Python | 100% Remote

Description

• Engagement Type: Contract-C2C or W-2 hourly/temporary
• Expected Commitment: 40 hours per week, Monday-Friday
• Work Schedule: Must work East Coast hours
• Initial Term: Three months, with potential to extend
• 100% Remote: Ideal candidate resides in NH, MA, RI, CT, ME, NY, or TX

Spyglass MTG is seeking experienced Lead Data Engineers who are “thinkers” and can mentor

junior developers while extending an existing codebase and building team proficiency in

Microsoft Fabric and Pyspark Python including class development and structured streaming.

Why Spyglass MTG?

• Exclusive focus on Microsoft technologies for more than 12 years
• 90% of our business comes from repeat customers
• 80% of our new business comes through Microsoft
• Five Microsoft Solutions Partner badges and 10 Advanced Specializations
• Member of Microsoft’s Partner Advisory Council for Data and AI
• Microsoft Fabric Voice member

Overview

Our client engagement is focused on Microsoft Fabric and Pyspark Python development

including class objects, structured streaming, Change Data Feed (CDF), and metadata driven

processes for our client in higher education.

The successful consultant will be a critical thinker and problem-solver who can work

independently, collaborate with client teams, and deliver high-quality, maintainable data

solutions.

The consultant will design and build python class objects focusing on developing reusable code

to load a Data Vault model from a Medallion ETL delta source. Solution supports near real time

processing using structured streaming. Collaboration and people skills are a must. This role

requires the development of production ready code as well as mentoring data engineers new to

Pyspark Python development. Use of AI, specifically GitHub Copilot, to increase productivity

and code quality is highly desired.

Key Responsibilities

• Extend and enhance an existing Python class-based codebase.
• Develop object-oriented solutions to source, transform, and load data into tables.
• Build and maintain ETL workflows using Microsoft Fabric notebooks.
• Partner closely with client resources during East Coast business hours.
• Mentor junior developers in Microsoft Fabric, Python, and object-oriented development.
• Provide hands-on technical leadership and deliver high-quality solutions.
• Promote effective development practices and maintainable code.

Requirements

Required Qualifications

• Must be available to work East Coast hours.
• Fluent English communication skills.
• Strong Python development experience.
• Strong Microsoft Fabric experience, particularly with notebooks.
• Demonstrated experience with object-oriented programming and class development.
• Experience developing solutions that source, transform, and load data into tables.
• Strong ETL experience.
• Experience leading and mentoring junior developers.
• Ability to think critically, solve problems independently, and collaborate effectively with

client teams.

Preferred Qualifications

• Experience with Data Vault data models.
• Experience using AI tools to generate code or accelerate development.
• Experience working in higher education.