{"id":3286581,"url":"https://alion.io/job/emory-university-lead-data-engineer","title":"Lead Data Engineer","company":{"id":452190,"name":"Emory University","domain":"emory.edu","url":"https://alion.io/company/emory-university","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"iCIMS","truth_index":{"grade":"A","score":100,"open_postings":81,"ghost_share":0,"stale_share":0,"repost_share":0.012,"time_to_fill_p50_days":15,"computed_at":"2026-10-30T05:48:23Z"}},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Atlanta, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":98000,"max_usd":192000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":450},"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"HIPAA","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-10-26T18:36:53Z","employer_posted_date":"2026-10-26","last_verified_at":"2026-10-30T03:45:35Z","board_verified":true,"closed_at":null,"days_open":3,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":3},"description":"Discover Your Career at Emory University\nEmory University is a leading research university that fosters excellence and attracts world-class talent to innovate today and prepare leaders for the future. We welcome candidates who can contribute to the excellence of our academic community.Description\nThe Lead Data Engineer provides technical leadership and hands-on engineering expertise for the development and operation of Emory University’s Unified Data Platform (UDP), built on Microsoft Fabric. The role leads to the integration of data from HR, Finance, Student, Research, and other enterprise applications to support analytics, reporting, research, and institutional decision-making.\nWorking closely with architects, researchers, business stakeholders, and cross-functional teams, the lead translates requirements into reliable, scalable, and governed data solutions. This position guides engineering delivery, mentors team members, establishes development standards, and resolves complex technical issues while contributing directly to pipeline development and production support. Microsoft Fabric experience is preferred. Candidates with strong experience in Azure Synapse or Databricks with PySpark, and the ability to apply that experience to Microsoft Fabric, will also be considered. The role requires sound judgment in data quality, security, governance, and the handling of sensitive university and research data. KEY RESPONSIBILITIES:\nLead the technical delivery of source system onboarding and data integration initiatives, from source analysis and design through development, validation, deployment, and production support.\nPartner with architects to implement platform designs, reusable ingestion frameworks, and engineering standards aligned with the UDP architecture and institutional priorities.\nDesign, develop, and optimize ETL and ELT pipelines using SQL, Python, PySpark, and Microsoft Fabric or comparable cloud technologies.\nAnalyze source schemas, business rules, and dependencies across enterprise applications; define source-to-target mappings, incremental load strategies, and reconciliation requirements.\nGuide implementation of bronze, silver, and gold data layers, including data transformation, dimensional modeling, and curated datasets for reporting and analytics.\nEstablish and review standards for coding, testing, documentation, version control, and deployment; conduct code reviews and mentor data engineers.\nCoordinate engineering tasks and technical dependencies with Business Analysts, Project Managers, Data Analysts, Architects, and source system owners; communicate delivery progress, risks, and resource needs.\nImplement data quality checks, reconciliation controls, monitoring, alerting, error handling, and recovery procedures to support reliable production processing.\nTroubleshoot complex pipeline and data issues; tune SQL, Spark workloads, and orchestration to improve performance, scalability, and efficient use of platform capacity.\nApply institutional data governance and security standards, including access controls, metadata, lineage, and appropriate handling of sensitive data; support HIPAA requirements where applicable.\nWork with researchers and business stakeholders to translate requirements into technical specifications and explain design choices and data limitations clearly.\nCreate and maintain technical documentation, operational runbooks, source mappings, and support procedures; coordinate production deployments and knowledge transfer.\nSupport existing UDP and Enterprise Business Intelligence (EBI) integrations and services, balancing operational needs with project delivery priorities.\nEvaluate emerging technologies and develop focused proofs of concept that address identified business or engineering needs.\nKNOWLEDGE, SKILLS, AND ABILITIES:\nStrong experience designing and maintaining data pipelines and ETL/ELT processes across multiple source systems.\nProficiency in Python, SQL, and Apache Spark (PySpark)\nExperience with modern data platforms such as Azure Fabric (preferred), Azure Synapse Serverless, or Databricks\nAbility to work with large, complex, and distributed datasets\nSolid understanding of data modeling concepts and best practices\nFamiliarity with data governance, metadata management, and data quality frameworks\nAbility to lead technical design discussions, review code, mentor engineers, and guide delivery across multiple workstreams\nExperience with CI/CD practices and proficiency with version control systems like Git\nFamiliarity with data pipeline orchestration and monitoring tools Like Airflow, Azure Data Factory or similar frameworks\nUnderstanding of biomedical informatics methodologies is a plus\nStrong analytical, problem-solving, and critical-thinking abilities\nStrong analytical, problem-solving, communication, and collaboration skills, with the ability to explain technical concepts to diverse audiences.\nAbility to prioritize engineering work, identify delivery risks, and adapt to changing business and platform requirements.\nADDITIONAL JOB DETAILS:\nWorks as a positive team member of a project that may consist of Business Analysts, Project Managers, Information Architects, Data Analysts, and/or Database Administrators to deliver quality applications and components within scope, on time, within budget, and ensures compliance.\nManages workload effectively and report status of tasks in a timely manner.\nIs able to guide stakeholders on solutions and support structure.\nEnsures proper governance of prioritizing work from partners.\nForms tactical strategies to support multiple clients.\nLeads and proactively identifies emerging technologies; develops proof-of-concepts, and promotes the usage of these emerging technologies.\nLeads small to medium size technical teams, and mentors other analysts on regulation adherence.\nFollows standard operational procedures and HIPAA regulations.\nDevelops strategies for managing complex data sets through maintaining data standards and metadata.\nApplies biomedical informatics technical standards, methodologies, and principles to research-specific program needs, objectives, and outcomes.\nDevelops reporting infrastructure to meet multiple client needs.\nGenerates standard templates for architecture documentation related to current and proposed informatic solutions.\nPerforms other related duties as required.\nMINIMUM QUALIFICATIONS:\nA bachelor's degree in a related field and seven years of related experience, OR an equivalent combination of education, training, and experience.\nPREFERRED QUALIFICATIONS:\nExperience with Microsoft Fabric Lakehouse, Warehouse, notebooks, and data pipelines.\nExperience in integrating higher education and Healthcare Enterprise HR, Finance, Student, and Research applications.\nNOTE: Tasks related to this position can be performed remotely with only occasional visits to an Emory University location. Eastern (EST) time zone business hours may apply. Emory reserves the right to change this status with notice to employee. Emory does not approve as a primary work location in the following states; NJ, AK, and HI, any U.S. Territories or outside of the United States.\nAdditional Details\nEmory is an equal opportunity employer, and qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status or other characteristics protected by state or federal law. Emory University does not discriminate in admissions, educational programs, or employment, including recruitment, hiring, promotions, transfers, discipline, terminations, wage and salary administration, benefits, and training. Students, faculty, and staff are assured of participation in university programs and in the use of facilities without such discrimination. Emory University complies with Section 503 of the Rehabilitation Act of 1973, the Vietnam Era Veteran's Readjustment Assistance Act, and applicable executive orders, federal and state regulations regarding nondiscrimination, equal opportunity, and affirmative action (for protected veterans and individuals with disabilities). Inquiries regarding this policy should be directed to the Emory University Department of Equity and Civil Rights Compliance, 201 Dowman Drive, Administration Building, Atlanta, GA 30322. Telephone: 404-727-9867 (V) | 404-712-2049 (TDD). Emory University is committed to ensuring equal access and providing reasonable accommodations to qualified individuals with disabilities upon request. To request this document in an alternate format or to seek a reasonable accommodation, please contact the Department of Accessibility Services at  or call 404-727-9877 (Voice) | 404-712-2049 (TDD). We kindly ask that requests be made at least seven business days in advance to allow adequate time for coordination.","description_format":"text","description_chars":8868,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Higher Education","Research Institutes"],"lifecycle":[{"event":"open","at":"2026-10-26T18:36:53Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 257 · green card filings: 15","filings_12m":257,"filings_prev_12m":319,"green_card_filings_12m":15,"median_offered_wage_usd":79706,"route":null,"cap_exempt":true,"checked_at":"2026-10-29T16:27:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":5}],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":3,"expected_fill_days":15,"reasons":["conf:2","velocity","win:early","comp:brand"],"computed_at":"2026-10-30T05:48:23Z"},"pay":null,"html_url":"https://alion.io/job/emory-university-lead-data-engineer","json_url":"https://alion.io/job/emory-university-lead-data-engineer.json","meta":{"generated_at":"2026-10-30T07:31:15Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":10530,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-31T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":452190},"rest":"https://alion.io/mcp/rest/get_company?id=452190"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Femory-university-lead-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Femory-university-lead-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Femory-university-lead-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/emory-university-lead-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Femory-university-lead-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3286581}},{"tool":"search_jobs","arguments":{"company":"emory.edu","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3286581},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}