{"id":2537425,"url":"https://alion.io/job/intellivo-senior-data-engineer","title":"Senior Data Engineer","company":{"id":3909766,"name":"Intellivo","domain":"intellivo.com","url":"https://alion.io/company/intellivo","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"BambooHR","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Memphis, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":98000,"max_usd":187000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":1089},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"CI/CD","optional":false},{"name":"Copilot","optional":false},{"name":"Cursor","optional":false},{"name":"dbt","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Feature Store","optional":false},{"name":"HIPAA","optional":false},{"name":"Machine Learning","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-06-17T00:00:00Z","employer_posted_date":"2026-06-17","last_verified_at":"2026-10-14T21:56:56Z","board_verified":true,"closed_at":null,"days_open":120,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":120},"description":"Senior Data Engineer\nRole Summary\nThe Senior Data Engineer is responsible for designing, building, and optimizing scalable data pipelines and platform infrastructure within a medallion architecture (Bronze, Silver, Gold) on Microsoft Fabric and OneLake. This role delivers enterprise-grade ingestion, transformation, and enrichment solutions that convert raw healthcare, legal, and insurance data into structured intelligence signals used for identification scoring, analytics, and operational reporting.\nThe role requires deep experience with cloud data platforms, strong Python and SQL skills, and the ability to operate in a regulated healthcare environment with strict HIPAA compliance and multi-tenant data isolation requirements across a large portfolio of client contracts. This person will work closely with Data Science, ML Engineering, and Software Engineering teams to ensure reliable, governed, and performant data delivery across the organization.\nCore Responsibilities\nData Ingestion Pipeline DevelopmentDesign and build data ingestion pipelines from multiple structured and unstructured sources including healthcare claims, P&C insurance data, and legal filings into the Bronze layer of the medallion architecture.\nOptimize ingestion workflows for reliability, throughput, and compliance across regulated production environments.\nImplement error handling, retry logic, and dead-letter patterns to ensure pipeline resilience.\n\nMedallion Architecture and TransformationDevelop Silver layer transformation logic including normalization, deduplication, entity resolution, and schema enforcement within Microsoft Fabric and OneLake.\nBuild Gold layer aggregations and enriched datasets that support ML scoring models and embedded analytics reporting.\nMaintain Feature Store pipelines that produce machine learning-ready feature sets for model training and inference.\n\nData Governance and ComplianceEnforce data contractual constraints from third-party data providers, including requirements for stateless processing and restrictions on data persistence or model training.\nImplement multi-tenant data isolation patterns including partitioning, access controls, and governed data handling across a large number of client contracts.\nDocument data lineage, transformations, and data contracts to support governance, audit readiness, and operational clarity.\n\nData Quality and MonitoringBuild and maintain data quality validation scripts to detect schema drift, completeness gaps, and business-rule violations across pipeline stages.\nImplement monitoring on pipeline health, data freshness, and operational exceptions to maintain high-confidence production data.\nEstablish alerting and escalation processes for pipeline failures and data anomalies.\n\nCross-Functional CollaborationPartner with ML Engineering and Data Science to deliver features that support model retraining, scoring pipelines, and identification engine capabilities.\nCollaborate with Software Engineering, Analytics, and business stakeholders to translate operational needs into reliable, production-ready data solutions.\nContribute to architectural decisions and technical documentation that support the broader data platform strategy.\n\nQualifications\nRequired\nB.S. or B.A. in Computer Science, Information Systems, Mathematics, or a related field.\n7+ years of professional data engineering experience, preferably within Azure-based or Microsoft Fabric environments.\nHands-on experience designing enterprise data pipelines, ETL/ELT workflows, and medallion or lakehouse architecture patterns.\nStrong programming skills in Python, with advanced SQL experience and data quality validation logic.\nExperience with Microsoft Fabric, OneLake, Azure Data Factory, or equivalent cloud data orchestration tools.\nWorking knowledge of CI/CD practices for data pipelines and infrastructure-as-code concepts.\nDemonstrated experience using AI-assisted development tools (e.g., GitHub Copilot, Cursor, or similar) to accelerate pipeline development, code generation, and debugging workflows.\nPreferred\nFamiliarity with healthcare data formats (claims, eligibility, EDI 837/835) and HIPAA compliance requirements.\nExperience with multi-tenant data architectures and governed data handling in regulated environments.\nExposure to ML feature engineering, Feature Store design, or data pipelines supporting model training workflows.\nExperience with dbt, PySpark, or similar transformation frameworks.\nProfessional Skills\nHighly organized with the ability to manage multiple concurrent technical workstreams.\nCritical thinker with strong problem-solving ability and attention to detail.\nClear communicator, comfortable working asynchronously with distributed teams.\nSelf-directed with a track record of driving projects through completion without constant oversight.","description_format":"text","description_chars":4818,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Health Care","Health Insurance & Benefits"],"lifecycle":[{"event":"open","at":"2026-10-14T14:40:04Z"}],"visa":[],"liveness":{"score":9,"band":"cold","label":"Long shot","p_open":1,"p_active":0.331,"p_room":0.28,"age_days":120,"expected_fill_days":23,"reasons":["conf:3","win:tail","crowd:"],"computed_at":"2026-10-15T01:11:44Z"},"pay":null,"html_url":"https://alion.io/job/intellivo-senior-data-engineer","json_url":"https://alion.io/job/intellivo-senior-data-engineer.json","meta":{"generated_at":"2026-10-15T01:11:44Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1465,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-16T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3909766},"rest":"https://alion.io/mcp/rest/get_company?id=3909766"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fintellivo-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fintellivo-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fintellivo-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/intellivo-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fintellivo-senior-data-engineer"}]}