{"id":2746483,"url":"https://alion.io/job/titan-professional-resources-senior-data-engineer","title":"Senior Data Engineer","company":{"id":2314927,"name":"TITAN PROFESSIONAL RESOURCES","domain":"titanprojobs.com","url":"https://alion.io/company/titanprojobs","size_band":null,"is_staffing_agency":true,"employer_type":"agency","is_intermediary":false,"listed_via":null,"ats_vendor":"Schema","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"Azure SQL Database","optional":false},{"name":"CI/CD","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"Microsoft Entra ID","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"MS SQL","optional":false},{"name":"Power BI","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"SSIS","optional":false},{"name":"PostgreSQL","optional":true}],"status":"live","first_seen_at":"2026-10-16T22:30:14Z","employer_posted_date":"2026-10-16","last_verified_at":"2026-10-17T15:24:51Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Titan Professional Resources is seeking a Senior Data Engineer to join one of our clients. This position will focus on designing, developing, and maintaining scalable data solutions while supporting the modernization of enterprise data platforms. The ideal candidate will have strong SQL and Python skills, hands-on experience with Microsoft Fabric and Azure, and the ability to lead technical initiatives and deliver reliable data solutions.\nSenior Data Engineer Responsibilities\nDesign, develop, test, deploy, and maintain scalable batch and near-real-time data pipelines across enterprise data sources.\n\nBuild modern data engineering solutions using Microsoft Fabric, including Lakehouse, Warehouse, OneLake, Notebooks, and Dataflows.\n\nDevelop reusable ETL/ELT processes and data transformations using T-SQL, Python, PySpark, and Spark SQL.\n\nImplement incremental loading, change data capture, schema evolution, data reconciliation, error handling, and recovery processes.\n\nDesign relational, dimensional, and Lakehouse data models to support analytics, reporting, and system integrations.\n\nMonitor and maintain production data pipelines through logging, alerting, data quality checks, metadata management, and operational support procedures.\n\nOptimize SQL queries, Spark workloads, pipelines, and storage for performance, scalability, reliability, and cost efficiency.\n\nApply security best practices, including role-based access controls, managed identities, secrets management, and secure connectivity.\n\nImplement source control, automated testing, CI/CD, and deployment processes using Git, Azure DevOps, and Microsoft Fabric.\n\nParticipate in code reviews, release planning, incident resolution, root-cause analysis, and post-implementation reviews.\n\nDevelop reusable engineering standards, templates, frameworks, and technical documentation.\n\nCollaborate with analysts, Power BI developers, architects, governance teams, and business stakeholders to deliver reliable data solutions.\n\nSupport the modernization and migration of legacy SSIS, SSRS, Azure Data Factory, SQL-based, and other data integration workloads to cloud and Microsoft Fabric platforms.\n\nSenior Data Engineer Qualifications\nBachelor's degree, college diploma, or equivalent practical experience in Computer Science, Information Systems, Data Engineering, Software Engineering, or a related field.\n\nMinimum of 5 years of progressive experience in data engineering, data integration, data warehousing, analytics engineering, or a related field.\n\nDemonstrated experience designing and delivering end-to-end data solutions and supporting production data environments.\n\nAdvanced SQL and T-SQL skills, including complex queries, stored procedures, views, indexing, execution-plan analysis, and performance tuning.\n\nStrong Python skills for data engineering, automation, testing, API integration, and file processing.\n\nHands-on experience with Microsoft Fabric and Azure data services, including Lakehouse, Warehouse, OneLake, Delta tables, pipelines, notebooks, Azure Data Factory, Azure SQL, Azure Data Lake Storage, and Key Vault.\n\nExperience with PySpark and Spark SQL is preferred.\n\nStrong understanding of data warehousing, Lakehouse architecture, dimensional modeling, medallion architecture, and ETL/ELT processes.\n\nExperience with Git, branching, pull requests, automated testing, CI/CD, and deployment management.\n\nKnowledge of Microsoft Entra ID, managed identities, service principals, role-based access control, and data security best practices.\n\nFamiliarity with data monitoring, logging, alerting, lineage, metadata, data quality, and audit requirements.\n\nExperience integrating databases, REST APIs, JSON, CSV, Parquet, Delta, SFTP, and other data sources.\n\nWorking knowledge of Power BI and semantic models; DAX experience is a plus.\n\nExperience with PostgreSQL, SSIS, and SSRS is an asset.\n\nStrong troubleshooting, analytical, communication, and problem-solving skills.\n\nAbility to lead technical discussions, mentor engineers, conduct code reviews, and establish engineering best practices.\n\nExperience in insurance or another regulated financial services environment is strongly preferred.\n\nMicrosoft Fabric, Azure Data Engineer, Power BI, or related Microsoft certifications are a plus.","description_format":"text","description_chars":4275,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-16T22:30:14Z"}],"visa":[],"liveness":{"score":54,"band":"ok","label":"Likely open","p_open":1,"p_active":0.542,"p_room":1,"age_days":0,"expected_fill_days":13,"reasons":["conf:2","agency","velocity","win:early"],"computed_at":"2026-10-17T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/titan-professional-resources-senior-data-engineer","json_url":"https://alion.io/job/titan-professional-resources-senior-data-engineer.json","meta":{"generated_at":"2026-10-17T20:18:11Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":4010,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2314927},"rest":"https://alion.io/mcp/rest/get_company?id=2314927"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftitan-professional-resources-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftitan-professional-resources-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftitan-professional-resources-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/titan-professional-resources-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftitan-professional-resources-senior-data-engineer"}]}