{"id":3255961,"url":"https://alion.io/job/cpl-data-engineer-python-databricks","title":"Data Engineer - Python / Databricks","company":{"id":2268173,"name":"Cpl","domain":"cpl.com","url":"https://alion.io/company/cpl-com","size_band":null,"is_staffing_agency":true,"employer_type":"agency","is_intermediary":false,"listed_via":null,"ats_vendor":"Schema","truth_index":{"grade":"B","score":77,"open_postings":49,"ghost_share":0,"stale_share":0.918,"repost_share":0.02,"time_to_fill_p50_days":29,"computed_at":"2026-11-04T06:34:25Z"}},"role":"Data Science","role_family":"Data Science","seniority":"staff","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Dublin, Ireland"],"countries":["IE"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":79000,"max_usd":189000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":781},"experience_years_min":10,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Azure","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false},{"name":"Azure Data Factory","optional":true},{"name":"CI/CD","optional":true},{"name":"MS SQL","optional":true},{"name":"Power BI","optional":true}],"status":"live","first_seen_at":"2026-10-23T06:52:47Z","employer_posted_date":"2026-10-23","last_verified_at":"2026-11-04T18:14:13Z","board_verified":true,"closed_at":null,"days_open":12,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":12},"description":"Role Summary\nThe role is for a hands-on Data Warehouse Python Developer within the Data Warehouse team. The individual will be responsible for the enhancement, optimisation, support, and modernisation of the Enterprise Data Warehouse platform. The role will focus on designing and delivering cloud-based data solutions using Azure Databricks, Microsoft Fabric, SQL Server, and Python while supporting the migration of the existing on-premise SQL DWH to a modern cloud-based Lakehouse architecture.\nThe role includes responsibility for production support, operational stability, automation, and continuous improvement of business-critical data platforms. The Enterprise Data Warehouse supports critical regulatory, finance, risk, operational, and management reporting requirements across the organisation.\nThe successful candidate will work closely with business stakeholders, business analysts, developers, infrastructure teams, and support teams to deliver scalable and reliable data solutions. The individual will be expected to actively participate in Agile delivery activities, production support, modernisation initiatives, and cloud transformation programmes. The role requires a strong technical background combined with the ability to understand business requirements and translate them into robust technical solutions.\nKey Interfaces\nData Warehouse Development Team\nBusiness Stakeholders\nBusiness Analysts\nInfrastructure and Cloud Engineering Teams\nProduction Support Teams\nDBA Teams\nArchitecture and Security Teams\nRisk, Finance, Operations, and Regulatory Reporting Functions\nThe role supports enterprise-wide data platforms and services that are critical to business operations and regulatory reporting.\nThe Successful Candidate Will\nDesign, develop, and support enterprise data solutions using Azure Databricks and Microsoft Fabric.\nBuild, enhance, and optimise cloud-based ETL/ELT pipelines and data integration processes.\nDevelop and maintain SQL Server databases, stored procedures, views, and performance-tuned solutions.\nDevelop Python-based solutions for data engineering, automation, monitoring, orchestration, and data quality management.\nDrive the modernisation of the Enterprise Data Warehouse from traditional SQL Server-based architecture to a cloud-native Lakehouse architecture.\nImplement and support Medallion (Bronze, Silver, Gold) data models and best practices.\nDesign, maintain, and support AutoSys job schedules, JIL scripting, workflow orchestration, and automation solutions.\nParticipate in production support and on-call support activities for business-critical systems.\nInvestigate, troubleshoot, and resolve production incidents and performance issues.\nContinuously improve operational processes, automation, monitoring, and platform performance.\nCollaborate with business users and technical teams to deliver scalable, resilient, and secure data solutions.\nEnsure adherence to data governance, security, audit, and operational standards.\nContribute to architectural decisions and strategic cloud transformation initiatives.\nExperience\nEducation\nPreferable degree educated in Computer Science, Software Engineering, Information Systems, Data Science, or a related technical discipline.\nPostgraduate qualification in a relevant technology discipline is desirable.\nExperience\nMinimum 10 years' experience in Data Warehouse development and SQL Server development.\nProven track record delivering enterprise-scale Data Warehouse and data engineering solutions.\nExtensive hands-on experience as a Data Warehouse Developer and Python Developer.\nExperience supporting large-scale production environments and business-critical systems.\nDemonstrable experience delivering Data Warehouse modernisation and cloud migration initiatives.\nTechnical Skills\nStrong hands-on experience with Azure Databricks.\nStrong experience designing and implementing solutions using Microsoft Fabric.\nAdvanced SQL Server and T-SQL development skills.\nStrong Python programming and automation skills.\nStrong cloud data engineering and data warehousing experience.\nExperience designing and implementing Lakehouse architectures.\nExperience with Medallion (Bronze, Silver, Gold) data models.\nExperience with AutoSys workload automation, JIL scripting, job scheduling, and dependency management.\nStrong experience in ETL/ELT design and development.\nStrong data modelling and database design skills.\nExperience troubleshooting and tuning complex SQL and data processing workloads.\nKnowledge of CI/CD, DevOps, and automation best practices.\nDesirable\nExperience within Financial Services, Banking, or Capital Markets.\nExperience with Power BI and enterprise analytics platforms.\nExperience with Azure Data Factory.\nMicrosoft Fabric, Azure, Databricks, or r\nAbility to work independently and take ownership of technical delivery.\nAbility to balance project delivery, production support, and strategic initiatives.\nelated cloud certifications.","description_format":"text","description_chars":4941,"description_truncated":false,"requirements":{"experience_years_min":10,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-26T01:49:05Z"}],"visa":[],"liveness":{"score":33,"band":"fade","label":"Fading","p_open":0.9,"p_active":0.41,"p_room":0.9,"age_days":11,"expected_fill_days":29,"reasons":["conf:63","agency","stale_co","urgency","velocity","win:mid","comp:brand"],"computed_at":"2026-11-04T06:34:25Z"},"pay":null,"html_url":"https://alion.io/job/cpl-data-engineer-python-databricks","json_url":"https://alion.io/job/cpl-data-engineer-python-databricks.json","meta":{"generated_at":"2026-11-04T19:10:00Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":29526,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-05T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2268173},"rest":"https://alion.io/mcp/rest/get_company?id=2268173"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcpl-data-engineer-python-databricks"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcpl-data-engineer-python-databricks"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcpl-data-engineer-python-databricks"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/cpl-data-engineer-python-databricks\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcpl-data-engineer-python-databricks"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3255961}},{"tool":"search_jobs","arguments":{"company":"cpl.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3255961},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}