{"id":2112730,"url":"https://alion.io/job/hubquest-senior-data-engineer","title":"Senior Data Engineer","company":{"id":3932832,"name":"HubQuest","domain":"hubquest.pl","url":"https://alion.io/company/hubquest","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"contractor","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Warsaw, Poland","Kraków, Poland","Wrocław, Poland","Poznań, Poland","Katowice, Poland"],"countries":["PL"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":200,"max":240,"currency":"PLN","period":"hour","gross":null,"usd_annual":122000},"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"LLM","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-09-09T09:09:57Z","employer_posted_date":null,"last_verified_at":"2026-09-09T09:09:57Z","board_verified":false,"closed_at":null,"days_open":50,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":50},"description":"We are a team of tech enthusiasts on a mission to bring together the best minds in IT services and analytics. Our goal? To build cutting-edge IT and Analytical Hubs that empower our partners to become truly data-driven organizations.\nFor our client’s Data Management & Data Foundation area, we are looking for an exceptional Senior Data Engineer – a highly experienced, hands-on engineer who can independently take ownership of complex technical challenges and turn them into robust, scalable solutions.\nThis is not a maintenance-focused or business-as-usual role. You will join a high-seniority engineering group working on strategic and technically challenging initiatives, moving between projects depending on priorities and where the strongest engineering expertise is needed.\nThe wider Data Management organization consists of approximately 30 engineers and technology specialists, while this role will focus primarily on a selected set of high-impact initiatives.\nThis is a role for someone who enjoys building things, solving difficult engineering problems, and having a real technical impact rather than simply executing predefined tasks.\nYou will contribute to several strategic projects within the Data Management domain, including:\nData platform migration to Databricks\nMigration and modernization of existing data management capabilities into the Databricks ecosystem, including engineering support, platform integration, and implementation of new Databricks-based solutions.\nAI-powered data discovery solution\nDevelopment of a new approach to enterprise data discovery.\nThe solution combines capabilities such as Databricks, Unity Catalog, AI-powered data discovery, RAG, and conversational interfaces to create a chat-based experience that helps business units discover and understand available data.\nInstead of relying on numerous manual discovery sessions with individual operating companies, the aim is to enable users to explore datasets, metadata, and available data products through an intelligent conversational interface.\nData Foundation\nDevelopment and evolution of the organization’s Data Foundation in Databricks, creating scalable technical foundations that can be reused across teams, markets, and data products.\nWho will succeed in this role?\nYou are likely to enjoy this position if you:\nare a strong engineer first and foremost;\nlike coding and still want coding to be a significant part of your daily work;\nare comfortable being given a difficult problem rather than a detailed list of implementation steps;\ncan work independently and make sound technical decisions;\nnaturally look for improvements instead of accepting existing solutions as fixed;\nenjoy exploring new technologies and translating them into practical enterprise solutions;\nare comfortable moving between different initiatives and technical contexts;\ncan discuss architecture with senior engineers and architects while remaining deeply hands-on;\nprefer an environment where technical competence, ownership, and initiative matter more than job titles.\n\nWhat we offer\nOpportunity to work on high-impact, strategic data initiatives rather than repetitive business-as-usual development.\nSignificant technical ownership and freedom in how problems are solved.\nHands-on work with Azure, Databricks, Python, PySpark, SQL, and emerging AI capabilities.\nExposure to modern applications of AI and RAG in enterprise data management and discovery.\nOpportunity to influence technical architecture and engineering practices.\nCollaboration with experienced engineers and architects across an international technology organization.\n\nWe are looking for someone who can operate at a genuinely senior level – a strong coder, an independent problem solver, and an engineer who brings ideas rather than waits for instructions.\nIf this sounds like the kind of engineering environment in which you do your best work, we’d like to hear from you.\nZakres obowiązków\nDesign, develop, and optimize complex data solutions and data pipelines on Azure and Databricks.\nTake end-to-end technical ownership of assigned engineering problems – from understanding the challenge through solution design, implementation, testing, and production deployment.\nWrite high-quality, production-grade code using Python, PySpark, and SQL.\nWork extensively with Azure Databricks and modern capabilities of the Databricks ecosystem.\nExplore and implement AI-enabled capabilities within the data platform, including solutions involving Databricks AI features, RAG-based approaches, data discovery, and conversational access to enterprise data.\nContribute to the migration and modernization of existing data platforms and solutions into Databricks-based architectures.\nWork with Unity Catalog and contribute to scalable approaches to data discovery, governance, and access.\nSolve technically difficult or non-standard problems where there may not be an existing blueprint or ready-made solution.\nProactively identify opportunities to improve architecture, performance, scalability, reliability, and maintainability.\nChallenge existing approaches when you see a better technical solution and actively contribute your own ideas.\nCollaborate with Data Engineers, Architects, Product Owners, DataOps, QA, DevOps, and other technology teams.\nSupport architectural discussions and contribute to technical design decisions across the Data Management landscape.\nMove between strategic initiatives as priorities evolve, bringing strong engineering expertise wherever it is most needed.\nWymagania\nMust-have skills\n8+ years of professional experience in Data Engineering, Software Engineering, or a closely related field.\nStrong, hands-on commercial experience with Azure Databricks.\nVery good knowledge of the Azure cloud ecosystem and cloud-based data architectures.\nExcellent programming skills in Python – we are looking for a strong coder, not someone who only uses Python for basic notebook development.\nAdvanced PySpark skills and experience working with large-scale data processing workloads.\nAdvanced SQL, including complex transformations, optimization, and analytical/window functions.\nStrong understanding of data engineering principles, ETL/ELT patterns, data pipelines, distributed processing, and production data platforms.\nExperience designing and delivering solutions independently, with limited supervision.\nAbility to understand an unfamiliar technical problem, propose an approach, and drive it through to implementation.\nStrong troubleshooting and problem-solving skills.\nExperience working with production-grade engineering practices, including version control, testing, CI/CD, monitoring, and deployment processes.\nStrong understanding of software development principles and the ability to produce clean, maintainable, well-structured code.\nHigh level of ownership, independence, and proactivity.\nExcellent English communication skills, both written and spoken\n\nWe will be especially interested in candidates who also bring:\nHands-on experience with AI capabilities within Databricks and modern AI-enabled data solutions.\nExperience with RAG architectures, LLM-based applications, or conversational interfaces built on enterprise data.\nExperience with Databricks Genie or similar conversational data discovery capabilities.\nStrong knowledge of Unity Catalog.\nExperience migrating enterprise data platforms or data management solutions to Databricks.\nUnderstanding of data cataloguing, metadata management, lineage, governance, and data discovery.\nStrong awareness of solution and data architecture and the ability to contribute meaningfully to architectural decisions.\nExperience designing reusable frameworks, components, or engineering standards rather than only individual pipelines.\nPerformance optimization experience in Databricks / Spark environments.\nExperience with Azure DevOps and mature CI/CD practices for data solutions.\n\nArchitectural experience is not a prerequisite, but a Senior Data Engineer who combines excellent coding skills with strong architectural awareness would be an especially good fit.\nTech stack\nDatabricks\nPython\nPySpark\nSQL\nData engineering\nAzure\nData architecture\nUnity Catalog\nCI/CD\nETL\nELT\nLLM\nAI\nRAG\nAzure DevOps\nSpark\nArchitectural experience","description_format":"text","description_chars":8239,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-08T22:25:03Z"}],"visa":[],"liveness":{"score":11,"band":"cold","label":"Long shot","p_open":0.4,"p_active":0.589,"p_room":0.45,"age_days":49,"expected_fill_days":28,"reasons":["seen:49","win:tail"],"computed_at":"2026-10-29T05:49:05Z"},"pay":{"stated_usd_annual":122000,"is_top_pay":false},"html_url":"https://alion.io/job/hubquest-senior-data-engineer","json_url":"https://alion.io/job/hubquest-senior-data-engineer.json","meta":{"generated_at":"2026-10-29T21:57:51Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":32396,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3932832},"rest":"https://alion.io/mcp/rest/get_company?id=3932832"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fhubquest-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fhubquest-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fhubquest-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/hubquest-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fhubquest-senior-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":2112730}},{"tool":"search_jobs","arguments":{"company":"hubquest.pl","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":2112730},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}