{"id":3401887,"url":"https://alion.io/job/optiveum-azure-databricks-engineer","title":"Azure Databricks Engineer","company":{"id":685848,"name":"Optiveum","domain":"optiveum.com","url":"https://alion.io/company/optiveum","size_band":null,"is_staffing_agency":true,"employer_type":"agency","is_intermediary":false,"listed_via":null,"ats_vendor":"Teamtailor","truth_index":null},"role":"DevOps","role_family":"DevOps","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Kraków, Poland"],"countries":["PL"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":135,"max":160,"currency":"PLN","period":"hour","gross":null,"usd_annual":82000},"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS Glue","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure SQL Database","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"Flink","optional":false},{"name":"Hadoop","optional":false},{"name":"HBase","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"MS SQL","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Unix","optional":false}],"status":"live","first_seen_at":"2026-10-28T13:16:54Z","employer_posted_date":"2026-10-28","last_verified_at":"2026-10-31T17:08:52Z","board_verified":true,"closed_at":null,"days_open":3,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":3},"description":"Azure Databricks Engineer\nAbout the Offer\nWe are currently looking for an Azure Databricks Engineer to join the team of one of the world's leading global investment banks. The project is delivered together with a large international IT services company. For this role, Optiveum is the recruitment and contracting party, which means you will sign the cooperation agreement directly with us.\nYou will design and build big data solutions in Azure Databricks for batch and real-time analytics, working with Delta Lake, PySpark, Kafka streaming and the Lakehouse / Medallion architecture.\nKey Details:\nRate: 135-160 PLN/h (B2B), depending on experience\n\nWork Model: Hybrid, 3 days per week from the client's office (non-negotiable), full-time\n\nLocation: Kraków (candidates must live in or near Kraków)\n\nResponsibilities:\nDesign and implement big data solutions in Azure Databricks for batch and real-time analytics use cases\n\nBuild Spark pipelines that populate downstream data marts for BI and generate feeds for Data Science\n\nIntegrate real-time services that process business events from Kafka and persist them in ADLS Gen2 using Databricks\n\nDevelop near real-time stream processing to derive features for ML model inference\n\nOptimise Databricks performance (liquid clustering, vacuum, Z-ordering etc.)\n\nWork with DevOps teams to drive operationally excellent infrastructure\n\nRequirements:\nBachelor's degree or higher in Computer Science, Engineering or Science\n\n8-10 years of experience, including 5+ years with Azure cloud-native services\n\nStrong hands-on experience with Azure Databricks, Delta Lake, Python / PySpark and Spark\n\nKnowledge of Lakehouse, Data Mesh, Data Virtualisation, dimensional modelling and data aggregation techniques\n\nExperience building distributed data platforms (e.g. Spark, Kafka, Flink, HBase) at large scale\n\nHadoop-based implementations, SQL / T-SQL, Unix and Hive\n\nAzure Data Factory, ADLS Gen2 and Azure SQL Database\n\nGood understanding of RDBMS, Data Lake, Data Warehouse, Lakehouse and Medallion Architecture\n\nAt least one workflow orchestration tool (Apache Airflow, Luigi, Oozie, AWS Glue or similar)\n\nKnowledge of Microsoft Fabric and basic understanding of data quality dimensions\n\nFluent English\n\nPolish or EU citizenship, or a permanent residence / work permit valid for at least 12 months\n\nRecruitment Process:\nOne interview with the IT services partner, followed by 1-3 interviews with the bank\n\nTechnical tasks are done live: please have your programming environment set up and tested beforehand. The use of AI tools, coding assistants or code generators during interviews is not allowed\n\nThe selected candidate will go through a background check by an external company (HireRight), covering identity, right to work, education and employment history, so the dates and employers in your CV must be accurate\n\nYour name in the application and CV must match your official ID document exactly (Polish citizens: please include all first names)\n\nCandidates who took part in a recruitment process for this IT services partner or this bank in the last 12 months cannot be considered","description_format":"text","description_chars":3116,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[{"language":"Polish","level":"All levels","optional":false},{"language":"English","level":"Advanced (C1)","optional":false}]},"benefits":[],"hiring_locations":[{"name":"Poland","iso":"PL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-28T14:48:21Z"}],"visa":[],"liveness":{"score":54,"band":"ok","label":"Likely open","p_open":1,"p_active":0.542,"p_room":1,"age_days":2,"expected_fill_days":22,"reasons":["conf:2","agency","velocity","win:early"],"computed_at":"2026-10-31T05:58:55Z"},"pay":{"stated_usd_annual":82000,"is_top_pay":false},"html_url":"https://alion.io/job/optiveum-azure-databricks-engineer","json_url":"https://alion.io/job/optiveum-azure-databricks-engineer.json","meta":{"generated_at":"2026-10-31T17:17:12Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":27085,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-01T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":685848},"rest":"https://alion.io/mcp/rest/get_company?id=685848"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Foptiveum-azure-databricks-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Foptiveum-azure-databricks-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Foptiveum-azure-databricks-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/optiveum-azure-databricks-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Foptiveum-azure-databricks-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3401887}},{"tool":"search_jobs","arguments":{"company":"optiveum.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3401887},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}