{"id":2116273,"url":"https://alion.io/job/hiberus-spark-data-lakehouse-developer","title":"Spark / Data Lakehouse Developer","company":{"id":53912,"name":"Hiberus","domain":"hiberus.com","url":"https://alion.io/company/hiberus","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Traffit","truth_index":{"grade":"C","score":67,"open_postings":93,"ghost_share":0.548,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-12T06:55:09Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CI/CD","optional":false},{"name":"Delta Lake","optional":false},{"name":"Docker","optional":false},{"name":"Dynatrace","optional":false},{"name":"Grafana","optional":false},{"name":"Kanban","optional":false},{"name":"Kubernetes","optional":false},{"name":"OpenTelemetry","optional":false},{"name":"Prometheus","optional":false},{"name":"pySpark","optional":false},{"name":"Scrum","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Python","optional":true}],"status":"live","first_seen_at":"2026-09-01T07:46:34Z","employer_posted_date":"2026-09-01","last_verified_at":"2026-10-12T23:41:31Z","board_verified":true,"closed_at":null,"days_open":41,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":40},"description":"Więcej niż jeden projekt. Więcej niż jeden rynek.\nJesteśmy częścią Hiberus, firmy technologicznej wywodzącej się z Hiszpanii z silną pozycją na rynku polskim: 4700+ specjalistów, obecnej w 14+ krajach i realizującej projekty dla klientów na całym świecie.\nPracujemy z technologiami AI, Data, Cloud, Software Development, BI i Cybersecurity. Ale przede wszystkim stawiamy na ludzi - gdy jeden projekt się kończy, szukamy kolejnych możliwości w ramach Hiberus, również w innych krajach.\nNaszą wartość dodatkową stanowi Hiberus University - międzynarodowe środowisko i realna możliwość rozwijania swoich kompetencji. Ponad tysiąc osób przeszkolonych w zeszłym roku z wybranych technologii.\nPierwszy projekt to początek. Z Hiberus możesz budować swoją karierę długoterminowo.\nRequirements\nMore Than One Project. More Than One Market.\nWe are part of Hiberus, a technology company founded in Spain with a strong presence in the Polish market: 4,700+ specialists, operating in 14+ countries and delivering projects for clients worldwide.\nWe work with technologies including AI, Data, Cloud, Software Development, BI, and Cybersecurity. But above all, we put people first. When one project comes to an end, we look for new opportunities within Hiberus - including projects in other countries.\nOne of our key advantages is Hiberus University - an international learning environment offering real opportunities to develop and expand your skills. More than 1,000 people were trained last year in selected technologies.\nYour first project is just the beginning. With Hiberus, you can build a long-term career.\nBenefits\nDla naszego Klienta z sektora finansowego poszukujemy doświadczonego Spark / Data Lakehouse Developera, który dołączy do zespołu Data Platform.\nOsoba na tym stanowisku będzie odpowiedzialna za projektowanie i rozwój rozwiązań do rekoncyliacji i synchronizacji danych w warstwie ODS (Operational Data Store), opartych na MongoDB, a także za budowę i utrzymanie warstw danych w architekturze Data Lakehouse - od surowych danych po warstwy Curated, Silver i Gold.\nGłówne obowiązki :\nProjektowanie i implementacja procesów Spark SQL/PySpark do walidacji i porównywania danych (MongoDB/ODS).\nImplementacja reguł jakości danych, detekcji duplikatów, anomalii i braków oraz raportowania/alertowania.\nIntegracja i optymalizacja Spark-MongoDB (MongoDB Spark Connector, partitioning, push-down, schema-aware reads).\nProjektowanie warstwy danych Raw → Bronze → Silver → Gold z wykorzystaniem Delta Lake/Iceberg/Hudi oraz CI/CD dla schematów i migracji.\nMonitoring i observability procesów Spark/batch/stream (Prometheus, Grafana, OpenTelemetry, Dynatrace) oraz definiowanie SLA/SLO.\nAutomatyzacja deploymentów Spark na Docker/Kubernetes (Spark Operator).\nDiagnozowanie problemów z danymi, wydajnością i opóźnieniami procesów.\nTworzenie dokumentacji technicznej, runbooków i diagramów przepływu danych.\nWspółpraca w Scrum/Kanban z Data Engineerami, BA, testerami i DevOps; prowadzenie warsztatów i code review.","description_format":"text","description_chars":3005,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Cybersecurity","Information Security"],"lifecycle":[{"event":"open","at":"2026-10-08T23:24:28Z"}],"visa":[],"liveness":{"score":12,"band":"cold","label":"Long shot","p_open":1,"p_active":0.338,"p_room":0.35,"age_days":40,"expected_fill_days":20,"reasons":["conf:3","stale_co","velocity","win:tail"],"computed_at":"2026-10-12T06:55:09Z"},"pay":null,"html_url":"https://alion.io/job/hiberus-spark-data-lakehouse-developer","json_url":"https://alion.io/job/hiberus-spark-data-lakehouse-developer.json","meta":{"generated_at":"2026-10-13T01:40:39Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2412,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-14T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":53912},"rest":"https://alion.io/mcp/rest/get_company?id=53912"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fhiberus-spark-data-lakehouse-developer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fhiberus-spark-data-lakehouse-developer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fhiberus-spark-data-lakehouse-developer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/hiberus-spark-data-lakehouse-developer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fhiberus-spark-data-lakehouse-developer"}]}