{"id":2433652,"url":"https://alion.io/job/the-codest-data-engineer-w-databricks","title":"Data Engineer w/ Databricks","company":{"id":2884,"name":"The Codest","domain":"thecodest.co","url":"https://alion.io/company/the-codest","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Recruitee","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Warsaw, Poland"],"countries":["PL"],"hiring_countries":["PL"],"hiring_countries_total":1,"salary":{"min":22000,"max":30000,"currency":"PLN","period":"month","gross":null,"usd_annual":91788},"salary_estimate":null,"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"Amazon SageMaker","optional":false},{"name":"AWS","optional":false},{"name":"AWS Lambda","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Docker","optional":true},{"name":"Kubernetes","optional":true}],"status":"live","first_seen_at":"2026-10-13T07:50:40Z","employer_posted_date":"2026-10-13","last_verified_at":"2026-10-13T14:03:35Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Hello World!\nWe are The Codest - International Tech Software Company with tech hubs in Poland delivering global IT solutions and projects. Our core values lie in “Customers and People First” approach that prioritises the needs of our customers and a collaborative environment for our employees, enabling us to deliver exceptional products and services.\nOur expertise centers on web development, cloud engineering, DevOps and quality. After many years of developing our own product - Yieldbird, which was honored as a laureate of the prestigious Top25 Deloitte awards, we arrived at our mission: to help tech companies build impactful product and scale their IT teams through boosting IT delivery performance. Through our extensive experience with product development challenges, we have become experts in building digital products and scaling IT teams.\nBut our journey does not end here - we want to continue our growth. If you’re goal-driven and looking for new opportunities, join our team! What awaits you is an enriching and collaborative environment that fosters your growth at every step.\nWe are currently looking for:\nDATA ENGINEER w/ DATABRICKS\nHere, you will have an opportunity to contribute to a banking app for one of the leading financial groups in Japan. The platform is equipped with bank modules and data management features and it is customer-facing as well. We are seeking an experienced Databricks Engineer to design, build, and manage scalable data solutions and pipelines using Databricks. You’ll work closely with cross-functional teams to ensure data is reliable, accessible, and efficient to power analytics and business intelligence initiatives.\nYour Responsibilities:\nExperience with Medallion Architecture (Bronze, Silver, Gold) for lakehouses using optimized performance patterns\n\nBuild strong data quality frameworks with automated testing and monitoring\n\nImplement Delta Lake features such as time travel, vacuum operations, and Z-ordering\n\nDevelop and maintain complex ETL/ELT pipelines processing large-scale datasets daily\n\nDesign and implement CI/CD workflows for data pipelines using Databricks Asset Bundles or equivalent tools\n\nCreate real-time and batch data processing solutions with Structured Streaming and Delta Live Tables\n\nOptimize Spark jobs for cost efficiency and performance, leveraging cluster auto-scaling and resource management\n\nDevelop custom integrations with Databricks APIs and external systems\n\nDesign scalable data architectures using Unity Catalog, Delta Lake, and Apache Spark\n\nEstablish data mesh architectures with governance and lineage tracking\n\nRequirements\nKey Requirements:\n6+ years of experience in data engineering, with a strong track record of designing and deploying production-grade data pipelines and ETL/ELT workflows\n\nProficiency in Python, PySpark, and SQL\n\nExtensive hands-on experience with AWS services such as Glue, Lambda, Redshift, and S3\n\nSolid background in data governance and management tools, including platforms like Unity Catalog and AWS Sagemaker Unified Studio\n\nProven experience in data migration initiatives and modernizing legacy systems\n\nCommunicative English language skills (the project is in an international team)\n\nNice to have:\nDatabricks Certified Professional Data Engineer (or equivalent certification)\n\nExcellent communication and teamwork skills\n\nStrong analytical thinking and problem-solving ability\n\nExperience with containerization and orchestration tools (e.g., Docker, Kubernetes) is considered an advantage\n\nRecruitment process:\n30 minute screening call online with our recruiter\n\n45min-60min technical call with one of our engineers\n\n1h call with the team leader\n\nOffer\n\nQuestions, insights? Feel free to reach out to our recruiting team:\n\nIn the meantime, feel free to visit our website where you can find key facts about us.","description_format":"text","description_chars":3866,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"Upper-Intermediate (B2)","optional":false}]},"benefits":[],"hiring_locations":[{"name":"Poland","iso":"PL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Outsourcing & Dedicated Teams","Custom Software Development","IT Staffing & Staff Augmentation"],"lifecycle":[{"event":"open","at":"2026-10-13T10:09:14Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":56,"reasons":["conf:3","win:early"],"computed_at":"2026-10-13T17:12:11Z"},"pay":{"stated_usd_annual":91788,"is_top_pay":false},"html_url":"https://alion.io/job/the-codest-data-engineer-w-databricks","json_url":"https://alion.io/job/the-codest-data-engineer-w-databricks.json","meta":{"generated_at":"2026-10-13T17:12:11Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":26219,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-14T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2884},"rest":"https://alion.io/mcp/rest/get_company?id=2884"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fthe-codest-data-engineer-w-databricks"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fthe-codest-data-engineer-w-databricks"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fthe-codest-data-engineer-w-databricks"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/the-codest-data-engineer-w-databricks\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fthe-codest-data-engineer-w-databricks"}]}