{"id":3518997,"url":"https://alion.io/job/remodevs-senior-data-engineer-aws-databricks","title":"Senior Data Engineer - AWS / Databricks","company":{"id":4184353,"name":"RemoDevs","domain":"remodevs.com","url":"https://alion.io/company/remodevs","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Traffit","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"contractor","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Warsaw, Poland","Wrocław, Poland","Kraków, Poland","Gdańsk, Poland","Poznań, Poland"],"countries":["PL"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":62000,"max_usd":101000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":111},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon Kinesis","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"AWS Lambda","optional":false},{"name":"Azure","optional":false},{"name":"Databricks","optional":false},{"name":"dbt","optional":false},{"name":"Delta Lake","optional":false},{"name":"GCP","optional":false},{"name":"Machine Learning","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Apache Kafka","optional":true},{"name":"CI/CD","optional":true},{"name":"CloudFormation","optional":true},{"name":"Google BigQuery","optional":true},{"name":"LLM","optional":true},{"name":"MLFlow","optional":true},{"name":"Snowflake","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-10-30T09:29:31Z","employer_posted_date":null,"last_verified_at":"2026-10-30T09:29:31Z","board_verified":false,"closed_at":null,"days_open":1,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":1},"description":"About Dateonic & the project\nBig Data and AI are in our DNA, with Databricks at the core of our innovation. Founded by engineers and architects passionate about tackling complex data challenges, Dateonic combines industry-leading technical expertise with a product-focused approach to turn raw data into actionable intelligence. Our culture is driven by three core values: Passion, Community, and Commitment. We love tough problems, support each other through close collaboration, and deliver what we promise without taking shortcuts.\nIn this outsourcing role, you will represent Dateonic on a long-term initiative with a global leader in experience innovation. Our partner operates at the intersection of data, AI, creativity, and technology to build modern digital platforms for world-renowned enterprise brands. Joining this project allows you to work on high-impact, global architecture while enjoying the support, engineering community, and technical mentorship of the Dateonic team.\nThe role\nWe are looking for an experienced Senior Data Engineer to design, build, and optimise modern, cloud-based data platforms powering analytics, AI, and data products. Beyond technical delivery, we value professionals who are genuinely curious about the business context behind the numbers, applying practical analysis and experience to help shape requirements rather than simply implementing them as given.\nOur project work is centred on AWS with Databricks, alongside growing demand for GCP, including cloud migration programmes. Azure and Fabric experience is also valued. We look for T-shaped engineers with deep expertise in one primary cloud who are adaptable and eager to broaden their multi-cloud capabilities.\nResponsibilities\nDesign, implement, and optimise scalable batch, streaming, and near-real-time data platforms using Apache Spark and Delta Lake, primarily on AWS and Databricks (with GCP or Azure/Fabric where project streams require).\n\nBuild robust ingestion, transformation, and curation workflows for structured and unstructured data, applying lakehouse patterns and medallion layering (bronze, silver, gold).\n\nSupport cloud-to-cloud migrations, including re-platforming legacy pipelines, data models, and storage layers.\n\nDeliver production-grade, model-ready datasets and build data pipelines for machine learning, causal modelling, and GenAI use cases (such as LLMs, vector search, RAG, and agent-based architectures).\n\nDesign logical and physical data models for analytical and operational use cases, orchestrating automated workflows with Databricks Workflows, Airflow, dbt, or cloud-native equivalents.\n\nEnforce enterprise data governance, lineage, quality frameworks, and granular access controls (RBAC/ABAC) using Unity Catalog, AWS Lake Formation, or equivalent cloud tools.\n\nImplement robust platform observability, monitoring data freshness, pipeline reliability, cost efficiency, and SLA compliance.\n\nBuild serving layers (APIs, feature inputs, analytical endpoints) and partner closely with data scientists, ML engineers, and business stakeholders to challenge requirements and surface better architectural solutions.\n\nMust-have requirements\nStrong hands-on experience with Apache Spark, Delta Lake, and production-grade batch and streaming pipeline development.\n\nAdvanced programming skills in Python and SQL with a solid grasp of data modelling, data quality, and governance principles.\n\nProven, demonstrable hands-on experience with the Databricks Lakehouse Platform, ideally on AWS (utilising services such as S3, Glue, EMR, Redshift, Kinesis, Lambda).\n\nDeep technical expertise in at least one major cloud (AWS, GCP, or Azure/Fabric) paired with an openness to work across clouds (candidates with strong Azure/Fabric experience are welcome provided they want to expand multi-cloud skills).\n\nSolid understanding of distributed systems, lakehouse architectures, scalability, and system performance tuning.\n\nA proactive, consultative mindset: comfortable asking probing questions, challenging assumptions, and collaborating effectively in cross-functional agile teams.\n\nNice to have\nHands-on experience across multiple clouds or direct experience in cloud-to-cloud migrations (for example, Azure to GCP).\n\nPractical experience with Google Cloud Platform services (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Dataproc).\n\nFamiliarity with Snowflake.\n\nHands-on exposure to GenAI data pipelines, vector databases, and LLM data preparation.\n\nExperience with Infrastructure as Code (Terraform, CloudFormation) and CI/CD pipelines for automated data deployments.\n\nKnowledge of event streaming technologies (such as Apache Kafka) or ML/experimentation tooling (such as Databricks MLflow).\n\nTech stack\nApache Spark\nPython\nSQL\nDatabricks\nDelta Lake","description_format":"text","description_chars":4768,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-30T11:25:45Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":28,"reasons":["seen:0","win:early"],"computed_at":"2026-10-31T05:58:55Z"},"pay":null,"html_url":"https://alion.io/job/remodevs-senior-data-engineer-aws-databricks","json_url":"https://alion.io/job/remodevs-senior-data-engineer-aws-databricks.json","meta":{"generated_at":"2026-10-31T17:15:48Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":27034,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-01T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4184353},"rest":"https://alion.io/mcp/rest/get_company?id=4184353"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fremodevs-senior-data-engineer-aws-databricks"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fremodevs-senior-data-engineer-aws-databricks"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fremodevs-senior-data-engineer-aws-databricks"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/remodevs-senior-data-engineer-aws-databricks\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fremodevs-senior-data-engineer-aws-databricks"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3518997}},{"tool":"search_jobs","arguments":{"company":"remodevs.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3518997},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}