{"id":2793538,"url":"https://alion.io/job/red-badger-databricks-engineer-contract","title":"DataBricks Engineer - Contract","company":{"id":14527,"name":"Red Badger","domain":"red-badger.com","url":"https://alion.io/company/red-badger","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":83,"open_postings":16,"ghost_share":0,"stale_share":0.688,"repost_share":0,"time_to_fill_p50_days":23,"computed_at":"2026-10-22T06:10:10Z"}},"role":"Data Science","role_family":"Data Science","seniority":"junior","employment_type":"contractor","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["London, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":54000,"max_usd":106000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":16},"experience_years_min":2,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"AI Agents","optional":false},{"name":"Amazon Kinesis","optional":false},{"name":"Amazon S3","optional":false},{"name":"Amazon SageMaker","optional":false},{"name":"AWS","optional":false},{"name":"AWS Bedrock","optional":false},{"name":"AWS Bedrock AgentCore","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Databricks","optional":false},{"name":"dbt","optional":false},{"name":"DynamoDB","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"PostgreSQL","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Scala","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-07-08T13:37:07Z","employer_posted_date":"2026-07-08","last_verified_at":"2026-10-22T08:04:39Z","board_verified":true,"closed_at":null,"days_open":105,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":105},"description":"DataBricks Engineer\nYou must have\n At least 2 years of commercial Databricks experience (current)\nStrong AWS Skills\nBe able to work 2 days a week onsite in Central London\nIdeally have worked on a large scale DataBricks migration project previously\nStrong understanding of Medallion Architecture\nDataBricks certification would be welcome but we prefer hands on experience over theoretical\n\nAbout Red Badger \nWe’re a tech and product consultancy, building enterprise software products for blue chip companies, multinationals and PLC’s. The best thing about Red Badger is; of course; the team. We’ve been around for 15+ years now and we are over 120 strong. We are really proud of our people; we support and learn a lot from each other; we work really hard but have fun doing it. We are a diverse group made up of 22 different nationalities, speaking 17 different languages. Headquartered in London we also have offices in Leeds and Cape Town. \nThe Role\nRed Badger is looking for a DataBricks Engineer to join our Data & AI practice. This is a delivery-focused role: you'll work directly with clients and Red Badger consultants, from all the cross functional disciplines, to shape complex technical solutions as an output from discovery phase, and then lead a team of data engineers to build the solution through to production. You'll work closely with the Director, Data & AI, and partner on pre-sales and proposals to add technical credibility and deepen our client partnerships.\nYou love solving complex problems, and customer value is your north star. You are comfortable consulting with technology stakeholders outside of your team. You are a technology polyglot, and an evangelist for agile ways of working.\nDay to day, you will spend roughly half of your time hands on, pairing with data engineers on the team, and helping them pick the right design to solve the problem. In the other half, you’ll be supporting the other functions (delivery, product, software engineering) and our clients with decisions impacted by the technical strategy of the project and providing support and line management to data engineers on your team.\n\nKey Responsibilities\nDiscipline Expertise and Leadership \n Technology breadth: Deep, production-grade experience across AWS &/or Azure native services, with expert-level Databricks and/or Snowflake and an Agile delivery mindset.Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse, \nProcessing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt\nData management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog / DataZone\nAI: Bedrock (including AgentCore) and SageMaker AI\nStorage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse\nProcessing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt\nData management & metadata: Purview\nAI: Foundry, (including Agent Service), ML\n\nOn AWS, you're fluent across the core services, for example: \nOn Azure, you’re fluent across the core services, for example:\nData Product mentality: You build Data Products where every pipeline and dataset is discoverable, addressable and secure by design.\nData capabilities: You know the full data lifecycle, from discovery, storage, pipelines, ETL and streaming to data quality, governance, metadata management and cataloguing, through to advanced analytics and decision-making.\n AI: You understand how AI is built and deployed in modern data platforms (Databricks, Snowflake) and cloud-native services like Amazon Bedrock, with enough depth to guide teams and advise clients, spanning LLMs and SLMs, agentic automation, Human in the Loop and MLOps.\n Data Architecture Design: You know when to use RAG (Retrieval-Augmented Generation), Serverless, DWH models, Data Mesh, Data Fabric, Medallion and Data Products.\nHands on mindset: Fluent in the language of data, whether SQL, Python, PySpark, R or Scala. Open formats including Parquet, Iceberg and JSON.\nAgile Ways of Working\nRun and contribute to agile ceremonies, helping to shape and improve the agile process\nWork with the project’s delivery manager and product owner to lead the team in delivering high quality digital products\nLead and support your peers in technical conversations\nBe an advocate for lean development, building for what is required now\nPairing with other members of the team, including designers\nConsulting with Clients\nOwn the relationship with the client’s technical stakeholders\nProactively engage with clients to shape and move the project forward, including giving updates on the delivery progress and highlighting potential technical blockers\nUpskilling and embedding modern data practices in client teams where necessary\nLeadership & Influence \nData Leadership: A proven track record of managing and inspiring teams, navigating enterprise-scale problems and turning them into opportunities for clients.\nPeople-first leadership: You guide, mentor and grow your team, bring the Red Badger culture with you, and build effective, high-trust teams where everyone is heard and valued.\nStakeholder Artistry: You are a master of client-facing delivery. You can translate complex data concepts into business value, managing multi-vendor environments with a focus on long-term partnership. Lanyards off, you embed as one team rather than an outside supplier.\nDesigning for People and Purpose: Your expertise goes beyond just building scalable architectures; you design systems with a focus on delivering value. You ensure that your extensible and scalable solutions are implemented because they consistently meet the evolving needs of both the business and its users.\n\nYour experience \nIt’d be great if you \nQuality Advocate: You take pride in the integrity of your work, championing quality assurance and performance tuning so the data solutions we build are robust, reliable and respected.\nIndustry Stewardship: A lifelong learner who keeps a pulse on industry standards and best practice.\nPartnership Focus: You build strong relationships with technology partners, established or new, to deliver the best outcomes for clients.\nYou care deeply about high-quality work that delivers real value\nYou're comfortable with ambiguity and solving complex problems collaboratively\nYou bring strong expertise in your craft, alongside a willingness to keep learning\nYou communicate clearly and build trust fast with clients, data engineering leaders and data and software engineers\nYou're pragmatic, adaptable, outcome-focused and low-ego in multidisciplinary teams\nYou lead with a people-first attitude, helping others grow and making sure people are heard, valued and set up to thrive\n It’d be amazing if you can also \nNegotiate SLAs and SLOs with the business and supporting teams\nHelp shaping and resourcing technical teams\nArticulate commercial objectives into a technical strategy\nShow a track record of owning the tech leadership on complex data projects, setting the technical vision for the project and managing technical stakeholders\nCoach and line manage data engineers and data delivery individuals who are starting their line management journey\nBe a part of the public face of the company in media and at meetups, conferences, etc.","description_format":"text","description_chars":7228,"description_truncated":false,"requirements":{"experience_years_min":2,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["UI/UX Design","IT Consulting & Digital Transformation","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-17T21:17:55Z"}],"visa":[{"country":"GB","licensed_sponsor":true,"evidence":"Licensed UK visa sponsor (Skilled Worker)","filings_12m":null,"filings_prev_12m":null,"green_card_filings_12m":null,"median_offered_wage_usd":null,"route":"Skilled Worker","cap_exempt":false,"checked_at":"2026-10-22T06:27:10+00:00","sources":["UK Home Office: register of licensed sponsors (workers)"],"filings_for_role_12m":0}],"liveness":{"score":7,"band":"cold","label":"Long shot","p_open":1,"p_active":0.235,"p_room":0.28,"age_days":105,"expected_fill_days":23,"reasons":["conf:1","stale_co","urgency","velocity","win:tail","crowd:junior"],"computed_at":"2026-10-22T06:10:10Z"},"pay":null,"html_url":"https://alion.io/job/red-badger-databricks-engineer-contract","json_url":"https://alion.io/job/red-badger-databricks-engineer-contract.json","meta":{"generated_at":"2026-10-22T09:42:48Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":6593,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-23T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":14527},"rest":"https://alion.io/mcp/rest/get_company?id=14527"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fred-badger-databricks-engineer-contract"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fred-badger-databricks-engineer-contract"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fred-badger-databricks-engineer-contract"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/red-badger-databricks-engineer-contract\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fred-badger-databricks-engineer-contract"}]}