{"id":744150,"url":"https://alion.io/job/sparta-staff-data-engineer","title":"Staff Data Engineer","company":{"id":445445,"name":"Sparta","domain":"spartacommodities.com","url":"https://alion.io/company/sparta-4","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"staff","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["London, United Kingdom","Barcelona, Spain","Madrid, Spain"],"countries":["GB","ES"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":96000,"max_usd":219000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":369},"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Flink","optional":false},{"name":"GCP","optional":false},{"name":"Kotlin","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"Redis","optional":false},{"name":"Spark","optional":false},{"name":"TypeScript","optional":false},{"name":"AI Agents","optional":true},{"name":"Apache Iceberg","optional":true},{"name":"dbt","optional":true}],"status":"live","first_seen_at":"2026-06-25T09:51:46Z","employer_posted_date":"2026-11-04","last_verified_at":"2026-11-07T03:04:40Z","board_verified":true,"closed_at":null,"days_open":134,"trust":{"level":"ok","repost_count":1,"flags":[],"days_open":133},"description":"We Are Sparta\nSparta is the AI leader for commodity trading, home to Leonidas AI, the first operating system for oil and commodity traders.\nBacked by $42 million in Series B funding led by One Peak, with participation from returning investors FirstMark and Singular, the same investors behind AI leaders like Legora, Dataiku, and Synthesia. Most companies are building a chatbot on top of data. We've built an agent with an actual reasoning layer, grounded in years of proprietary market data and in-house trading expertise nobody else has.\nWe're scaling fast, and it's an exciting time to join. From independents to multinationals, the world's leading commodity teams use Sparta and Leonidas AI to move faster, trade smarter, and stay ahead of the market.\nAt Sparta, you'll be trusted to take ownership, backed by a team who wants you to succeed. AI is how we build here, not just what we sell. Good ideas move fast, and yours could go from staging to production in a couple of hours, whatever department you're in. You'll be challenged, supported, and given room to grow, building the AI that's changing how commodity trading gets done.\nYour work has reach. From shaping Leonidas AI, to powering smarter decisions for traders around the world, to changing how commodity trading is done. And because we're growing fast, you'll accelerate your career with a level of ownership and impact you simply won't get at bigger, slower-moving companies.\nStaff Data Engineer\nAt Sparta, we're on a mission to build the next generation of commodity trading platforms - replacing the fragmented tools traders depend on with a single, powerful dashboard. Our product is a data-driven platform that aggregates real-time feeds from across the commodities domain, transforming them into intuitive, actionable visualisations within one unified interface. Users can explore pre-built data views or build their own custom formulas - turning raw market data into decisions.\nAt the heart of Sparta is a serious data engineering challenge. We're building a platform that enables the rapid development of reliable, scalable ETL pipelines - the foundation everything else depends on. As our data volumes grow and our product ambitions expand, the demands on that infrastructure grow with them. We're looking for experienced data engineers who are familiar with these challenges at scale - people who understand what it takes to keep a data platform performing as complexity increases.\nWe want people who thrive with ownership. At Sparta, you'll be handed problems, not solutions - and we expect you to run with them. Speed matters, autonomy is real, and we'd rather you move fast and course-correct than wait for permission. As a Staff engineer, you'll also be shaping the direction of the platform itself: engaging directly with stakeholders, contributing to product thinking, and investing meaningfully in the engineers around you.\nThis role can be based in the UK (London) or Spain (Barcelona, Madrid), and we would expect to spend some time together with the team in-office (2 -3 days a week).\nCore Responsibilities\nPlay a leading role in the design, build, and ongoing evolution of scalable data pipelines and ETL frameworks that power both real-time and analytical data processing.\n\nTake shared ownership of the health and performance of our data platform - optimising for latency, throughput, and reliability at scale.\n\nCollaborate closely with engineering and cross-functional stakeholders to ensure data infrastructure aligns with product goals and trader-facing outcomes - acting as the connective tissue between data and backend engineering.\n\nDrive architectural decisions across our data platform, with a focus on pipeline reliability, data quality, and scalability.\n\nContribute to the definition of our target architecture - shaping how we ingest, transform, store, and serve data as the platform evolves.\n\nMentor and support other engineers through design reviews, technical discussions, and hands-on knowledge sharing.\n\nSkills & Experience\n7+ years of experience as a data or software engineer, with a strong track record of delivering production-quality data systems.\n\n2+ years working within a product-focused organisation, collaborating closely with cross-functional teams.\n\nProven experience building and scaling data-intensive pipelines and platforms in production environments.\n\nDeep understanding of stream and batch processing frameworks - hands-on experience with Flink or Spark is essential.\n\nComfortable working across multiple programming languages - we primarily work with Kotlin, Python, and TypeScript.\n\nEqually comfortable designing high-level architecture as diving deep into low-level implementation details.\n\nExperienced in designing and deploying data infrastructure in cloud environments such as AWS or GCP.\n\nHands-on experience with core data infrastructure tooling such as Kafka, Redis, and/or clustered Postgres.\n\nNice to have experience\nFamiliarity with open lakehouse technologies, such as Apache Iceberg and dbt.\n\nExperience building data infrastructure to support AI agents - including low-latency retrieval and analytical interfaces.\n\nExperience leading teams or managing engineers, driving both delivery and technical excellence.\n\nExposure to complex distributed environments with demanding constraints such as high throughput, low latency, or large-scale datasets.\n\nWorking style\nWhereas Sparta is a remote-first company, for this role we’re looking for someone who values a hybrid working style, which in a typical week could involve spending a couple of days in the office - with flexibility built in.\nWhy Join Sparta?\nAt Sparta, our culture is built on innovation, collaboration, and high performance. We thrive in a fast-paced environment where initiative is celebrated, challenges are embraced, and impact is rewarded.\nEquity in a high-growth, VC-backed company\n$42M in Series B funding - strong market traction and investment\nEarly-stage growth - build your career as we scale\nMarket-leading product - we are redefining commodity trading intelligence\nTop-tier tools and technology to support your success\nWhat's the Culture Like at Sparta?\nAt Sparta, our culture isn't just a set of values on a wall - it's how we work. We embrace a dynamic environment where initiative is celebrated, challenges are met head-on, and innovation thrives. You'll collaborate with people who are passionate about our mission and committed to building outstanding products and outcomes for our customers.\nThe Sparta Code\nUnderstanding is non-negotiable\nUnderstanding leads to believing. Believing leads to winning.\nThe 'why' is the difference between compliance and conviction. Before we execute, we ask: why does this matter, who does it serve, what changes if we win? People who understand the mission don't need to be managed.\nAsk for forgiveness, not for permission\nMost decisions are reversible. Most fears are not.\n90% of decisions are reversible. Make them, ship, iterate. Perfection is the enemy of efficiency. Bias for action means moving before you have all the answers, but it isn't recklessness. The rule: tell the rest of us what you did, what changed, what you learned.\nFall in love with the problem\nThe mission wins. Your idea doesn't have to.\nSolutions flatter our ego. They feel like progress. But solutions without problems are opinions, and opinions don't move customers, markets, or teammates. The goal is to find what's true, not to win the room. If your idea gets killed because a better one comes along, that's the system working.\nIt's your fault. Lucky you.\nIf it's on you, it's in your control.\nTrue ownership sounds harsh until you feel how liberating it is. If every problem is yours, you stop spending energy on who to blame and start spending it on how to fix it. Effective leaders default to 'it's on me'. Not out of guilt, but out of agency.\nConflict is a gift\n Honesty is an expression of care.\nWithholding feedback is choosing comfort over growth, yours and your colleague's. Staying silent deprives others of the chance to learn. We challenge openly and with positive intent. Done with care, this builds trust. Done with ego, it destroys it.\nSparta Commodities is proud to be an equal opportunity employer and promotes diversity within its workforce. We are determined that no-one will ever receive less favourable treatment on the grounds of gender, age, disability, religion, belief, sexual orientation, marital status, race, veteran status or any basis covered by appropriate law.","description_format":"text","description_chars":8523,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity","Hybrid work"],"hiring_locations":[{"name":"United Kingdom","iso":"GB","kind":"country"},{"name":"Spain","iso":"ES","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Oil & Gas","Financial Data & Market Intelligence"],"lifecycle":[{"event":"open","at":"2026-09-11T13:41:39Z"},{"event":"close","at":"2026-09-14T21:03:02Z"},{"event":"reopen","at":"2026-11-04T12:53:32Z"}],"visa":[{"country":"GB","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"Licensed UK visa sponsor (Skilled Worker)","filings_12m":null,"filings_prev_12m":null,"green_card_filings_12m":null,"median_offered_wage_usd":null,"route":"Skilled Worker","cap_exempt":false,"checked_at":"2026-11-06T22:32:54+00:00","sources":["UK Home Office: register of licensed sponsors (workers)"],"filings_for_role_12m":0}],"liveness":{"score":15,"band":"cold","label":"Long shot","p_open":1,"p_active":0.54,"p_room":0.28,"age_days":133,"expected_fill_days":57,"reasons":["conf:1","win:tail","crowd:"],"computed_at":"2026-11-06T05:58:05Z"},"pay":null,"html_url":"https://alion.io/job/sparta-staff-data-engineer","json_url":"https://alion.io/job/sparta-staff-data-engineer.json","meta":{"generated_at":"2026-11-07T04:49:29Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":11751,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-08T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":445445},"rest":"https://alion.io/mcp/rest/get_company?id=445445"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsparta-staff-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsparta-staff-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsparta-staff-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/sparta-staff-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsparta-staff-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":744150}},{"tool":"search_jobs","arguments":{"company":"spartacommodities.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":744150},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}