{"id":3961962,"url":"https://alion.io/job/smarkets-data-engineer","title":"Data Engineer","company":{"id":688000,"name":"Smarkets","domain":"smarkets.com","url":"https://alion.io/company/smarkets","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["London, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"Agile","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Flask","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Jira","optional":false},{"name":"Kubernetes","optional":false},{"name":"Machine Learning","optional":false},{"name":"NumPy","optional":false},{"name":"Pandas","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"Scikit-learn","optional":false},{"name":"Apache Kafka","optional":true},{"name":"AWS","optional":true},{"name":"C++","optional":true},{"name":"dbt","optional":true},{"name":"Docker","optional":true},{"name":"ElasticSearch","optional":true},{"name":"FastAPI","optional":true},{"name":"Grafana","optional":true},{"name":"Jenkins","optional":true},{"name":"Kibana","optional":true},{"name":"Linux","optional":true},{"name":"Prometheus","optional":true},{"name":"Rust","optional":true}],"status":"live","first_seen_at":"2026-11-09T08:49:02Z","employer_posted_date":"2026-11-09","last_verified_at":"2026-11-09T12:08:37Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Who are we?\nSmarkets: Predicting the Future of Betting\nSmarkets runs one of the world’s most sophisticated prediction markets, handling over £29 billion in volume since 2010 and engaging 200,000+ traders globally. We’re a technology company that happens to revolutionise betting - from sports to political markets, to delivering the sharpest prices and the fairest odds.\nOur stack is designed for scale, reliability, and speed: Linux, Kafka, Postgres, Kubernetes, with Python 3, C++, Rust and React powering our platform. We build infrastructure that institutions trust while keeping trading accessible to everyone. Our edge? We’ve thrived through every market cycle, competitor, and industry revolution.\nAt the heart of our success are our people. We create a high-performance environment where exceptional talent can thrive, blending deep business experience with a commercial mindset to drive strategic growth.\nIf you’re ready to help shape the future of prediction markets with cutting-edge technology and a customer-first philosophy, Smarkets is where you belong.\nThe Team\nThe Data Team is responsible for taking the wealth of data that Smarkets generates and using it to drive insights which improve the business. Since Smarkets produces a huge amount of data - including sports event data, payments information, order flow and user analytics - there are many opportunities for the team to add real business value.\nThe team’s responsibilities currently span across three different areas:\nData Engineering: development and maintenance of ETL pipelines, services and APIs, and data-related infrastructure like Redshift or BigQuery;\n\nData Science and Machine Learning: data exploration, ML models training and ML Ops to extract new insights from data;\n\nAnalytics and Reporting: creation of data models and dashboards as well as automation of reporting pipelines for different teams, stakeholders and third-parties.\n\nIn a typical week, a data engineer in the Data team would:\nAdd a new python ETL pipeline that segments users interested in specific sports through analysing behaviour which streamlines and tailors marketing communications to those users;\n\nDevelop a new endpoint to a Flask API, add unit tests, and deploy the new version of the API into our production Kubernetes cluster;\n\nTrain and evaluate an ML model to identify certain user patterns and provide it as service to other engineering teams in a Flask API;\n\nTeam Tech Stack\nOur current technology stack primarily includes Linux, Docker, Kubernetes, Jenkins, Kafka, Python, Flask/FastAPI, Postgres, AWS Redshift, dbt, Google Bigquery, Prometheus, Grafana, Elastic Search, Kibana, Lightdash.\nAbout the Role:\nYou will work very closely with the Data team lead and the other team members who will be assisting you whenever needed, making your integration in the company as smooth as possible.\nThe Data team works in an organised way using Agile methodologies and tools such as Jira and regular standups. You will find an environment where you have a clear engineering direction, can focus on your work and hone your skills as a data engineer through exciting projects. You will always be able to count on the support of many engineers across the company.\nWhat you will do:\nAs a member of the data team, your responsibilities will include contributions to:\nDeveloping and maintaining our Data ETL pipelines, some of which are real-time. The pipelines are fundamental to helping teams and stakeholders understand and drive business direction. Data components can also be user facing e.g. sending notifications to users;\n\nEnsuring our data lake is kept in a healthy state, particularly our data warehouses: Redshift and Bigquery;\n\nDeveloping and maintaining Flask services and Postgres databases within the Data team to provide access to data or manage certain business entities relevant to Data.\n\nAssisting the different teams in the company with reporting, especially when it comes to automated reporting pipelines.\n\nDoing data exploration and training & deploying ML models used to perform different kinds of user segmentation, detect operational anomalies or estimate important business quantities. In particular maintain and improve our existing recommender service that provides users with suggestions on new sport competitions.\n\nRole Requirements:\nWhat we are looking for in you:\n3+ years of experience\n\nYou have an understanding of developing ETL pipelines using Python frameworks such as luigi or airflow;\n\nYou have experience with the development of Python-based REST APIs / services and their integration with databases (e.g. Postgres);\n\nYou are familiar with the key tools of the Python data science stack, e.g. Pandas, Numpy and scikit-learn;\n\nSome experience with training and deploying ML models;\n\nYou enjoy writing elegant, well-tested and maintainable code;\n\nYou are a team player that enjoys contributing to the success of the team in a proactive and friendly environment;\n\nYou have a bachelor’s in Computer Science, Math or equivalent field, or possess relevant experience.\n\nOur Values\nOur values are at the heart of everything we do - guiding how we work, collaborate, and innovate. They reflect what we expect of ourselves and each other to deliver the best results, while fostering a positive, high-performing environment:\nPush to Win: We set ambitious goals and relentlessly pursue them, always striving for excellence.\n\nMake Others Better: We lift each other up, share knowledge, and celebrate team success over individual achievement.\n\nGive a Shit: We care deeply about our work, our users, and the impact we make.\n\nBe a Pro: We take ownership, act with integrity, and consistently deliver to a high standard.\n\nBring the Energy: We bring positivity, curiosity, and enthusiasm to everything we do, inspiring those around us.\n\nCulture Fit: These values define how we succeed as a team. If this isn’t you, this may not be the right place. We hire people who thrive in a fast-paced, collaborative, and ambitious environment.\nPerks & Benefits\nWe offer a competitive salary and benefits package, alongside a dynamic, collaborative environment where your work truly makes an impact and your voice is heard. Our team is diverse, driven, and ambitious - united by a strong work ethic and a hunger to innovate and win.\nOur benefits are designed around Health, Wealth,and Development, supporting you both professionally and personally.\nThese include:\nStock Options: Vest over 4 years - your success is our success.\n\nPension Scheme: Competitive plan via Aviva, with up to 6% matched contributions if you opt in.\n\nHealth Insurance: Comprehensive coverage to keep you and your family healthy.\n\nEnhanced Parental Leave: Enhanced maternity and paternity leave to support you through life’s most important moments.\n\nStay Fuelled: Enjoy fresh, chef-made breakfast and lunch every day, plus a constant supply of fruit, snacks, tea, coffee and soft drinks - because great work starts with great food.\n\nCycle-to-Work Scheme: Support for sustainable commuting and staying active.\n\nLearning & Development: £1,000 annual education budget for courses, conferences, books, or training.\n\nHoliday: 25 days paid leave + bank holidays, with the option to carry over 5 days.\n\nFlexible Working: Choose to work 1 day from home (20 WFA days/year) or 2 days from home (5 WFA days/year) based on your needs and preferences.\n\nTeam Energy: Regular socials, hackathons, and events - because collaboration and fun go hand-in-hand.\n\nDiversity & Inclusion\nWe’re an equal opportunities employer and celebrate diversity in all its forms. If you need any adjustments during the recruitment process, please let us know - we’re happy to accommodate your needs.","description_format":"text","description_chars":7700,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Flexible schedule","Health insurance","Parental leave","Stock options"],"hiring_locations":[{"name":"United Kingdom","iso":"GB","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Sports Betting"],"lifecycle":[{"event":"open","at":"2026-11-09T12:08:37Z"}],"visa":[{"country":"GB","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"Licensed UK visa sponsor (Skilled Worker)","filings_12m":null,"filings_prev_12m":null,"green_card_filings_12m":null,"median_offered_wage_usd":null,"route":"Skilled Worker","cap_exempt":false,"checked_at":"2026-11-09T07:32:21+00:00","sources":["UK Home Office: register of licensed sponsors (workers)"],"filings_for_role_12m":0}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":52,"reasons":["conf:1","win:early"],"computed_at":"2026-11-09T13:53:19Z"},"pay":null,"html_url":"https://alion.io/job/smarkets-data-engineer","json_url":"https://alion.io/job/smarkets-data-engineer.json","meta":{"generated_at":"2026-11-09T13:53:19Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":18561,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-10T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":688000},"rest":"https://alion.io/mcp/rest/get_company?id=688000"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsmarkets-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsmarkets-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsmarkets-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/smarkets-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsmarkets-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3961962}},{"tool":"search_jobs","arguments":{"company":"smarkets.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3961962},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}