{"id":3387516,"url":"https://alion.io/job/catena-media-senior-data-engineer","title":"Data Engineer","company":{"id":56993,"name":"Catena Media","domain":"catenamedia.com","url":"https://alion.io/company/catena-media","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"BambooHR","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Gżira, Malta"],"countries":["MT"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":36000,"max_usd":95000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2679},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Apache Kafka","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Claude Code","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"GitHub Actions","optional":false},{"name":"LLM","optional":false},{"name":"pySpark","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-10-28T08:26:33Z","employer_posted_date":"2026-10-28","last_verified_at":"2026-11-02T15:14:01Z","board_verified":true,"closed_at":null,"days_open":5,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":5},"description":"We are seeking a Data Engineer to join our Data & Analytics team, responsible for designing, building, testing and maintaining scalable data pipelines and data models on our Databricks lakehouse on Azure, governed through Unity Catalog. You will work in an AI-first team where agentic AI is part of how we design, build, test and operate our data platform every day. As part of the team, you’ll contribute to technical design and help shape our engineering standards.\nYOUR CHALLENGE:\nDesign and develop data pipelines in Python (PySpark) on Databricks, applying engineering best practices for performance, reliability and maintainability.\nIngest and integrate diverse data sources into the lakehouse in batch, following our bronze, silver and gold layering and ensuring data quality and accuracy.\nHelp introduce event streaming and real-time ingestion to the platform: design, build and operate streaming pipelines on Databricks from sources such as Kafka, handling late, duplicate and out-of-order events reliably.\nMaintain data models and the data estate codebase, with data governed, secured and documented in Unity Catalog.\nWrite automated tests for every change: unit tests for pipeline logic, integration tests against real data, and data quality checks that catch issues before they reach users.\nFollow and contribute to the team’s engineering standards: clean, modular code, peer code review, CI/CD, infrastructure as code (Databricks Asset Bundles) and clear documentation.\nUse agentic AI tools (such as Claude Code) daily to build, test, review and troubleshoot, and help design and improve the AI agents and skills that automate our data workflows, with human review built in.\nMonitor and operate our cloud data platform (Databricks on Azure) day to day: track pipelines and jobs, troubleshoot issues and support daily data operations.\nCollaborate with engineers, analysts, and business stakeholders; support ad hoc data analysis requests. \nDrive continuous improvement through training and self-development. \nAny other ad hoc tasks that may be required by the business from time to time. \nTO DO IT, YOU WILL NEED:\nA Degree in IT, Computer Science, or related fields.\nProven experience as a Data Engineer, building and maintaining scalable ETL/ELT pipelines for data lakes or lakehouses, with exposure to both batch and real-time data.\nHands-on experience with Databricks on Azure, including Unity Catalog (catalogs, schemas, permissions and lineage).\nHands-on experience with event streaming and real-time ingestion: Spark Structured Streaming and event platforms such as Kafka.\nStrong SQL skills; experience with relational databases and complex queries.\nExperience orchestrating pipelines with Databricks Workflows (Jobs) and deploying them with Databricks Asset Bundles; Azure Data Factory experience is an asset.\nCoding proficiency in PySpark and Python.\nA strong testing mindset: experience writing unit and integration tests (e.g. pytest) and data quality checks, and writing code that is designed to be tested.\nSolid software engineering practices: Git, pull requests and code review, CI/CD (Azure DevOps, GitHub Actions or equivalent) and documentation.\nHands-on experience working with agentic AI: using AI coding agents (such as Claude Code) in daily engineering work, and designing, building or integrating LLM-powered agents that orchestrate data workflows.\nComfortable delivering in a fast-paced, agile environment.\nStrong analytical and problem-solving skills.\nExcellent communication and team collaboration.\nSelf-motivated with a drive for continuous learning.\nWant to help build the future of Catena Media? Apply now for the opportunity to join our collaborative team!","description_format":"text","description_chars":3696,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Continuous learning"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["iGaming & Gambling"],"lifecycle":[{"event":"open","at":"2026-10-28T08:26:33Z"},{"event":"close","at":"2026-10-28T12:58:12Z"},{"event":"reopen","at":"2026-10-28T17:06:07Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":4,"expected_fill_days":24,"reasons":["conf:3","velocity","win:early"],"computed_at":"2026-11-02T06:13:15Z"},"pay":null,"html_url":"https://alion.io/job/catena-media-senior-data-engineer","json_url":"https://alion.io/job/catena-media-senior-data-engineer.json","meta":{"generated_at":"2026-11-02T17:54:54Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":24916,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-03T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":56993},"rest":"https://alion.io/mcp/rest/get_company?id=56993"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcatena-media-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcatena-media-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcatena-media-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/catena-media-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcatena-media-senior-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3387516}},{"tool":"search_jobs","arguments":{"company":"catenamedia.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3387516},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}