{"id":3398211,"url":"https://alion.io/job/endava-senior-data-engineer-7","title":"Senior Data Engineer","company":{"id":6702,"name":"Endava","domain":"endava.com","url":"https://alion.io/company/endava","size_band":null,"is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":{"grade":"B","score":75,"open_postings":30,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":25,"computed_at":"2026-10-29T05:49:05Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Skopje, North Macedonia"],"countries":["MK"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":36000,"max_usd":94000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2679},"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"Machine Learning","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"Power BI","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-10-28T09:32:48Z","employer_posted_date":"2026-10-28","last_verified_at":"2026-10-29T19:33:57Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.\nBy combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.\nFrom prototype to real-world impact - be part of a global shift by doing work that matters.\n Our data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science. This discipline is responsible for transforming raw data into actionable insights, building robust data infrastructures, and enabling data-driven decision-making and innovation through advanced analytics and predictive modeling.\nYou’ll design, build and maintain data pipelines using a medallion architecture, transforming operational data into trusted, well-structured datasets for reporting and analysis.\nThe role combines hands-on development, data modelling, production support and technical leadership. You’ll work closely with development and data teams, product owners and business stakeholders to deliver reliable data products that meet reporting and operational needs.\nResponsibilities\nWork with analysts and stakeholders to understand source systems, data flows, business processes and reporting requirements, clarifying business rules and challenging unclear assumptions.\nDesign, build and maintain ETL/ELT pipelines in Azure Databricks using Python, PySpark and SQL.\nImplement bronze, silver and gold data layers, covering raw data ingestion, cleansing, validation and preparation for reporting.\nDevelop curated datasets and dimensional models, and make them available through Microsoft Fabric for Power BI reporting.\nImplement incremental processing and manage schema changes, duplicates, missing values and late-arriving data.\nProvide technical guidance and mentoring, lead code and design reviews, and support consistent development, testing and CI/CD practices.\nContribute to product and delivery discussions by explaining technical trade-offs, identifying data dependencies and helping prioritise work based on business value and technical constraints.\nDocument data models, transformations, lineage, dependencies and operational procedures.\n 7+ years of experience in data engineering, including designing, building, deploying and supporting production data pipelines.\nStrong Python and SQL skills, with strong hands-on experience using PySpark and Spark SQL in Azure Databricks.\nExperience with Microsoft Fabric, particularly making curated data available for reporting through OneLake, lakehouses or warehouses.\nGood understanding of data warehousing and dimensional modelling, including table grain, facts, dimensions and historical changes.\nExperience orchestrating and monitoring data pipelines.\nExperience with automated testing, data validation, Git and CI/CD practices.\nWorking knowledge of Azure storage, access management and secure credential handling.\nTaking ownership of technical decisions, reviewing designs and code, and guiding other engineers.\nAbility to understand business processes and product priorities, translate requirements into practical data solutions, and explain how technical choices affect users, reporting and operational decisions.\nAbility to work independently, explain technical decisions clearly and collaborate effectively in English with business and technical colleagues.Useful additional experience\n\nExperience with Snowflake.\nExperience delivering data solutions in enterprise environments. Familiarity with logistics, transportation or supply chain data is an advantage.\nEnterprise data modelling and aligning data definitions across source systems.\nPractical use of AI development tools.\n Discover some of the global benefits that empower our people to become the best version of themselves:\nFinance: Competitive salary package, share plan, company performance bonuses, value-based recognition awards, referral bonus; \nCareer Development: Career coaching, global career opportunities, non-linear career paths, internal development programmes for management and technical leadership;\nLearning Opportunities: Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences;\nWork-Life Balance: Hybrid work and flexible working hours, employee assistance programme;\nHealth: Global internal wellbeing programme, access to wellbeing apps;\n Community: Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations.\nAt Endava, we’re committed to creating an open, inclusive, and respectful environment where everyone feels safe, valued, and empowered to be their best. We welcome applications from people of all backgrounds, experiences, and perspectives-because we know that inclusive teams help us deliver smarter, more innovative solutions for our customers. Hiring decisions are based on merit, skills, qualifications, and potential. If you need adjustments or support during the recruitment process, please let us know.","description_format":"text","description_chars":5291,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":["Flexible schedule","Hybrid work"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-28T13:19:49Z"}],"visa":[],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":0,"expected_fill_days":25,"reasons":["conf:3","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-10-29T05:49:05Z"},"pay":null,"html_url":"https://alion.io/job/endava-senior-data-engineer-7","json_url":"https://alion.io/job/endava-senior-data-engineer-7.json","meta":{"generated_at":"2026-10-29T23:38:49Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":34765,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6702},"rest":"https://alion.io/mcp/rest/get_company?id=6702"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fendava-senior-data-engineer-7"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fendava-senior-data-engineer-7"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fendava-senior-data-engineer-7"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/endava-senior-data-engineer-7\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fendava-senior-data-engineer-7"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3398211}},{"tool":"search_jobs","arguments":{"company":"endava.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3398211},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}