{"id":747143,"url":"https://alion.io/job/livestockinformation-data-engineer-fixed-term-contract","title":"Azure Data Engineer - Fixed Term Contract","company":{"id":683571,"name":"Livestock Information Ltd","domain":"livestockinformation.org.uk","url":"https://alion.io/company/livestockinformation","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"contractor","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":["GB"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":69000,"max_usd":159000,"period":"year","method":"role_country_seniority_unknown","sample_n":116},"experience_years_min":null,"visa_sponsorship":true,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"Databricks","optional":false},{"name":"GDPR","optional":false},{"name":"Microsoft Teams","optional":false},{"name":"MS SQL","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-08-06T00:00:00Z","employer_posted_date":"2026-08-06","last_verified_at":"2026-10-10T22:11:18Z","board_verified":true,"closed_at":null,"days_open":66,"trust":{"level":"ok","repost_count":0,"flags":[],"days_open":65},"description":"The salary for this role is £50,000.\nThis role is being offered on a 12 Month Fixed Term Contract.\nAre you an experienced Azure Data Engineer with a passion for building scalable, high-quality data solutions? \n Can you design and optimise data pipelines using tools like Azure Databricks and Data Factory to deliver real business impact? \n Do you enjoy collaborating with cross-functional teams to turn complex data into valuable insights\nIf so, we’d love to hear from you!\nAt Livestock Information Ltd, our mission is to be an outstanding service provider of livestock data, empowering government, industry, and farmers to effectively manage disease and infection control, whilst enhancing productivity and innovation in agriculture. To achieve this, we need great people, who share in our values.\nAs a Data Engineer at LI, you will play a key role in delivering scalable, high-quality data solutions that support critical business needs.\nIn this role, you’ll design and build new data services, lead migrations of existing solutions, and ensure the ongoing performance and enhancement of live data platforms. Working in a collaborative, agile environment, you’ll partner with cross-functional teams including Product Owners, Business Analysts, Developers, and Testers to deliver impactful data products.\nYou’ll work with a modern Azure data stack, including Databricks, Synapse, Data Factory, and Data Lake technologies, using tools like Azure DevOps to support end-to-end development and delivery.\nResponsibilities\nYour responsibilities will include\nDesigning & Implementing Data Storage Solutions on Azure: Select Azure data storage services appropriately and design data storage schemas, ensuring they are optimised for specific use cases.\nBuilding and Maintaining Data Pipelines for Data Integration and Processing: Build and maintain data pipelines for data movement and process orchestration. Collect data from various sources, transform data into a practical format and load it into appropriate data storage solutions on Azure using tools such as Azure Data Factory and Azure Databricks. Ensure data pipelines are scalable and efficient.\nEnsuring Data Quality & Accuracy Through Testing & Validation: Test and verify data at different phases of the data pipeline, from extraction through to loading.\nOptimising Data Processing Performance Through Tuning & Monitoring: Ensure data processing is efficient and scalable by tuning the data pipeline and monitoring performance; identify and resolve bottlenecks in the data pipeline and optimise data processing algorithms.\nDeveloping & Maintaining Data Models & Schemas: Develop and maintain data models and schemas optimised for specific use cases. Select the appropriate data modelling techniques and ensure the data schema is scalable and efficient.\nCollaborating With Other Teams to Provide Data for Analytics & Reporting: Work closely with other teams to provide data they need to perform their job functions.\nEnsuring Data Security & Privacy Prerequisites Are Followed: Ensure that data streamed and processed on Azure confirms with applicable data security and privacy requirements such as the General Data Protection Regulation (GDPR).\nWorking with Large Datasets & Performing Data Analysis: Work with large datasets of hundreds of millions and billions of rows of data and perform data analysis\nStaying updated on the latest Azure features, updates and best practices to ensure they are adopted effectively as appropriate\nYou may be required to undertake other duties assigned by your line manager as appropriate\nRequirements\nWe are looking for someone with the following\nProven experience in Python programming for data engineering and analytics\nStrong proficiency in SQL, including the Microsoft T-SQL dialect\nHands-on experience with Azure data storage solutions\nPractical knowledge of data integration and processing frameworks, such as Azure Databricks and Azure Data Factory\nSolid understanding of data modelling concepts and schema design best practices\nStrong analytical and problem-solving skills, with excellent attention to detail\nEffective communication skills and the ability to work collaboratively within cross-functional teams.\nFor further information, please see the attached Job Description - Data Engineer Job Description\nBenefits\nAs an LI employee, you will be entitled to our company benefits which include\nA fully remote and flexible working set up \n25 days annual leave, increasing by 1 day each year of service up to maximum of 30 days (plus Bank Holidays)\n1 Privilege Day \n4 x annual salary Life Assurance\nMarket leading pension scheme through Legal & General\nEnhanced Family Friendly Policies\nExcellent learning, training, and career development opportunities\n24/7 access to our Employee Assistance Programme\nA diverse and inclusive culture where everyone is respected and valued\nApplication and Interview Process\nTo apply for this role, you will need to submit a CV and answer some pre-screening questions.\nThe interview and assessment process for this role will involve a telephone interview with our Talent Team, followed by a first stage and a final stage interview. Interviews will be conducted either remotely via MS Teams or face to face.\nIf we need to make a reasonable adjustment so that you can complete your application, please contact us as soon as possible by emailing  before the closing date to discuss your needs.\nThe closing date for this role is 4pm on Friday, 17th April. Applications received after the closing date will not be considered. Please note that we may close the advert early if we receive a high volume of applications\nArtificial Intelligence\nArtificial intelligence tools can be used to help you prepare your application. However, all statements and examples provided during the recruitment process should be accurate and based on your own knowledge and experience. Applications may be withdrawn if content is found to be plagiarised, including where ideas or experiences generated by artificial intelligence are presented as personal work. For further information, please click on the following link : AI & Recruitment at LI\nValues\nWe approach our work with TACT; we are Transparent, Accountable, Committed and we work as a Team.\nWe are transparent together, embracing honesty and building trust. We are accountable to the industry and strive for the best possible solutions for the communities we serve. We drive change with passion, commitment and enthusiasm to deliver a great service to the livestock industry. We work kindly and cohesively which allows us to support each other in our personal and strategic goals. For more information on our values and what its like to work at Livestock Information, please visit our Careers Page : Careers - Livestock Information Ltd\nAt Livestock Information Ltd, we have a zero-tolerance approach to harassment, abuse, discrimination, or bullying during our recruitment process. Any such behaviour may result in a candidate being withdrawn from consideration We are committed to upholding our company values and ensuring a safe and respectful experience for all candidates and staff.\nDiversity statement\nAt Livestock Information, we value diversity and believe that every individual brings different strengths. We understand that not everyone may possess every single skill outlined in this job description, but if you believe you have a solid skill set that enables you to excel in this position then we really encourage you to apply.\nFurther information\nIf you feel your application has not been treated in a fair and open manner or if you are dis-satisfied with any of your interactions during the recruitment process and you wish to make a complaint, you should contact our Talent team via email: \nDisclaimer\n Livestock Information Ltd. cannot sponsor work visas at this time.\nLivestock Information Ltd. Does not discriminate based on race, sex, colour, religion, age, national origin, marital status, disability, veteran status, genetic information, sexual orientation, gender identity or any other reason prohibited by law in provision of employment opportunities and benefits.\n Livestock Information Ltd. Does not accept unsolicited CVs from any source other than directly from a candidate. Any unsolicited CV’s not originating directly from a candidate and sent to Livestock Information Ltd or any Livestock Information Ltd employees, including unsolicited CVs sent to a Livestock Information Ltd mailing address or email address, are rejected. Livestock Information Ltd will NOT pay a fee for any placement resulting from the receipt of an unsolicited CV. Livestock Information Ltd considers any candidate for whom the recruiter has submitted an unsolicited CV referred by the company free of any fees.","description_format":"text","description_chars":8844,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Annual leave","Flexible schedule"],"hiring_locations":[{"name":"United Kingdom","iso":"GB","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-09-11T14:29:28Z"}],"visa":[],"liveness":{"score":11,"band":"cold","label":"Long shot","p_open":1,"p_active":0.376,"p_room":0.28,"age_days":65,"expected_fill_days":27,"reasons":["conf:0","win:tail","crowd:"],"computed_at":"2026-10-10T05:45:15Z"},"pay":null,"html_url":"https://alion.io/job/livestockinformation-data-engineer-fixed-term-contract","json_url":"https://alion.io/job/livestockinformation-data-engineer-fixed-term-contract.json","meta":{"generated_at":"2026-10-11T01:14:35Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":1806,"day_limit":5000,"remaining_today":3194,"minute_limit":60,"resets_at":"2026-10-12T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":683571},"rest":"https://alion.io/mcp/rest/get_company?id=683571"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Flivestockinformation-data-engineer-fixed-term-contract"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Flivestockinformation-data-engineer-fixed-term-contract"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Flivestockinformation-data-engineer-fixed-term-contract"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/livestockinformation-data-engineer-fixed-term-contract\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Flivestockinformation-data-engineer-fixed-term-contract"}]}