{"id":50404,"url":"https://alion.io/job/informa-group-plc-senior-data-engineer","title":"Senior Data Engineer","company":{"id":4365,"name":"Informa","domain":"informa.com","url":"https://alion.io/company/informa-group-plc","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":{"grade":"B","score":80,"open_postings":10,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":16,"computed_at":"2026-10-16T05:45:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":18500,"max_usd":38000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":59},"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"Amazon SageMaker","optional":false},{"name":"AWS","optional":false},{"name":"AWS Bedrock","optional":false},{"name":"AWS Lambda","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Claude Code","optional":false},{"name":"CloudFormation","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Feature Store","optional":false},{"name":"GCP","optional":false},{"name":"GitHub","optional":false},{"name":"GitHub Actions","optional":false},{"name":"LLM","optional":false},{"name":"Platform Engineering","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Scrum","optional":false},{"name":"Terraform","optional":false},{"name":"Amazon CloudWatch","optional":true},{"name":"Bitbucket","optional":true},{"name":"Datadog","optional":true},{"name":"GitLab","optional":true},{"name":"Grafana","optional":true},{"name":"Java","optional":true},{"name":"Jenkins","optional":true},{"name":"Power BI","optional":true},{"name":"pySpark","optional":true},{"name":"Scala","optional":true},{"name":"Snowflake","optional":true},{"name":"Spark","optional":true},{"name":"Tableau","optional":true}],"status":"live","first_seen_at":"2026-08-11T07:40:30Z","employer_posted_date":"2026-08-11","last_verified_at":"2026-10-16T20:30:10Z","board_verified":true,"closed_at":null,"days_open":66,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":66},"description":"Informa is a leading academic publishing, business intelligence, knowledge and events business, creating unique content and connectivity for customers all over the world. It is listed on the London Stock Exchange and is a member of the FTSE 100.\nTaylor & Francis is one of the world’s largest publishers of high-quality, peer reviewed scholarly journals, books, e-books and reference works. We empower learners, thinkers and doers with trusted knowledge that advances research and enriches lives. We bring together diverse people, ideas and opinions to validate and publish the experts, theories and truths that matter. And we’ve been doing this in an unbroken arc since 1798.\nOur purpose is to foster human progress through knowledge. We strongly believe that this requires us to encourage and examine different ideas and voices, so that any work that meets our exacting levels of quality deserves to be included in our publications. This requires open minds, the opportunity for robust debate, and the courage to defend perspectives that stand up to scrutiny, even if they conflict with our personal beliefs or values. Because that’s the only way to find the best obtainable version of the truth and, ultimately, foster human progress. If you agree, then we’d love to hear from you.\n We are seeking an experienced Senior Data Engineer to join our Data and Analytics Platform team. In this role, you will collaborate with data quality engineers and business data analysts to understand data requirements and models, build robust data ingestion pipelines, and develop complex business-specific use cases that enable seamless information consumption from our platform.\nYou will be part of a dynamic and enthusiastic team driving agile development to build an enterprise-level data analytics platform as part of Taylor & Francis's product and technology-led initiatives. The ideal candidate will possess strong hands-on experience with diverse data management methodologies and a proven track record of implementing them across a wide range of data projects to generate highly relevant data products.\nBuilding Scalable Data Pipelines\nDesign and develop high-quality, scalable ETL/ELT pipelines for processing big data using AWS analytical services. Leverage no-code tools and reusable Python libraries to ensure efficiency, maintainability, and reusability. Ensure data pipelines and platform components are scalable, performant, and cost-efficient.\nPlatform Engineering\nBuild and enhance reusable platform capabilities across ingestion, transformation, orchestration, data quality, cataloguing, and monitoring. Develop scalable and reliable AWS data pipelines and data products using standardised data architecture patterns such as medallion architecture, lakehouse, and other modern design paradigms.\nData-Related Automation\nDrive configuration-driven, declarative, and automated engineering approaches that reduce bespoke development and improve productivity. Champion automation across the data engineering lifecycle to minimize manual intervention and accelerate delivery.\nCollaborating & Aligning with Project Goals\nWork closely with cross-functional teams, including Tech Leads, Engineering Managers, and Business Analysts, to understand project objectives and deliver robust data solutions. Follow Agile/Scrum principles to drive consistent progress and iterative delivery.\nData Discovery & Root Cause Analysis\nPerform data discovery and analysis to uncover data anomalies. Identify and resolve data quality issues through root cause analysis, and provide informed recommendations for data quality improvement and remediation.\nAI-Augmented Development\nChampion the integration of Claude Code and other LLM tools into our software development lifecycle (SDLC). Lead the team in using AI to accelerate coding, debugging, automated testing, and documentation.\nCI/CD & Operational Excellence\nManage the automated deployment of code and ETL workflows within cloud infrastructure (AWS preferred) using tools such as GitHub Actions, AWS CodePipeline, or other modern CI/CD systems. Implement Infrastructure as Code (IaC), automated testing frameworks, observability solutions, security best practices, and operational reliability measures to ensure robust and resilient data platform operations.\nEffective Time Management\nDemonstrate strong organizational and time management skills. Prioritize tasks effectively and ensure the timely delivery of key project milestones.\nTechnical Mentorship\nSet the gold standard for the team by leading code reviews, defining CI/CD patterns, and enforcing data governance standards via AWS Lake Formation.\nThe AI Frontier (SageMaker & Bedrock)\nArchitect the infrastructure for our AI initiatives. Implement our initial AWS SageMaker footprint (Data Wrangler, Feature Store) and manage AWS Bedrock integrations (Knowledge Bases, RAG pipelines) to support downstream Data Science and GenAI initiatives.\nDocumentation & Data Mapping\nDevelop and maintain comprehensive data catalogs, including data mapping and documentation, to ensure data governance, transparency, and accessibility for all stakeholders.\nLearning & Contributing to Best Practices\nContinuously improve your skills by learning and implementing data engineering best practices. Stay updated on industry trends and contribute to team knowledge-sharing and codebase optimization.\nWhat You Will Be Doing (Daily Execution & Process)\nData Engineering\nBuild and evolve reusable data platform capabilities. Develop scalable ingestion, ETL/ELT and data processing solutions using AWS. Implement and support medallion data processing and data product patterns. Build automation around data quality, metadata, cataloguing, orchestration and monitoring.\nAgile Orchestration\nFunction as an integral part of an Agile engineering team, defining delivery phases, sub-activities, and milestones while ensuring development standards are rigorously enforced.\nProject Delivery\nCollaborate with Engineering Managers and Business Analysts to produce accurate delivery estimates and oversee the transition from analysis through to final delivery.\nInfrastructure as Code (IaC)\nCreate and maintain resilient infrastructure using Terraform or AWS CloudFormation and strong deployment practices enabled by automated tests to ensure environment parity and automationstability.\nQuality & Testing\nImplement comprehensive unit testing strategies and automated data quality checks to identify and resolve issues prior to deployment.\nObservability & Monitoring\nEstablish and maintain observability practices including logging, monitoring, and alerting to ensure platform health, performance optimization, and proactive issue detection.\nCross-Functional Collaboration\nWork closely with cross-functional teams to gather requirements and develop cloud-based applications, analytical services, and platforms.\nSecurity & Compliance\nEnsure all data solutions strictly adhere to company security guidelines and regulatory requirements. Implement security best practices throughout the data engineering lifecycle.\nKnowledge Management\nDocument technical solutions and maintain a robust knowledge base for the team.\n 3. Technical Requirements (Qualifications)\nExperience\n6+ years in Data Engineering, with deep expertise in architecting scalable cloud-native data solutions, optimizing complex ETL/ELT workflows, and implementing modern data platform patterns including lakehouse and medallion architectures.\nData Expertise\nStrong analytical skills in handling and processing structured and semi-structured datasets, with hands-on experience in designing and implementing scalable and cost-effective data engineering solutions on AWS.\nCloud Technologies\nProficiency in building data pipelines and working with data warehousing solutions on AWS (Redshift, S3, Glue, Lambda, etc.). Experience with alternative cloud platforms (Google Cloud, Azure) is a plus.\nProgramming Skills\nStrong programming proficiency in Python, with additional experience in Java/Scala being advantageous. Ability to write efficient, reusable, and scalable code to process large datasets. PySpark experience is a plus.\nData Warehousing\nProven experience with modern data warehousing tools such as AWS Redshift, Snowflake, or equivalent platforms, with a focus on performance optimization and query tuning.\nPlatform Engineering & Architecture\nExperience building reusable platform capabilities and implementing standardised data architecture patterns including medallion architecture, lakehouse, and modern data mesh principles.\nAI-Enabled Engineering\nProficiency in using Claude Code or similar AI assistants to streamline complex engineering tasks.\nMLOps\nFamiliarity with setting up SageMaker or Bedrock environments to build the infrastructure where models operate.\nData Modeling\nAdvanced knowledge of Star/Snowflake schemas and modern Data Lake design principles.\nVersion Control & Automation\nHands-on experience with version control systems such as GitHub, GitLab, or Bitbucket, and with CI/CD pipelines using tools like GitHub Actions, AWS CodePipeline, or Jenkins to ensure smooth, automated deployments. Strong understanding of Infrastructure as Code principles and automated testing frameworks.\nObservability & Operational Reliability\nExperience implementing observability solutions (CloudWatch, Datadog, Grafana, etc.) and ensuring operational reliability through monitoring, alerting, and incident response practices.\nData Governance & Security\nKnowledge of data governance practices, compliance standards, and security protocols in a cloud environment.\nAutomation & Efficiency\nDemonstrated ability to drive configuration-driven and declarative engineering approaches that reduce manual effort and improve team productivity.\nOptional Skills\nExperience with business intelligence (BI) tools such as Tableau, Power BI, or QuickSight, and exposure to data visualization techniques will be an advantage.\nEducation\nBachelor's or Master's degree in Computer Science, Data Engineering, or a related technical field.\n You must have the right to work and live in India.\nLocation: The successful candidate will be able to utilise our balanced working model. We ask that candidates live within a commutable distance of our Bengaluru office to ensure that as a balanced worker they can make it to our office location to collaborate as required. There is an expectation for a minimum of 3 days per week in-person time.\nWe believe that great things happen when people connect face-to-face. That's why we work in-person with each other, or with customers and partners, three days a week or more. When you’re not spending time together in one of our offices or other workplaces - like at conference - you get the flexibility and support to work from home or remotely.\nWhat we offer in return:\nA competitive salary + bonus\n24 days annual leave\n4 volunteering days annually\nDay off for your birthday\nPension contributions\nMedical insurance for self and dependants; life cover and personal accident cover for self\nSeasonal social and charitable events\nTraining and development\nTools and equipment for remote working\nNote: This role does not provide any relocation support.\nWe want all our candidates to shine in our recruitment process. Please let us know if there is anything we can do to ensure you are able to show us your best self. This could include having the application form in a different format, more time for questions, or anything else - please ask us, we are happy to be flexible! Please contact \nBeing Yourself at Taylor & Francis:\nIf you’re excited about working with Taylor & Francis to foster human progress through knowledge, we invite you to apply even if your existing skills and experience don’t fit every item listed above. At Taylor & Francis, we are at our best and most successful when colleagues can be themselves and make a contribution regardless of their identity or background. As a colleague, you will have the opportunity to...","description_format":"text","description_chars":13590,"description_truncated":true,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":["Annual leave","Flexible schedule","Health insurance"],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":true,"industries":["Publishing","Exhibitions","Market Research"],"lifecycle":[{"event":"open","at":"2026-08-11T07:40:30Z"}],"visa":[],"liveness":{"score":8,"band":"cold","label":"Long shot","p_open":1,"p_active":0.293,"p_room":0.28,"age_days":65,"expected_fill_days":16,"reasons":["conf:3","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-16T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/informa-group-plc-senior-data-engineer","json_url":"https://alion.io/job/informa-group-plc-senior-data-engineer.json","meta":{"generated_at":"2026-10-16T22:31:17Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":4129,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4365},"rest":"https://alion.io/mcp/rest/get_company?id=4365"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Finforma-group-plc-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Finforma-group-plc-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Finforma-group-plc-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/informa-group-plc-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Finforma-group-plc-senior-data-engineer"}]}