{"id":3706444,"url":"https://alion.io/job/elsevier-senior-data-engineer-ii","title":"Senior Data Engineer II","company":{"id":3090,"name":"Elsevier","domain":"elsevier.com","url":"https://alion.io/company/elsevier","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":80,"open_postings":25,"ghost_share":0,"stale_share":0.8,"repost_share":0,"time_to_fill_p50_days":26,"computed_at":"2026-11-04T06:34:25Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India","Chennai, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"CI/CD","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"Java","optional":false},{"name":"Knowledge Graph","optional":false},{"name":"Python","optional":false},{"name":"Recommender Systems","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"Spring Boot","optional":false},{"name":"SQL","optional":false},{"name":"GitHub Actions","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-11-03T21:12:27Z","employer_posted_date":"2026-11-03","last_verified_at":"2026-11-04T08:24:51Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Senior Data Engineer II - Search and AI Platform\nAre you a Senior Data Engineer II looking for an innovative role?\nDo you enjoy being part of a team that works with a diverse range of technology?\nAbout our Team: -\nThe Search and AI Platform is Elsevier’s agentic data platform which powers products such as LeapSpace, Scopus, ScienceDirect, Clinical Key, Reaxys, Libra and our next-generation AI powered search systems.\nThe platform uses agentic services to interrogate our rich knowledge graphs, search and recommendation systems, and our unparalleled collection of research data to deliver insights to the scientific community so they can collaborate more effectively, work smarter, and deliver quality research more quickly.\nWe’re looking for an innovative, passionate Senior Data Engineer II in the Libra team to lead the design, build and operation of scalable pipelines that ingest content into a centralized content storage system. The Libra systems are in early-stage implementation and will handle massive volumes of content, so we are looking for someone who can take technical ownership of the architecture, build and maintenance of scalable and reliable data pipelines and services for various kinds of report generation.\nAbout the Role: -\nThe Libra Team is a core part of Elsevier’s Search and AI Platform. This team works on building an Evaluation Platform for Subject Matter Experts (SMEs) to review AI-generated medical content item-by-item, provide ratings/feedback based on predefined metrics, track team progress, and export results for quality assurance and model improvement purposes. As a Senior Data Engineer II, you will lead the technical design and delivery of robust, scalable and reliable data pipelines and services for report generation across Libra services, set engineering standards within the team, and mentor and grow other engineers.\nResponsibilities: -\nLeading the design, prototyping and build of robust and scalable data pipelines, setting the standard for clean code and best-practice software engineering principles across the team.\nWorking with technologies including Python (Fast API), Java (Spring Boot), Data Warehouse, Spark, Airflow, Snowflake, ETL/ELT, Iceberg, Kafka and RDBMS.\nOwning cloud infrastructure in AWS to host, monitor and scale the services, automating common tasks mercilessly and driving cost and performance optimisation.\nPartnering with Product Managers, architects and engineering teams to translate product requirements into scalable technical solutions, implementation plans and delivery roadmaps.\nMentoring and coaching engineers through design reviews, pair programming and code review, raising the technical bar of the team.\nDriving data quality, observability, governance and reliability practices across Libra data products, including SLAs, lineage and monitoring.\nContributing to architectural decisions for the wider Search and AI Platform and influencing technical direction beyond your immediate team.\nRequirements: -\n6+ years of professional experience in data engineering, with a strong track record of building scalable, high-performance and reliable data platforms and services.\nStrong core skill set including SQL, Python, Airflow, Data Warehousing, Snowflake, AWS, Git, ETL/ELT and familiarity with AWS Glue.\nDeep experience with SQL and data warehouses, preferably Snowflake, including data modelling, performance tuning and cost management at scale.\nAn advocate and enforcer of best practices for rapid development of quality software, including clean code, architectural design patterns, testing strategy and CI/CD.\nComfortable learning new technologies, languages and tools on the job, and helping others do the same, to ensure the product is not left behind in a rapidly evolving ecosystem.\nDemonstrated experience leading the technical delivery of non-trivial projects end to end, from design through to production support.\nA desire to operate in a senior data engineering role, including deputising for the technical lead, owning design and implementation of data systems and pipelines, and setting engineering standards.\nAn inclusive, positive, collaborative mindset and a desire to deliver real business value to our customers.\nNice to have\nExperience with large-scale content management systems and big data platforms.\nExperience leading architectural decisions within a team or across teams.\nFamiliarity with CI/CD pipelines and infrastructure as code (GitHub Actions, Terraform).\nExposure to search, graph, or large-scale analytical databases.\nStrong ownership mindset and proven ability to drive outcomes in ambiguous problem spaces.\nWork in a way that works for you: -\nWe promote a healthy work/life balance across the organization. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, family leave and tuition reimbursement, we will help you meet your immediate responsibilities and long-term goals.\nWorking flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive.\nWorking for you: -\nAt Elsevier, we know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:\nGroup Health Insurance Policy (covering self and family)\nGroup Life insurance/accident policy\nGenerous long-service awards\nNew Baby gift\nSubsidized food provided (applies to India- Chennai)\nCasual Leave, Sick Leave, Privilege Leave, Compassionate Leave, Special Sick Leave, Gazetted Public Holiday and Maternity/Paternity Leave\nFree Transport provided to and from the office (applies to India-Chennai)\nAbout Us: -\nA global leader in information and analytics, we help researchers and healthcare professionals’ advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world’s\n\nWe know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Clickhereto access benefits specific to your location.\nWe are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.\nCriminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scamshere.\nPlease read our Candidate Privacy Policy.\nWe are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.\nUSA Job Seekers:\nEEO Know Your Rights.","description_format":"text","description_chars":7272,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Health insurance","Life insurance","Parental leave"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Publishing","Clinical Decision Support","Scientific & Lab Software"],"lifecycle":[{"event":"open","at":"2026-11-03T21:12:27Z"}],"visa":[],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":0,"expected_fill_days":26,"reasons":["conf:3","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-11-04T06:34:25Z"},"pay":null,"html_url":"https://alion.io/job/elsevier-senior-data-engineer-ii","json_url":"https://alion.io/job/elsevier-senior-data-engineer-ii.json","meta":{"generated_at":"2026-11-04T11:49:47Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":17739,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-05T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3090},"rest":"https://alion.io/mcp/rest/get_company?id=3090"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Felsevier-senior-data-engineer-ii"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Felsevier-senior-data-engineer-ii"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Felsevier-senior-data-engineer-ii"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/elsevier-senior-data-engineer-ii\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Felsevier-senior-data-engineer-ii"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3706444}},{"tool":"search_jobs","arguments":{"company":"elsevier.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3706444},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}