Senior Specialist, Data Engineering

Job Description

Senior Specialist, Data Engineering

The Opportunity:

Based in Hyderabad, joining a global healthcare biopharma company and be part of a 130-year legacy of success backed by ethical integrity, forward momentum, and an inspiring mission to achieve new milestones in global healthcare. Lead an organization driven by digital technology and data-backed approaches that supports a diversified portfolio of prescription medicines, vaccines, and animal health products. · Drive innovation and execution excellence. Be the leaders who have a passion for using data, analytics, and insights to drive decision-making, which will allow us to tackle some of the world's greatest health threats. Our Technology centers focus on creating a space where teams can come together to deliver business solutions that save and improve lives. AN integral part of our company IT operating model, Tech centers are globally distributed locations where each IT division has employees to enable our digital transformation journey and drive business outcomes. These locations, in addition to the other sites, are essential to supporting our business and strategy. A focused group of leaders in each tech center helps to ensure we can manage and improve each location, from investing in growth, success, and well-being of our people, to making sure colleagues from each IT division feel a sense of belonging to managing critical emergencies. And together, we must leverage the strength of our team to collaborate globally to optimize connections and share best practices across the Tech Centers.

Role Overview:

Do you see the bigger picture and how teams collectively deliver on business needs and goals? Are you a perfect mix of creativity, dedication, persistence, people and passion? If so, Senior Data Engineer role is a great career move to advance your communications and change skills while helping to establish a global team’s presence in Hyderabad! Our IT team is transforming the way our company uses the power of leading-edge science to save and improve lives around the world.

What will you do in this role

• Leads the design, construction, and maintenance of complex, scalable data pipeline architectures-ingesting, processing, and delivering high-quality data to stakeholders.
• Architects and optimize batch and real-time processing pipelines on Databricks and AWS, ensuring large-scale datasets are highly structured and ready for advanced analytics.
• Establishes, documents, and champions engineering standards, defining best practices to share and scale across the broader organization.
• Drives the technical delivery of high-impact data analytics initiatives, ensuring robust execution from ingestion to reporting.
• Develops deep, systemic knowledge of supported technologies; masters the architectural complexity and critical dependencies between multiple teams, Databricks platforms, and AWS cloud infrastructure.
• Collaborates intensively with peer platforms and technical leadership to evaluate, pilot, and implement modern data trends and methodologies within the corporate ecosystem.
• Translates strategic stakeholder business goals into technical architectures, designing robust solutions that directly unlock business value.
• Establishes and actively manages trust-based relationships with key business partners, product owners, and stakeholders.
• Monitors global data engineering market developments, identifying and prototyping next-generation pipeline patterns to increase performance and reduce operational costs.
• Fosters and builds a technical "community of practice", leveraging lessons learned from complex cloud analytics deployments to mentor junior engineers.
• Maintains accountability for team delivery, ensuring all engineered solutions meet rigorous quality standards, strict timelines, compliance regulations, and exceptional user experiences.
• Spearheads innovative experimentation, leading proof-of-concept development and defining quantitative, measurable success criteria for new technologies.
• Applies deep commercial domain expertise, with a specialized focus on designing data assets that support Salesforce CRM integrations and advanced commercial analytics.

What Should you have:

• 5-8 years of experience.
• Brilliant short and long-form writing and storytelling skills, capable of capturing authentic voice in written communication.
• Strong project management skills and proven ability to manage multiple projects at once in a fast-paced, collaborative, deadline-oriented environment.
• Able to quickly grasp information and develop clear communication with minimal guidance.
• Outstanding attention to detail. Our technology teams operate as business partners, proposing ideas and innovative solutions that enable new organizational capabilities. We collaborate internationally to deliver services and solutions that help everyone be more productive and enable innovation.
• High-Scale Languages: Expert in PySpark, Python, and advanced SQL with a strong focus on distributed computing and query optimization.
• Advanced IDMC Engineering: Proven experience designing complex, high-throughput ETL/ELT pipelines using IDMC, including advanced mapping configurations, parameterization, and performance optimization.
• Databricks Lakehouse Expert: Deep knowledge of Databricks optimization, Unity Catalog governance, and Delta Lake formats.
• AWS Cloud Architecting: Proven experience designing serverless AWS data infrastructure using Terraform, Lambda, S3, IAM, and Step Functions.
• Salesforce Integration Pipelines: Extensive experience building high-volume replication pipelines from Salesforce/Veeva CRM systems, handling polymorphic keys and schema shifts.
• Advanced Data Modeling: Expertise in enterprise semantic layers, slowly changing dimensions (SCD Type 2), and data warehousing architectures.
• CI/CD & Testing Automation: Experience designing robust GitOps workflows, automated testing frameworks, and continuous deployment pipelines.
• Technical Leadership: Experience writing architectural blueprints (Design documents), defining standards, and mentoring junior engineers.

Primary Skills:

SQL, Python, ETL, IDMC, AWS, Data warehousing, Databricks, Data modeling, and CI/CD

Secondary Skills:

Communication Skills

Who we are

We are known as well-known org Inc., Rahway, New Jersey, USA in the United States and Canada and our company everywhere else. For more than a century, bringing forward medicines and vaccines for many of the world's most challenging diseases. Today, our company continues to be at the forefront of research to deliver innovative health solutions and advance the prevention and treatment of diseases that threaten people and animals around the world.

What we look for

Imagine getting up in the morning for a job as important as helping to save and improve lives around the world. Here, you have that opportunity. You can put your empathy, creativity, digital mastery, or scientific genius to work in collaboration with a diverse group of colleagues who pursue and bring hope to countless people who are battling some of the most challenging diseases of our time. Our team is constantly evolving, so if you are among the intellectually curious, join us-and start making your impact today.

Required Skills:

Preferred Skills:

Current Employees apply HERE

Current Contingent Workers apply HERE

Secondary Language(s) Job Description:

#MSDHYDIT

Search Firm Representatives Please Read Carefully

Merck & Co., Inc., Rahway, NJ, USA, also known as Merck Sharp & Dohme LLC, Rahway, NJ, USA, does not accept unsolicited assistance from search firms for employment opportunities. All CVs / resumes submitted by search firms to any employee at our company without a valid written search agreement in place for this position will be deemed the sole property of our company. No fee will be paid in the event a candidate is hired by our company as a result of an agency referral where no pre-existing agreement is in place. Where agency agreements are in place, introductions are position specific. Please, no phone calls or emails.

Employee Status:

Relocation:

VISA Sponsorship:

Travel Requirements:

Flexible Work Arrangements:

Shift:

Valid Driving License:

Hazardous Material(s):

Job Posting End Date:

*A job posting is effective until 11:59:59PM on the day BEFORE the listed job posting end date. Please ensure you apply to a job posting no later than the day BEFORE the job posting end date.