Sr. Data Engineer

About Us

Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.

At Visa, you'll have the opportunity to create impact at scale - tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world.

Join Visa and do work that matters - to you, to your community, and to the world. Progress starts with you.

Job Description

Role Summary

The Senior Data Engineer will play a key role in designing, building, and evolving large-scale data platforms and services that power reporting, analytics, and data products across Visa.

This role is focused on building scalable, reliable data pipelines and reusable platform capabilities across modern cloud and big data environments. You will work with technologies such as Spark, PySpark, Kafka, Hadoop, and Hive to support batch and real-time data processing at enterprise scale.

Beyond building individual pipelines, you will help improve how data engineering is done across the organization by automating delivery processes, strengthening observability and data quality, establishing engineering standards, and developing reusable frameworks that enable teams to deliver new data products faster and more reliably.

You will work across engineering, analytics, and product teams to solve complex data challenges and help shape the future of Visa's reporting and analytics platforms.

What You'll Do

• Design, build, and optimize large-scale data pipelines and data services supporting batch and real-time processing.

• Develop scalable solutions using technologies such as Spark, PySpark, Kafka, Hadoop, Hive, and cloud-based data platforms.

• Architect data pipelines, data models, and reusable frameworks that support enterprise reporting, analytics, and data products.

• Build shared platform capabilities, services, and automation that can be adopted across multiple engineering teams.

• Improve data pipeline performance and reliability through performance tuning, workflow optimization, monitoring, and observability.

• Automate deployment and delivery processes to improve engineering efficiency and reduce the time required to bring new data capabilities to production.

• Establish automated quality gates and validation practices to improve data quality, reliability, and operational stability.

• Develop reusable blueprints and engineering patterns for new data services and data products.

• Implement and strengthen data governance practices, including data lineage, metadata management, access controls, monitoring, and validation.

• Troubleshoot complex performance and reliability issues across distributed data systems and identify opportunities for architectural improvement.

• Partner with engineering, analytics, product, and other technical teams to design and deliver end-to-end data solutions.

• Evaluate emerging technologies, including Generative AI, and identify opportunities to improve data engineering and platform capabilities.

• Lead technical initiatives from concept through implementation and adoption, influencing engineering practices across teams.

• Mentor engineers and contribute to technical design reviews, architecture discussions, and engineering best practices.

What We're Looking For

• Hands-on experience designing and building enterprise-scale data platforms, pipelines, or distributed data processing solutions.

• Strong experience with technologies such as Spark/PySpark, Kafka, Hadoop, Hive, or comparable big data technologies.

• Experience supporting both batch and real-time/streaming data processing.

• Experience designing scalable data architectures and solving performance, reliability, and data quality challenges.

• Experience building reusable data platforms, frameworks, shared services, or engineering capabilities used across multiple teams.

• Strong understanding of data quality, governance, lineage, metadata, observability, and operational reliability.

• Experience automating data engineering workflows, deployment pipelines, testing, and quality controls.

• Ability to independently diagnose complex distributed-system and data-platform issues and drive them through resolution.

• Ability to influence technical direction and drive initiatives across teams without requiring direct authority.

• Strong ownership and the ability to move technical initiatives from design through production and broader adoption.

Visa requires at least 3 days in office, expectations of these days will be confirmed by your Hiring Manager.

Qualifications

Basic Qualifications:

• 2+ years of relevant work experience and a Bachelors degree, OR 5+ years of relevant work experience.

Preferred Qualifications:

• Experience designing and operating data platforms at enterprise scale.

• Advanced experience with Apache Spark and PySpark, including performance tuning and optimization.

• Experience with Kafka or comparable streaming technologies and real-time processing architectures.

• Experience with orchestration technologies such as Apache Airflow.

• Experience with Hadoop, Hive, distributed storage, and modern cloud data architectures.

• Experience developing automated data quality, validation, monitoring, and observability frameworks.

• Experience with data governance capabilities including lineage, metadata management, and access controls.

• Experience designing reusable data engineering frameworks, shared services, or self-service platform capabilities.

• Experience improving CI/CD and automated delivery practices for data platforms.

• Exposure to Generative AI and its application within data engineering or analytics environments.

• Demonstrated ability to lead technically complex initiatives across multiple engineering teams.

Information for US Applicants

For roles located in the US, the estimated salary range for this position is $118,700.00 to $ 183,600.00 USD per year, which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge, skills, experience, and location. In addition, this position may be eligible for bonus and equity.Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401(k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program.

Work Hours

Varies upon the needs of the department.

Travel Requirements

This position requires travel 5-10% of the time.

Mental/Physical Requirements

This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers.

Visa is an EEO Employer

Qualified applicants will receive consideration for employment without regard to race, color religion, sex, national origin, sexual orientation, gender identity, disability or protect veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with the EEOC guidelines and applicable local law.