Data Engineer - IBM Quantum

Job Description

Job Title: Data Engineer - IBM Quantum. Location: Research Triangle Park, NC, Yorktown Heights, NY, Austin, TX, Chicago, IL, New York, NY

Responsibilities:

• Design, build, and maintain scalable and reliable data pipelines that support analytics, operational dashboards, and quantum hardware performance insights.
• Design and implement ETL/ELT processes to move data between operational systems and business intelligence platforms.
• Build scalable data connectors for IBM Quantum's Lakehouse platform.
• Develop and maintain data integration workflows with a strong focus on data quality, accuracy, reliability, and continuous improvement.
• Apply advanced SQL using PostgreSQL and Presto for complex analytical queries and performance optimization.
• Build and manage workflow orchestration using Apache Airflow, including dependency management, retries, monitoring, and backfills.
• Develop data transformations, validation pipelines, and analytics using Python and related libraries such as pandas;
• Process large-scale datasets, including system telemetry, experiment metadata, cloud operations data, and quantum device performance metrics.
• Work with streaming platforms such as Apache Kafka or IBM Event Streams to process event-driven data from distributed quantum systems.
• Apply streaming architecture concepts, including topics, partitions, consumer groups, and schema evolution;
• Integrate multiple technical data sources, including quantum hardware telemetry, calibration data, experiment logs, job execution data, user activity, and system health metrics.
• Collaborate with quantum hardware, software, cloud, SRE, product, and analytics teams to deliver production-ready data solutions.
• Use Git-based version control, participate in code reviews, and follow software engineering best practices.

Qualifications:

• Bachelor's degree in Computer Science, Data Engineering, Software Engineering, or a related field.
• Experience designing, building, and maintaining scalable ETL/ELT data pipelines.
• Strong SQL skills using PostgreSQL and Presto.
• Experience with Python, including pandas and related data processing libraries.
• Experience building and operating Apache Airflow workflows;
• Experience processing large-scale heterogeneous datasets.
• Familiarity with Apache Kafka or IBM Event Streams.
• Understanding of streaming architectures and distributed data systems.
• Experience with Git and collaborative software development practices.
• Strong problem-solving, communication, and collaboration skills.

Preferred:

• Master's degree in a related field.
• Experience with Lakehouse architectures, including IBM watsonx.data.
• Experience with distributed analytics platforms such as Presto, Trino, or Apache Spark.
• Knowledge of data modeling for analytics and reliability engineering.
• Familiarity with data governance, dataset ownership, lineage, and lifecycle management.
• Experience operating cloud-based or distributed data pipelines;
• Experience working with hardware telemetry, infrastructure monitoring, or large operational datasets.
• Interest or experience in quantum computing, advanced hardware systems, or cryogenic technologies.

Benefits and Compensation:

• Annual salary: $116,000 to $200,000, depending on experience, skills, and location.
• Comprehensive healthcare benefits, including medical, prescription, dental, vision, and mental health coverage.
• Financial benefits including 401(k), pension plan, employee stock purchase plan, financial counseling, life insurance, and disability coverage.
• Performance-based incentive opportunities;
• Paid time off including holidays, vacation, sick leave, parental bonding leave, and paid family leave where applicable.
• Access to IBM's AI-powered learning platform with training and industry certifications.
• Employee resource groups, volunteer opportunities, and discounts on products, services, and experiences.

Other Information:

• Work arrangement: Hybrid.
• Travel requirement: Up to 20% (approximately one day per week).
• No visa sponsorship is available for this position. Applicants must already have authorization to work in the United States without current or future sponsorship.
• IBM is committed to equal employment opportunity and welcomes applicants from diverse backgrounds;
• The position supports IBM Quantum's mission of developing industry-leading quantum computing systems, software, and cloud services through advanced data engineering and analytics.