Data Lake Studio Manager

At eBay, we're more than a global ecommerce leader - we’re changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We’re committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts.

Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work - every day. We're in this together, sustaining the future of our customers, our company, and our planet.

Join a team of passionate thinkers, innovators, and dreamers - and help us connect people and build communities to create economic opportunity for all.

Job Summary

We are looking for a proactive and technically skilled Data Lake Studio Manager to oversee and expand our Data Lake Studio workspace. This platform allows our customers-data engineers, analysts, and business teams-to easily transfer data across diverse storage systems and coordinate intricate data pipelines from start to finish.

In this role, you will be responsible for the operational success, feature adoption, and reliability of our Studio platform. You will ensure users can easily set up connectors for cross-storage data transfers. You will build and schedule automated ETL/ELT workflows, monitor job execution, and provide transparency into data movement across cloud, on-premises, and object storage systems.

Key Responsibilities

• Data Transfer & Storage Coordination

• Direct the Studio’s data movement suite, maintaining high efficiency, reduced latency, and consistent reliability for batch and streaming transfers across multiple storage platforms (e.g., S3, ADLS, GCS, HDFS, relational databases, and data warehouses).
• Coordinate connector connectivity, throughput efficiency, error-handling mechanisms, and schema evolution during cross-storage data migrations and replication tasks.
• Drive self-service ingestion frameworks, allowing customers to easily register new data sources and targets without manual infrastructure setup.

2. Workflow Orchestration & Pipeline Management

• Take responsibility for the operational health and user experience of the pipeline orchestration engine within the Studio (e.g., DAG-based scheduling, event-driven triggers, dependency management).
• Define standards and guidelines for customer pipeline development, ensuring fault tolerance, automatic retry policies, and backfilling capabilities.
• Maintain pipeline observability, providing customers with comprehensive monitoring dashboards, real-time logging, and configurable alerting for job failures or bottlenecks.

3. Customer Enablement & Platform Operations

• Act as the functional owner and advocate for Studio users, streamlining onboarding, documentation, template creation, and self-service workflows.
• Monitor compute and network costs associated with large-scale data transfers and processing workloads, establishing prioritization quotas and cost-optimization practices.
• Troubleshoot customer partner concern issues related to pipeline execution failures, lockouts, or network efficiency bottlenecks between storage tiers.

4. Data Governance & Security Oversight

• Ensure all cross-storage data movements align with organizational security policies, encryption standards (in-transit and at-rest), and compliance frameworks (e.g., GDPR, SOC 2, HIPAA).
• Coordinate identity management, granular credential mapping, and Role-Based Access Control (RBAC) across external storage endpoints and Studio pipeline tasks.

Qualifications & Requirements

Education & Experience

• Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field, or equivalent experience.
• Experience: 5+ years of hands-on experience in Data Engineering, Data Platform Management, or Cloud Data Operations, with 2+ years in a team lead, product owner, or manager capacity.

Technical Skills

• Data Movement & Storage: Demonstrated proficiency with various storage architectures (S3, ADLS, GCS, HDFS, SFTP) and tools/frameworks for high-throughput data transfer.
• Orchestration Frameworks: Extensive hands-on experience with enterprise orchestration tools (e.g., Apache Airflow, Prefect, Dagster, Temporal, or cloud-native workflow managers).
• ETL / ELT & Processing: Experience with distributed computing frameworks (e.g., Apache Spark, Apache Flink).
• Storage & Catalog Protocols: Knowledge of open table formats (e.g., Apache Iceberg, Delta Lake, Apache Hudi) and metadata catalog integration.
• Scripting & Querying: Strong proficiency in SQL and Python.

Leadership & Operations

• Strong track record of improving developer/user experience for self-service analytics platforms.
• Excellent communication skills to interface effectively with both software engineers and business collaborators.
• Hands-on experience with SLAs/SLOs, monitoring tooling (e.g., Prometheus, Grafana, Datadog), and DataOps methodologies.

Additional Details

The base pay range for this position is expected in the range below:

Base pay offered may vary depending on multiple individualized factors, including location, skills, and experience. The total compensation package for this position may also include other elements, including a target bonus and restricted stock units (as applicable) in addition to a full range of medical, financial, and/or other benefits (including 401(k) eligibility and various paid time off benefits, such as PTO and parental leave). Details of participation in these benefit plans will be provided if an employee receives an offer of employment.

If hired, employees will be in an “at-will position” and the Company reserves the right to modify base salary (as well as any other discretionary payment or compensation program) at any time, including for reasons related to individual performance, Company or individual department/team performance, and market factors.

Remote roles are not eligible for U.S. visa sponsorship.

eBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status. If you have a need that requires accommodation, please contact us at [email protected]. We will make every effort to respond to your request for accommodation as soon as possible. View our accessibility statement to learn more about eBay's commitment to ensuring digital accessibility for people with disabilities. It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

We use cookies to enhance your experience and may use AI tools for administrative tasks in the hiring process. To learn how we handle your personal data and use AI responsibly, please visit ourTalent Privacy Notice, Privacy Center and AI Hiring Guidelines.