Big Data Engineer Graduate (Data Management Suite, Data Integration) - 2027 Start

岗位职责 / Responsibilities

Team Introduction

The Data Management Suite team builds products that support the full lifecycle of data pipelines, including data ingestion and integration, data development, data catalog, data security, and data governance. These products serve a wide range of businesses and help data engineers and data scientists significantly improve their productivity.

As a Data Engineer on the Data Management Suite team, you will have the opportunity to build, optimize, and scale one of the largest data platforms in the world. You will gain hands-on experience working on core systems across the data platform ecosystem, and your work will have a direct impact on the company’s core products and hundreds of millions of users.

We are looking for talented individuals to join our team. As a graduate, you will get opportunities to pursue bold ideas, tackle complex challenges, and unlock limitless growth.

Successful candidates must be able to commit to an onboarding date by the end of the year. Please state your availability and graduation date clearly in your resume.

Candidates can apply to a maximum of two positions and will be considered for jobs in the order you apply. The application limit is applicable to our Company and its affiliates' jobs globally. Applications will be reviewed on a rolling basis - we encourage you to apply early.

Responsibilities

- Design, develop, and optimize the architecture of large-scale data ingestion systems to support real-time data pipelines with high throughput, low latency, and fault tolerance.

- Improve the performance, scalability, and reliability of data ingestion pipelines.

- Develop and implement automated and intelligent operations and maintenance systems to monitor, diagnose, and ensure the stability and reliability of data ingestion pipelines.

- Collaborate with cross-functional teams to deliver event data ingestion, transformation, and storage solutions that meet diverse business requirements.

- Troubleshoot and resolve complex issues in production systems to ensure minimal downtime and optimal performance.

任职要求 / Requirements

Minimum Qualification(s)

- Individuals who are completing or have recently completed a Bachelor's / Master's degree in Computer Science, Software Engineering, or a related technical discipline.

- Experience in software development with proficiency in one or more programming languages, such as Java, Scala, Python, or Go.

- Strong understanding of data structures, algorithms, and distributed systems principles.

- Hands-on experience with big data technologies such as Hadoop, Flink, Kafka, or similar frameworks.

Preferred Qualification(s)

- Experience with real-time data processing frameworks such as Flink; contributions to open-source projects are a plus.

- Experience in the event tracking domain, including event collection, real-time processing, governance, quality assurance, and cost optimization.

- Understanding of data lakehouse architectures and the integration of stream and batch processing.

- Strong problem-solving skills and the ability to work effectively in a fast-paced, collaborative environment.