Platform Engineer (Rust)

Polars

Polars is the next generation of DataFrames. We don’t take the easy route and build from the ground up, controlling every element allows us to create a superior solution. Our open-source implementation is one of the fastest growing data projects on GitHub and has over 30 thousand stars and 100 million downloads to date.

We believe data processing should be a seamless experience from working locally on your development machine to an enterprise production environment. There should be one framework to learn for data practitioners, removing the need for rewriting code when going to production. To make that possible, we are building a cloud platform to seamlessly bring locally developed Polars pipelines to production. We are also building a distributed engine for Polars to scale beyond the limits of a single machine, both in the cloud and on-premises.

How will you make an impact?

You will be working on fundamental components of both the Polars Cloud platform and the Polars distributed query engine. Some of the things you will be working on are designing gRPC / REST api’s, leader election and failover for cluster nodes, replication of distributed query state and more. For these problems, you will cooperate closely with the cloud platform and compute engine teams.

Requirements

• You are familiar with Linux and can find what you need in manpages

• You are proficient in async Rust (Tokio)

• You are familiar with distributed systems architecture and implementation

• You prefer simple solutions to complex ones, but know when complex solutions are needed

• You enjoy working across different domains in a small team

Benefits

• An important role in a high-growth startup allowing plenty of growth opportunities in diverse directions

• Chance to work with and learn from a small strong technical team passionate about data processing and software engineering

• Competitive salary

• Stock option package

• Flexible working hours

We're looking for someone who can join us in our Amsterdam office twice a week to collaborate with the team, drive faster development and ideation, and help build our team culture.