430,210open jobs
14,612companies
64,442added this week
Browse all
Salary
$188k – $388k per year (Estimated)
Location
In office (San Francisco)
Seniority
Staff
Employment
Full-Time
Overview
Company
Impact
Profile match
Index : kitd this commitmain process supervisor for OpenBSDabout summary refs log tree commit diff log msgauthorcommitterrange KITD(8) System Manager's Manual KITD(8) NAME kitd — process supervisor SYNOPSIS kitd [-d] [-c cooloff] [-m maximum] [-n name] [-t restart] command ...

Our mission is general causal intelligence; AI that is capable of (1) predicting the future and (2) identifying the actions to alter it.

To achieve this breakthrough, we are building a Large Physics foundation Model (LPM) because physical systems, unlike text or images, are governed by verifiable cause and effect. We believe that scaling on physics will enable an understanding of causality required to predict and control physical systems, starting with weather.

Our founding team has built and deployed AI against the physical world in robotics, drug discovery, and particle physics at institutions like DeepMind, Waymo, Cruise, Insitro, Nabla Bio, and CERN.

We look for data engineers who are excited to tackle unsolved problems. Data is critical to any ML model but is especially consequential for our thesis to learn physics from sensory observations. The vast majority of meaningful progress in AI comes not from new architectures, but from training on data that is carefully curated with specific characteristics, quality, and scale.

Responsibilities

Your mission is to own every dataset end to end - from discovering the source and securing access, to writing the pipelines that ingest it, to guaranteeing it enters training clean, standardized, and correct.

  • Research and source new modalities of multimodal physical data (e.g. sparse sensors, point clouds, hyperspectral imagery, radar), and secure access through partnerships, vendors, and public archives

  • Build petabyte-scale data pipelines (e.g. Apache Spark) that ingest each source into our storage in standardized, training-ready form, across both batch and streaming - including the orchestration, storage, and monitoring they need where shared platform infrastructure doesn't yet exist

  • Develop quality metrics that measure coverage, correctness, and consistency across sources - and catch the subtle inconsistencies (sensor bias, drift, processing artifacts) that silently degrade models

  • Design and implement automated QA checks that continuously measure and monitor data quality over time, and own the verdicts they produce

  • Write technical requirements and provide actionable feedback to external data vendors and partners

  • Collaborate with researchers to validate that new and improved datasets translate into model performance

What we're looking for

We value a relentless approach to problem-solving, rapid execution, and the ability to quickly learn in unfamiliar domains.

  • Demonstrated experience building large-scale data pipelines, QA systems, or evaluation workflows (e.g. Spark, Ray, Beam)

  • Detail-oriented in identifying subtle data inconsistencies and issues that could affect quality, with the ability to understand how quality impacts model performance

  • Comfortable going deep on unfamiliar source material - reading format specifications, sensor documentation, and vendor manuals to get ingestion exactly right

  • Experience working with external data vendors and partners, from technical evaluation to ongoing feedback

  • Owns deliverables end-to-end, from collecting and translating requirements to autonomously driving execution

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
430,210 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
San Francisco
$104k – $259k per year (Estimated) • Remote/Hybrid • Full-Time • 8+ years exp • Master's Degree • Petah Tikva
Python
Java
C++
Scala
C++
TensorFlow C++
PyTorch C++
Databases
Databricks
AI/ML
Spark
JAX
AI Agents
Flink
TensorFlow
PyTorch
Ignite
Feature Store
Recommender Systems
Apply
Remote/Hybrid • 4+ years exp
Python
SQL
Python
pySpark
Databases
Databricks
AI/ML
Spark
dbt
AI Agents
Agentic Workflows
DevOps
GCP
CI/CD
Apply
$52k – $132k per year (Estimated) • In office • Full-Time • Bachelor's Degree • Brussels
Python
SQL
C#
C#
.NET
Databases
Databricks
AI/ML
Spark
Airflow
DevOps
Git
Analytics
ETL/ELT
Apply
Data Engineer 1 day ago
$58k – $93k per year (Estimated) • Remote/Hybrid • Full-Time • Bachelor's Degree • Warsaw
Python
SQL
Python
pySpark
Databases
Databricks
Delta Lake
AI/ML
Spark
DevOps
Azure DevOps
Azure
CI/CD
Git
Gitflow
Analytics
Power BI
ETL/ELT
Dimensional Modeling
Apply
$180k – $238k per year • Remote/Hybrid • 5+ years exp • Bachelor's Degree • Dublin
AI/ML
Multimodal AI
Anthropic
Interpretability
Web3
Rollup
Apply
$184k – $380k per year (Estimated) • In office • Full-Time • San Francisco
Python
Rust
DevOps
Terraform
GCP
Pulumi
SLURM
Azure
AWS
Docker
Kubernetes
IAM
Cybersecurity
Okta
SOC 2
FedRAMP
Zero Trust
Threat Modeling
Microsoft Entra ID
Apply
$207k – $428k per year (Estimated) • In office • Full-Time • San Francisco
AI/ML
Reinforcement Learning
Post-training
Robotics
Reinforcement Learning
Apply
$195k – $402k per year (Estimated) • In office • Full-Time • San Francisco
AI/ML
Multimodal AI
Computer Vision
World Models
Robotics
Sensor Fusion
Apply
$199k – $411k per year (Estimated) • In office • Full-Time • San Francisco
AI/ML
Interpretability
Apply
$181k – $373k per year (Estimated) • In office • Full-Time • San Francisco
DevOps
Terraform
GCP
Azure
AWS
Docker
Kubernetes
Apply
$60k – $100k per year • In office • Full-Time • 3+ years exp • San Francisco
Apply
$77k – $170k per year (Estimated) • In office • Full-Time • 3+ years exp • San Francisco
Apply
$140k – $210k per year • Equity • In office • Full-Time • 4+ years exp • San Francisco
Python
Go
TypeScript
DevOps
GCP
CI/CD
Kubernetes
Management
Stripe
Apply
$200k – $250k per year • Equity 1–2% • In office • Full-Time • 3+ years exp • San Francisco
Apply
$160k – $250k per year • Equity 1–2% • In office • Full-Time • 3+ years exp • San Francisco
Python
AI/ML
PyTorch
DevOps
AWS
Apply
See all jobs
This is one of many
430,210 more open roles from verified company boards, updated every day.