1,530,856open jobs
91,667companies
233,384added this week
Browse all
Salary
$225k – $300k per year
Location
Hybrid (Palo Alto, United States)
Seniority
Staff · 8+ years exp
Employment
Full-Time

Confirmed on the employer's own hiring board on Oct 12, 2026. First seen by Alion on Jul 13, 2026.

Overview
Company
Impact
Profile match
DataHub, formerly Acryl Data, runs the managed service behind the open-source metadata platform of the same name that was first developed inside LinkedIn and is now used by thousands of engineering organisations. Its product gives data teams a searchable catalog with column-level lineage, ownership records, quality monitoring and access policies across warehouses, streaming systems and business intelligence tools. Customers use it to answer who owns a dataset, what will break when it changes and which reports depend on it before a migration begins.

Join our team as a Staff Backend Engineer (Catalog) and play a crucial role in addressing the metadata crisis faced by enterprises as AI and data products become business-critical. You will lead the development of DataHub's Platform framework, which connects diverse data systems and powers our metadata collection capabilities. Your work will directly impact the deployment of AI systems at massive scale, affecting millions of users worldwide.

Missions

  • Lead the development of DataHub's Platform framework, focusing on connecting diverse data systems and enhancing metadata collection capabilities.
  • Design and implement scalable, fault-tolerant ingestion systems for enterprise-scale metadata, ensuring clean and intuitive APIs for the connector ecosystem.
  • Collaborate with engineering teams to address data discovery, lineage, and governance challenges, and contribute to the overall architecture of the metadata layer.

Profil recherché

- 8+ years building production-grade distributed systems

- Built and maintained online applications serving live traffic at scale (100+ QPS)

- Designed indexing, storage, and data architectures to make large-scale data accessible to online services

- Advanced Python and API design expertise

- Experience with high-scale data processing or integration frameworks

- Designed and scaled distributed systems

- Strong systems knowledge and distributed architecture experience

- Hands-on experience developing in a tight loop with LLMs and applying best practices for scalable LLM development

- Set up monitoring and alerting for services

- Proven track record solving complex technical challenges

- One of Java/Scala/Kotlin/C#/Go - very strong nice-to-have / borderline must-have

- Python/TypeScript/Node.js - nice-to-have

- CI/CD deployment pipelines

- AWS

- Kubernetes/Docker

- Microservice Architecture

- Early-stage startup experience

- Experience fine-tuning LLM-powered applications exposed to end users

- Experience building and maintaining services that make calls to LLMs in order to serve live traffic

- Open-source contributions

- Experience with DataHub or similar metadata/ETL frameworks (Airflow, Airbyte, dbt)

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,530,856 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Backend
Similar stack
Same company
Palo Alto
$85k – $158k per year • Hybrid • Grand Prairie
Python
C++
DevOps
RTOS
Git
Linux
Management
Confluence
Jira
Agile
Scrum
Apply
$200k – $271k per year • Equity • In office • Full-Time • 12+ years exp • Bachelor's Degree • Seattle
AI/ML
AI Agents
RAG
Agentic Workflows
Apply
≈ $102k – $202k per year (Estimated) • Remote (United States) • Full-Time • 5+ years exp • Bachelor's Degree • Columbus
Java
SQL
Java
Maven
Spring Boot
Databases
MySQL
Db2
Oracle
Apache Kafka
Google Bigtable
AI/ML
JAX
Tokenization
DevOps
Rest API
Terraform
GCP
CI/CD
Jenkins
Git
Docker
Kubernetes
Google Cloud Run
API Gateway
Management
Agile
Scrum
Kanban
Waterfall
QA
Swagger
Apply
≈ $105k – $181k per year (Estimated) • Remote (United States) • Full-Time • 5+ years exp • Bachelor's Degree • Columbus
Java
SQL
Java
Maven
Spring Boot
Databases
MySQL
Db2
Oracle
Apache Kafka
Google Bigtable
AI/ML
JAX
Tokenization
DevOps
Rest API
Terraform
GCP
GitHub Actions
CI/CD
Jenkins
Git
Docker
Kubernetes
Google Cloud Run
API Gateway
Management
Agile
Scrum
Kanban
Waterfall
QA
Swagger
Apply
≈ $121k – $222k per year (Estimated) • In office • 5+ years exp • Houston
Python
JavaScript
TypeScript
SQL
Python
Flask
SQLAlchemy
FastAPI
Celery
Pydantic
Alembic
Databases
PostgreSQL
Redis
Frontend
RxJS
Three.JS
Angular
Sass
NgRx
Angular Material
DevOps
GCP
WebSockets
Azure
CI/CD
Git
AWS
Docker
Management
Jira
QA
Playwright
Jest
Pytest
Apply
Principal Engineer 2 hours ago
≈ $101k – $204k per year (Estimated) • In office • Full-Time • Bachelor's Degree • London
Python
Java
Scala
Databases
Apache Kafka
DevOps
Splunk
OpenShift
Helm
OpenTelemetry
Prometheus
CI/CD
GitOps
Docker
Kubernetes
Grafana
Apply
≈ $15k – $40k per year (Estimated) • In office • Bachelor's Degree • Makati
Python
JavaScript
TypeScript
SQL
C#
Databases
MySQL
Apply
≈ $15k – $40k per year (Estimated) • In office • Bachelor's Degree • Makati
Python
JavaScript
TypeScript
SQL
C#
Databases
MySQL
Apply
≈ $53k – $111k per year (Estimated) • In office • Calgary
JavaScript
TypeScript
C#
C#
ASP.NET Core
Frontend
Angular
DevOps
Azure DevOps
Azure
CI/CD
Windows Server
Apply
≈ $34k – $80k per year (Estimated) • In office • Full-Time • 10+ years exp • Bachelor's Degree • Shenzhen
Java
SQL
Databases
Apache Kafka
DevOps
Kong
CI/CD
Linux
Apply
≈ $137k – $237k per year (Estimated) • Remote (United States) • Full-Time • 8+ years exp • Palo Alto
Python
Java
DevOps
Terraform
GCP
CloudFormation
Datadog
Prometheus
Pulumi
Azure
CI/CD
AWS
Docker
Kubernetes
Grafana
Platform Engineering
Service Mesh
Apply
≈ $156k – $286k per year (Estimated) • In office • Full-Time • 4+ years exp • Palo Alto
Databases
Snowflake
Google BigQuery
Amazon Redshift
BigQuery
AI/ML
dbt
Analytics
Power BI
Fivetran
Looker
Collibra
Alation
Apply
≈ $20k – $41k per year (Estimated) • In office • 5+ years exp • Bengaluru
Python
Java
DevOps
Terraform
GCP
CloudFormation
Prometheus
CI/CD
AWS
Docker
Kubernetes
Grafana
Platform Engineering
Self-Healing
Apply
≈ $28k – $57k per year (Estimated) • In office • 5+ years exp • Bengaluru
DevOps
CI/CD
Docker
Kubernetes
Incident Management
GitHub
Management
Linear
Jira
Agile
Scrum
Apply
$207k – $258k per year • Equity • In office • 5+ years exp • Palo Alto
Python
Go
Java
DevOps
Terraform
GCP
AWS CDK
CloudFormation
Datadog
Docker Swarm
Prometheus
Pulumi
Azure
CI/CD
GitOps
ArgoCD
Jenkins
Git
AWS
Docker
Kubernetes
Amazon EKS
Google GKE
Azure AKS
AWS Lambda
GitHub
GitLab
Amazon S3
Amazon ECS
Amazon CloudWatch
Linux
Management
Agile
Apply
$162k – $203k per year • In office • 5+ years exp • Bachelor's Degree • Palo Alto
Python
C++
Bash
Lua
AI/ML
OpenCV
CUDA Toolkit
TensorRT
OpenCL
CUDA
DevOps
Linux
IoT
FreeRTOS
Apply
$207k – $258k per year • Equity • In office • 8+ years exp • Bachelor's Degree • Palo Alto
Python
Rust
C++
Python
Dask
Databases
Apache Kafka
AI/ML
Spark
Flink
Ray
DevOps
Terraform
AWS CDK
CloudFormation
Datadog
Prometheus
AWS
Kubernetes
Grafana
Amazon CloudWatch
Amazon Kinesis
Linux
Apply
$50k per year • In office • Internship • Palo Alto
Management
Outlook
Microsoft Office
Apply
KOHLER Store Manager 11 hours ago
≈ $101k – $213k per year (Estimated) • In office • 5+ years exp • Bachelor's Degree • Palo Alto
Management
Outlook
Microsoft Office
Apply
See all jobs
This is one of many
1,530,856 more open roles from verified company boards, updated every day.