Member of Technical Staff (Backend Software Engineer, Search Crawler)

Perplexity AI • C++ • Go • Python • Rust • 1 year ago
Apply now
Save
368,634open jobs
9,437companies
50,578added this week
Browse all
Location
In office (Belgrade, Berlin, London)
Seniority
Staff · 5+ years exp
Employment
Full-Time
Overview
Company
Impact
Profile match

Perplexity AI

Perplexity AI is an American company that builds an answer engine combining live web search with large language models to return sourced, conversational responses instead of a list of links. Its products span a consumer assistant on web and mobile, the Comet browser, enterprise search over internal documents and the Sonar developer API that exposes the same grounded retrieval stack. Founded in 2022 in San Francisco by former researchers and engineers from OpenAI, Meta and Databricks, the company is backed by NVIDIA, IVP, New Enterprise Associates and SoftBank.
perplexity.ai • HQ: San Francisco, United States • AI Agents • Internet Services • Artificial Intelligence • Search Engines • LLM & Generative AI • 1001-5000 employees • Est. 2022

We are seeking an experienced Backend Software Engineer to join our Crawler team. In this role, you will design, develop, and operate systems that ingest, process, and manage web-scale data in support of our next generation of advanced search technologies. This is a critical, high-impact engineering position, requiring expertise across both backend and frontend components of our data acquisition stack.

Responsibilities

  • Take ownership of and lead projects focused on developing large-scale web crawlers, ingestion pipelines, and data processing systems.

  • Build, maintain, and optimize core backend and frontend components for crawler services, including storage, retrieval, and UI dashboards for data management.

  • Collaborate closely with Search and Infrastructure teams to ensure the reliable, high-quality ingestion and processing of billions of web pages.

  • Architect and implement fullstack features and scalable distributed systems that handle high-load and real-time data operations.

  • Rapidly iterate, experiment with novel approaches, and continuously enhance system performance, usability, and reliability.

Qualifications

  • Minimum of 5 years of software development experience, with strong knowledge of data structures and algorithms in at least one of the following languages: Python, C++, Rust, or Go.

  • Experience with large-scale web crawlers is highly desirable.

  • Proven experience building, deploying, and optimizing high-load, distributed, and hardware-adjacent services.

  • Deep understanding of cloud infrastructure, with hands-on experience in Kubernetes (K8s) and AWS.

  • Demonstrated passion for writing clean, efficient, and scalable systems.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,634 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
Belgrade
≈ $140k – $253k per year (Estimated) • In office • 5+ years exp • Long Beach
C++
Rust
C++
Protobuf
AI/ML
Human-in-the-Loop
DevOps
CI/CD
Vector
Apply
$100k – $500k per year • In office • Full-Time • 1+ year exp • Fort Collins
C++
Python
SystemVerilog
Cython
C++
CMake
Cython
PyBind11
AI/ML
ChatGPT
Claude
Copilot
Edge AI
Chips/EDA
Synopsys ZeBu
Apply
Remote/Hybrid • 7+ years exp • Bachelor's Degree
C#
JavaScript
Python
SQL
TypeScript
C#
ASP.NET Core
Blazor
Dapper
Databases
Oracle
Frontend
Angular
Bootstrap
JQuery
Vue.js
DevOps
AWS
Azure
Azure DevOps
CI/CD
Git
Apply
≈ $26k – $90k per year (Estimated) • Remote/Hybrid • 2+ years exp • Madrid
Python
Python
Celery
Django
Databases
Apache Kafka
MySQL
PostgreSQL
RabbitMQ
Redis
Apply
≈ $54k – $124k per year (Estimated) • Remote/Hybrid • 5+ years exp • Madrid
Python
Python
Celery
Django
Databases
Apache Kafka
MySQL
PostgreSQL
RabbitMQ
Redis
Apply
$275k – $375k per year • In office • Full-Time • 15+ years exp • San Francisco
AI/ML
Perplexity
Web3
Rollup
Apply
$180k – $300k per year • In office • Full-Time • 3+ years exp • San Francisco • New York
TypeScript
JavaScript
AI/ML
Perplexity
Frontend
GSAP
Tailwind CSS
Analytics
A/B Testing
Design
Figma
Framer
Management
Slack
Apply
$200k – $250k per year • In office • Full-Time • San Francisco
AI/ML
LLM
Perplexity
RAG
Apply
$200k – $400k per year • Remote/Hybrid • Full-Time • 4+ years exp • San Francisco • New York
Kotlin
Rust
TypeScript
AI/ML
Perplexity
AI Agents
Apply
$220k – $405k per year • In office • Full-Time • 5+ years exp • Bachelor's Degree • San Francisco • Palo Alto
Python
Rust
C++
Go
AI/ML
Perplexity
AI Agents
DevOps
AWS
Kubernetes
Apply
Remote/Hybrid • Full-Time • 3+ years exp • Belgrade • Prague • Brno
Python
Analytics
Power BI
Tableau
SpaceTech
QGIS
Apply
Remote/Hybrid • Full-Time • 6+ years exp • Belgrade
Python
SQL
Databases
PostgreSQL
Snowflake
AI/ML
Dagster
MLFlow
Prefect
RAG
Vertex AI
Amazon SageMaker
Feature Store
LLM Evaluation
OCR
AI Agents
DevOps
AWS
GCP
Kubernetes
Prometheus
Terraform
Vector
Analytics
Power BI
A/B Testing
Apply
In office • Full-Time • 1+ year exp • Bachelor's Degree • Belgrade
SQL
Apply
In office • 5+ years exp • Belgrade
JavaScript
Node JS
TypeScript
Frontend
GSAP
React.js
Sass
Three.JS
DevOps
Rest API
Design
Figma
Apply
Remote/Hybrid • Full-Time • 5+ years exp • Belgrade
Java
Python
SQL
Databases
Databricks
Google BigQuery
PostgreSQL
Snowflake
AI/ML
Dagster
MLFlow
Prefect
RAG
AI Agents
OCR
Time Series Forecasting
DevOps
AWS
CI/CD
GCP
Kubernetes
Prometheus
Pulumi
Terraform
Vector
Analytics
Power BI
Apply
See all jobs
This is one of many
368,634 more open roles from verified company boards, updated every day.
Browse all jobs Get matched roles