2,412,331open jobs
149,945companies
294,556added this week
Browse all
Location
In office

Confirmed on the employer's own hiring board on Nov 20, 2026. First seen by Alion on Nov 20, 2026.

Overview
Company
Impact
Profile match
Mind Studios is a trusted technology partner for growing companies. We build long-term partnerships to scale your product and business.
Overview

We are supporting an established recruitment organisation developing an AI-powered platform. We need a hands-on engineer to improve ingestion and the pipelines feeding production search and matching.

You will own production data delivery, improve reliability and quality, and work alongside specialist technical leadership. The emphasis is on strong ETL/ELT, data modelling and workflow orchestration, supporting production search and matching.

Data migrations run through an existing Go layer, so candidates need sufficient Go understanding to follow the workflows and investigate issues with platform engineering colleagues.

About the Project

- Remove ingestion bottlenecks and make the flow from approved sources to search and matching reliable.

- The stack includes PostgreSQL/pgvector, VoyageAI embeddings via Amazon Bedrock, and an existing Go layer driving data migrations and orchestration.

- Work with specialist data and ML expertise, platform engineering, Product and DevOps.

- Follow approved consent and access rules; escalate unresolved decisions.

Requirements

Essential Technical Experience

- Hands-on ownership of production ETL/ELT pipelines, including transformations, incremental processing, failure investigation and recovery.

- Strong SQL and PostgreSQL data modelling.

- Experience managing complex workflow dependencies, retries, partial failures and backfills. DAG-based orchestration using Apache Airflow, Dagster or equivalent tools or approaches is relevant evidence.

- Working understanding of Go sufficient to follow existing migration/orchestration code, trace data flows and collaborate with platform engineering on investigation and changes.

- APIs, batch/asynchronous processing, schema evolution, metadata and lineage.

- Idempotency, reconciliation and safe recovery or reruns.

- Production vector search and embedding pipelines for search or matching.

- Diagnosing input, embedding, indexing and downstream quality issues.

- Cloud operation, automated testing, code review and deployment discipline.

- Monitoring, alerts, runbooks, privacy-aware modelling and access controls.

Desirable Technical Experience

- Direct pgvector and Amazon Bedrock experience is strongly preferred.

- VoyageAI embedding integrations and embedding evaluation.

- Python data-processing experience.

- Entity resolution and search relevance.

Market Experience

- Data pipelines supporting production search, matching or ML products - Required.

- Recruitment Technology / HRTech and recruitment data - Desirable.

Soft Skills and Working Style

- Clear communication and collaboration with Product, Engineering and DevOps.

- Independent investigation, practical problem-solving and attention to detail.

- Ownership of implementation, operational reliability and follow-through.

- Clarify ambiguity, explain decisions, verify results and escalate blockers.

Responsibilities

Pipeline Ownership, ETL/ELT and Orchestration

- Document the existing sources, transformations, processing dependencies, scheduling or triggers, and failure modes during handover.

- Automate ingestion, validation, deduplication and incremental updates from approved sources.

- Make source onboarding repeatable and reduce the validated backlog.

- Manage dependent processing stages, including partial failures, retries and backfills, with clear checks on downstream data correctness.

Recovery, Data Quality and Lineage

- Implement safe retries, checkpoints, replay/backfill and quarantine without silent loss or duplication.

- Reconcile record counts and maintain metadata, source identifiers and lineage.

- Detect schema changes, apply quality checks and investigate failures.

Production Operation and Matching

- Maintain matching-service interfaces and contribute to agreed ML/matching changes.

- Test embedding/indexing consistency, compatibility and matching quality.

- Work with DevOps on logs and alerts for freshness, failures, throughput, latency and cost.

- Maintain tests, deployment discipline and runbooks for independent operation and recovery.

Privacy and Collaboration

- Implement approved consent, access, separation, retention and deletion rules; report unresolved mappings.

- Clarify requirements, report progress and escalate unresolved legal decisions to the client

Assessment Process

1. CV Review

2. Screening Call (30 mins) - Technical screening to understand experience

3. Technical assessment/challenge. (1 hr)

4. Final Interview (30 mins) - Cultural fit, collaboration instincts, MVP mindset

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,412,331 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
In your city
Data Engineer 14 days ago
In office · Full-Time · Chicago
Python
SQL
Python
pySpark
Databases
Databricks
Amazon Redshift
AI/ML
Spark
Machine Learning
DevOps
AWS
Amazon S3
Amazon Kinesis
Apply
In office · Contractor · Trotwood
DevOps
Azure
Analytics
ETL/ELT
Apply
In office · Pune
SQL
C#
C#
.NET
Databases
MS SQL
AI/ML
OCR
DevOps
Rest API
Azure DevOps
Dynatrace
Azure
CI/CD
GitHub
Windows
Cybersecurity
Checkmarx
SIEM
Apply
In office · 3+ years exp · Bachelor's Degree · Bengaluru
SAS
Life Sciences
CDISC
Apply
Hybrid · 5+ years exp · Bachelor's Degree · Bengaluru
Python
SQL
Databases
SAP HANA
Databricks
AI/ML
Embeddings
Scikit-learn
AI Agents
TensorFlow
PyTorch
LLM
RAG
Knowledge Graph
Multi-Agent Systems
Machine Learning
DevOps
GCP
Azure
AWS
Management
ServiceNow
Apply
See all jobs
This is one of many
2,412,331 more open roles from verified company boards, updated every day.