Salary
≈ $22k – $56k per year (Estimated)
Location
In office
Seniority
Middle · 4+ years exp
Employment
Full-Time
Overview
Company
Impact
Profile match
Job Mail is a South African online job board offering a large selection of vacancies across the country and some positions abroad. Job seekers can search and apply for jobs online, upload a CV and receive job alerts, while employers and recruitment agencies can advertise positions to a broad national audience. The brand is one of the longer-established names in South African job advertising and is operated from South Africa.
- Design, build, and deploy machine learning and LLM-based systems, including retrieval-augmented generation (RAG) pipelines, fine-tuned models, and agentic workflows.
- Own the full lifecycle of AI features: data collection and evaluation, model/prompt selection, experimentation, deployment, and monitoring in production.
- Build and maintain data pipelines, embeddings stores, and vector databases that support search, retrieval, and personalization.
- Evaluate and integrate third-party model APIs (OpenAI, Anthropic, etc.) alongside open-source and self-hosted models, balancing quality, latency, and cost.
- Fine-tune, train, and deploy open-source models on our own infrastructure - including data prep, training/fine-tuning runs, quantization, and self-hosted inference serving at scale.
- Establish evaluation frameworks and metrics to measure model quality, drift, hallucination rate, and business impact over time.
- Collaborate with full-stack engineers to expose AI capabilities through clean, well-documented APIs and SDKs.
- Implement guardrails, safety checks, and monitoring for AI systems running in production.
- Stay current with the fast-moving AI/ML landscape and bring back practical recommendations on tools, models, and techniques.
- Write clear technical documentation and communicate trade-offs to both technical and non-technical stakeholders.
- 4+ years of experience building and shipping machine learning or AI-powered systems in production.
- Strong Python skills, with hands-on experience using frameworks such as PyTorch, TensorFlow, or similar.
- Practical experience with large language models - prompting, fine-tuning, RAG, or agent frameworks (e.g., LangChain, LlamaIndex, or custom implementations).
- Hands-on experience training and fine-tuning open-source models (e.g., Llama, Mistral, Qwen) - full fine-tuning or parameter-efficient methods (LoRA/QLoRA) - and deploying them on your own infrastructure rather than relying solely on hosted APIs.
- Experience standing up self-hosted inference serving on your own infra (e.g., vLLM, TGI, Triton, Ray Serve), including GPU provisioning, batching, and cost/latency optimization.
- Solid understanding of ML fundamentals: model evaluation, overfitting, data leakage, and experimentation methodology.
- Experience with vector databases and embedding-based retrieval (e.g., Pinecone, Weaviate, pgvector, FAISS).
- Comfort working with cloud infrastructure (AWS, GCP, or Azure) and containerized deployments (Docker, Kubernetes), including GPU-backed compute.
- Familiarity with MLOps practices - model versioning, CI/CD for ML, monitoring, and rollback strategies for both hosted and self-hosted models.
- Strong software engineering fundamentals: clean code, testing, code review, and API design.
- Proficiency working with AI coding assistants (e.g., Claude Code, GitHub Copilot, Cursor) to accelerate development, while critically reviewing and validating AI-generated code.
- Excellent communication skills and comfort working in a remote, async-friendly environment.
- Experience with model quantization, distillation, or optimization techniques (e.g., GPTQ, AWQ, ONNX) for efficient self-hosted inference.
- Background in NLP, computer vision, or recommendation systems.
- Experience with streaming data pipelines (Kafka, Spark) or feature stores.
- Contributions to open-source ML/AI tooling.
- Prior experience in a startup or fast-growth environment.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
697,746 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Free forever. No card. Under a minute.
Your match
How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.
Recommended for you based on this role
Similar stack
Same company
In your city
Apps Dev Tech Sr Lead Analyst
1 hour ago
$145k – $218k per year • Remote/Hybrid • Full-Time • Bachelor's Degree • Mississauga
Python
Java
Kotlin
SQL
Databases
Weaviate
Pinecone
Apache Kafka
AI/ML
Copilot
AutoGen
LangChain
Fine-tuning
Prompt Engineering
AI Agents
Flink
LLM
RAG
Anomaly Detection
Feature Store
DevOps
CI/CD
AWS
Docker
Kubernetes
Trunk-Based Development
Chaos Engineering
Progressive Delivery
AIOps
SLI/SLO/SLA
Cybersecurity
Threat Modeling
Management
Agile
Apply
Full Stack Engineer
1 hour ago
≈ $22k – $55k per year (Estimated) • In office • Full-Time • 5+ years exp
Python
JavaScript
TypeScript
Python
FastAPI
Django
Databases
MySQL
PostgreSQL
AI/ML
Copilot
Cursor
Claude Code
LLM
RAG
Frontend
React.js
DevOps
Rest API
Terraform
GCP
Datadog
Azure
CI/CD
AWS
Docker
Grafana
QA
Sentry
Apply
Member of Technical Staff - Engineering
3 hours ago
$175k – $300k per year • In office • Bachelor's Degree • San Francisco
Python
Go
JavaScript
TypeScript
AI/ML
Cursor
Claude Code
Reinforcement Learning
Function Calling
AI Agents
LLMOps
OpenAI Codex
Tool Use
Reward Modeling
Machine Learning
Frontend
Next.js
React.js
DevOps
CI/CD
Kubernetes
QA
Selenium
Playwright
Apply
Scientific Chemistry (Python, AI Evaluation)
1 hour ago
≈ $39k – $112k per year (Estimated) • Remote • Contractor • Master's Degree
Python
AI/ML
SciPy
NumPy
Gemini
LLM
Apply
Scientific Chemistry (Python, AI Evaluation)
1 hour ago
≈ $39k – $112k per year (Estimated) • Remote • Contractor • Master's Degree
Python
AI/ML
SciPy
NumPy
Gemini
LLM
Apply
Finance Internship
1 hour ago
≈ $9k – $17k per year (Estimated) • In office • Internship
Analytics
Power BI
Apply
E-Commerce IT Operations Assistant
1 hour ago
≈ $9.5k – $18k per year (Estimated) • In office • Full-Time • 2+ years exp
Management
Microsoft Office
Apply
Production Planner / AutoCAD Draughter
1 hour ago
≈ $15k – $40k per year (Estimated) • In office • Full-Time • Germiston
Design
AutoCAD
Apply
Repair Service Coordinator
1 hour ago
≈ $9.5k – $18k per year (Estimated) • In office • Full-Time • 2+ years exp • Edenvale
Management
Microsoft Office
Apply
≈ $18k – $44k per year (Estimated) • In office • Full-Time • Cape Town
Management
Jira
Agile
Apply
This is one of many
697,746 more open roles from verified company boards, updated every day.

