Data Scientist LLM Fine - Tuning

We're looking for a Data Scientist to own how the language models inside the ANE product are adapted to the realities of network operations. You'll turn real operational data (alarms, syslogs, telemetry, configurations, runbooks and engineers' decisions) into training and evaluation datasets. You'll then fine-tune open-weight models that run entirely on customer premises. Your work directly improves how accurately ANE explains faults, how well it follows a customer's playbooks, and how reliably it supports engineers.

Responsibilities:

• Curate operational data: build datasets from network alarms, syslogs, SNMP and streaming telemetry, configuration data, incident history and runbooks, including cleaning, deduplication, labelling, and anonymisation of customer data.
• Turn engineer decisions into training signal: ANE records every proposed fix and whether an engineer approved, edited or rejected it. Use that record to build supervised and preference datasets.
• Fine-tune open-weight models: retrain and fine-tune LLMs and smaller language models (for example, Llama, Mistral, Qwen or DeepSeek) using LoRA/QLoRA, supervised fine-tuning and preference-optimisation methods, sized for customer GPU hardware.
• Build evaluation harnesses: measure domain accuracy, hallucination rates, tool-calling reliability and faithfulness to runbooks, so that no model ships without passing defined quality gates.
• Improve retrieval: fine-tune embedding models and tune RAG pipelines over vendor documentation and customer playbooks.
• Prepare models for on-premises deployment: handle quantisation, packaging and versioning so models run efficiently with local inference servers (for example, vLLM) in air-gapped environments.
• Support forecasting: contribute time-series models for capacity and bandwidth forecasting and device-health trends.
• Run the model lifecycle: maintain reproducible training pipelines, model registries (for example, MLflow), model cards and governance documentation.
• Work across the team: collaborate with our AI architect, software developers and network engineers, who carry more than 30 years of experience building carrier and enterprise networks.

Requirements:

• Strong working knowledge in data science or machine learning, including hands-on LLM fine-tuning.
• Strong Python and PyTorch, plus experience with Hugging Face Transformers, PEFT and TRL.
• Practical experience building fine-tuning datasets, including data cleaning, labelling strategy and synthetic data generation.
• Experience designing LLM evaluations and benchmarks, not just training runs.
• Comfort working on Linux GPU servers, with distributed training (DeepSpeed or FSDP) and model quantisation.
• Experience with RAG systems, embedding models and vector databases.
• Clear communication and the judgment to know when a model isn't ready to ship.

Nice to Have:

• Experience with network or IT operations data: syslog, SNMP, streaming telemetry, alarms or trouble tickets.
• Familiarity with IP/MPLS, optical or SD-WAN networks, or with network management platforms such as Nokia NSP, Cisco Crosswork, Juniper Paragon, Grafana or Prometheus.
• Experience deploying models in air-gapped or highly regulated environments.
• Time-series forecasting and anomaly detection experience.
• Knowledge of agentic AI, multi-agent systems or knowledge graphs.

Skills

LLM, PyTorch, Python, large language model