{"id":1179946,"url":"https://alion.io/job/halyk-bank-middle-ai-engineer","title":"Middle AI Engineer","company":{"id":47313,"name":"Halyk Bank","domain":"halykbank.kz","url":"https://alion.io/company/halykbank","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"HeadHunter","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"middle","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Almaty, Kazakhstan"],"countries":["KZ"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"Asyncio","optional":false},{"name":"AWQ","optional":false},{"name":"AWS","optional":false},{"name":"Chroma","optional":false},{"name":"CI/CD","optional":false},{"name":"Clean Architecture","optional":false},{"name":"DeepSpeed","optional":false},{"name":"Docker","optional":false},{"name":"Docker Compose","optional":false},{"name":"DPO","optional":false},{"name":"FastAPI","optional":false},{"name":"Fine-tuning","optional":false},{"name":"FSDP","optional":false},{"name":"GCP","optional":false},{"name":"GGUF","optional":false},{"name":"Git","optional":false},{"name":"GitHub Actions","optional":false},{"name":"GPT-4","optional":false},{"name":"GPTQ","optional":false},{"name":"Grafana","optional":false},{"name":"HTTPX","optional":false},{"name":"Hugging Face","optional":false},{"name":"Kubernetes","optional":false},{"name":"KV Cache","optional":false},{"name":"LangChain","optional":false},{"name":"LangGraph","optional":false},{"name":"LangSmith","optional":false},{"name":"LLaVA","optional":false},{"name":"LLM","optional":false},{"name":"LoRA","optional":false},{"name":"Mistral","optional":false},{"name":"Mypy","optional":false},{"name":"OpenAI","optional":false},{"name":"OpenTelemetry","optional":false},{"name":"PEFT","optional":false},{"name":"Perplexity","optional":false},{"name":"pgvector","optional":false},{"name":"Pinecone","optional":false},{"name":"Poetry","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Prometheus","optional":false},{"name":"Pydantic","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Qdrant","optional":false},{"name":"QLoRA","optional":false},{"name":"Quantization","optional":false},{"name":"Qwen","optional":false},{"name":"RabbitMQ","optional":false},{"name":"RAG","optional":false},{"name":"Redis","optional":false},{"name":"Rest API","optional":false},{"name":"RLHF","optional":false},{"name":"Ruff","optional":false},{"name":"RunPod","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"TGI","optional":false},{"name":"Tokenization","optional":false},{"name":"Transformers","optional":false},{"name":"TRL","optional":false},{"name":"vLLM","optional":false},{"name":"VLM","optional":false},{"name":"WebSockets","optional":false},{"name":"Agile","optional":true},{"name":"AutoGen","optional":true},{"name":"CrewAI","optional":true},{"name":"Gradio","optional":true},{"name":"MLFlow","optional":true},{"name":"Streamlit","optional":true},{"name":"TensorRT","optional":true},{"name":"Weights & Biases","optional":true}],"status":"live","first_seen_at":"2026-09-24T13:16:56Z","employer_posted_date":"2026-09-24","last_verified_at":"2026-10-19T19:00:56Z","board_verified":true,"closed_at":null,"days_open":27,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":27},"description":"Halyk Банк - это мощная экосистема, где технологии сочетаются с ценностями.\nМы гордимся более чем 14 000 работниками, которые делают нас лучшим местом работы. Мы предоставляем услуги во всех сегментах финансового рынка: банковском, страховом, лизинговом и т.д.\nМы стремимся стать ведущим цифровым банком, внедряя инновации и предоставляя возможности для роста и развития.\nМы ищем талантливых специалистов, готовых развиваться вместе с нами!\n Обязанности:\n Разработка и внедрение LLM/VLM-решений для бизнес-задач компании;\n Проектирование и построение RAG-пайплайнов для работы с корпоративными данными Разработка и оптимизация мульти-агентных систем на базе LangGraph и LangChain Настройка и обслуживание инференс-серверов (vLLM, TGI, TensorRT-LLM) Fine-tuning моделей (LoRA, QLoRA, RLHF, DPO) под специфические задачи;\n Разработка REST API на FastAPI для интеграции ML-сервисов в продукт;\n Контейнеризация и деплой ML-сервисов с помощью Docker и Kubernetes;\n Оптимизация производительности моделей: квантизация, батчинг, управление GPU-памятью;\n Проектирование и поддержка векторных баз данных для хранения эмбеддингов;\n Написание и поддержка автоматических тестов для ML-пайплайнов;\n Мониторинг качества моделей в продакшене (LangSmith, OpenTelemetry);\n Проведение бенчмарков и A/B-тестов для сравнения моделей и подходов;\n Работа с GPU-инфраструктурой: настройка multi-GPU, распределённое обучение\n Подготовка и очистка данных для обучения и оценки моделей;\n Исследование и внедрение новых моделей, техник и фреймворков;\n Написание технической документации и ADR (Architecture Decision Records);\n Участие в код-ревью и менторинг младших специалистов;\n Взаимодействие с продуктовой командой для определения требований и приоритетов;\n Оптимизация стоимости облачной GPU-инфраструктуры;\n Обеспечение безопасности и надёжности ML-сервисов в продакшене.\n Требования:\n Python;\n Python 3.10+ (async/await, type hints, dataclasses). SOLID, Clean Architecture, DI. pytest + mocks, Ruff/Black/MyPy, Poetry/uv, Git & CI/CD;\n LLM / VLM\n Transformer (attention, KV-cache). Модели: GPT-4, LLaMA 3, Mistral, Qwen, LLaVA, GPT-4o. Fine-tuning: LoRA/QLoRA, PEFT, RLHF, DPO. Prompting: CoT, ReAct, Few-shot. Evaluation: LLM-as-judge, perplexity. Tokenization (tiktoken);\n LangChain & LangGraph LangChain (LCEL, Agents, Tools, Memory), LangGraph (multi-agent graphs), RAG-пайплайны, Vector DB (Chroma, Pinecone, Qdrant, pgvector), LangSmith;\n Инференс vLLM (PagedAttention, continuous batching), Quantization (GPTQ, AWQ, GGUF), Serving (vLLM, TGI, TensorRT-LLM), OpenAI-compatible API. PyTorch & DL PyTorch, Hugging Face (Transformers, PEFT, TRL), Distributed (DDP, FSDP, DeepSpeed), BF16/FP16. GPU & Инфраструктура NVIDIA (H100, A100, RTX 4090), multi-GPU parallelism, Cloud (AWS/GCP/RunPod), мониторинг nvidia-smi;\n Backend FastAPI, Pydantic v2, async (asyncio, httpx), WebSockets/SSE, JWT. DevOps Docker (GPU), Docker Compose, Kubernetes basics, GitHub Actions, Prometheus/Grafana;\n Хранилища PostgreSQL + pgvector, Redis, S3, Vector DBs, Kafka/RabbitMQ. Nice to Have CrewAI, AutoGen, MLflow/W&B, Airflow, Streamlit/Gradio.\n Уровни опыта: Junior: Python, PyTorch, LangChain, Docker Middle: Fine-tuning, RAG, vLLM, FastAPI, LangGraph Senior: Архитектура, distributed training, MLOps Lead: Стратегия, оптимизация затрат, лидерство Soft Skills: Аналитическое мышление, техническая коммуникация, быстрое обучение, English B2+, Agile.\n Условия:\n Заработная плата и бонусы: конкурентоспособная оплата труда благодаря системе грейдирования, премии ко Дню Независимости и годовой бонус.\n Социальный пакет: ДМС и страхование жизни, мобильная связь и скидки от партнеров.\n Отпуск и отдых: 26 дней отпуска с возможностью взять дополнительные дни при наступлении важных событий.\n Бонусы за рекомендации.\n Рабочие условия: льготные условия на паркинг, свободный стиль одежды (smart casual).\n Обучение и развитие: тренинги, вебинары и доступ к корпоративной библиотеке, четкая система карьерного роста.\n Корпоративная культура: открытая и дружеская рабочая атмосфера, спортивные турниры и активная корпоративная жизнь.\n Инициативы и проекты: возможность участия в социальных проектах, реализация идей в новых проектах группы «Halyk» с использованием современных digital-инструментов.\n Команда: творческая и поддерживающая команда для реализации ваших идей.\n Присоединяйтесь к нам и становитесь частью команды «Halyk»!","description_format":"text","description_chars":4389,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"Russian","level":"Advanced (C1)","optional":false}]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-09-24T13:20:21Z"}],"visa":[],"liveness":{"score":56,"band":"ok","label":"Likely open","p_open":1,"p_active":0.745,"p_room":0.75,"age_days":26,"expected_fill_days":30,"reasons":["conf:34","velocity","win:late"],"computed_at":"2026-10-21T05:46:15Z"},"pay":null,"html_url":"https://alion.io/job/halyk-bank-middle-ai-engineer","json_url":"https://alion.io/job/halyk-bank-middle-ai-engineer.json","meta":{"generated_at":"2026-10-21T17:02:34Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":24019,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":47313},"rest":"https://alion.io/mcp/rest/get_company?id=47313"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fhalyk-bank-middle-ai-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fhalyk-bank-middle-ai-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fhalyk-bank-middle-ai-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/halyk-bank-middle-ai-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fhalyk-bank-middle-ai-engineer"}]}