AI Platform Infrastructure Engineer (Telecom Domain)

​About the Project
DevBrother is partnering with a European telecommunications provider to build a highly secure, fully on-premise AI ecosystem from the ground up. We are looking for a hands-on Senior AI Platform & Infrastructure Engineer to take ownership of the hardware, models, and server infrastructure. You will act as the technical lead for the AI deployment, working remotely to configure systems with occasional travel to Croatia for bare-metal hardware setup and localized performance tuning.

​Key Responsibilities
​Infrastructure & Hardware: Lead the setup and configuration of multi-GPU servers, including BIOS, firmware, and NVIDIA driver optimization during on-site visits or via secure remote access.
​Local LLM Deployment: Serve and orchestrate open-source models using vLLM, SGLang, or similar frameworks. Manage quantized models, implement OpenAI-compatible endpoints, and configure routing/fallbacks between models.
​Search & Speech Ecosystem: Deploy embeddings, rerankers, and hybrid search solutions. Set up Open WebUI (or similar) with robust citation capabilities, alongside local Speech-to-Text (STT) and Text-to-Speech (TTS) deployments.
​Security & System Administration: Administer Ubuntu LTS environments with strict security protocols. Manage encrypted storage, SSO with MFA, TLS, and audit logging in a fully air-gapped/blocked internet environment.
​Operations & Monitoring: Build and maintain operational pipelines, including monitoring, alerting, and automated backups with tested restoration procedures.
​Dashboards & Web: Configure web applications integrated with SSO roles, time-series aggregations, and email alerts.
​Documentation: Write and maintain comprehensive runbooks, architecture diagrams, and security protocols.
​
Requirements
​5+ years of senior-level experience in ML infrastructure, bare-metal server deployment, or systems engineering.
​Upper-Intermediate (B2) or Advanced English for direct communication with stakeholders and technical documentation.
​Deep expertise in serving local LLMs (vLLM, SGLang) and building RAG pipelines.
​Strong background in Linux (Ubuntu LTS) administration, network security, and air-gapped environment configurations.
​Leadership capabilities with the ability to drive architectural decisions and coordinate integration with the data engineering team.
​Strong Plus: Domain experience in Telecom/VoIP to better understand the business context and use cases of the deployed ecosystem.
​Willingness to occasionally travel to Croatia for on-site hardware setup and infrastructure deployments.

We OFFER:
​A fast-paced, highly professional, international team environment with a flat structure and rapid decision-making.
​Competitive compensation packages commensurate with your background and product portfolio.
​Flexible, remote-first workflow optimized for seamless global alignment.
Medical Insurance in Ukraine and a Multisport program in Poland.
Offices in Ukraine (Kyiv, Kharkiv) and Poland (Wroclaw) or Remote.
Paid vacation, sick leave, and official holidays.
Legal & Accounting services.
The company provides all necessary equipment.
English classes and Education reimbursement.