{"id":731622,"url":"https://alion.io/job/g-core-labs-s-a-python-inference-engineer","title":"Python Inference Engineer","company":{"id":6268,"name":"Gcore","domain":"gcore.com","url":"https://alion.io/company/g-core-labs-s-a","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":null},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Serbia"],"countries":["RS"],"hiring_countries":["CY"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Docker","optional":false},{"name":"Kubernetes","optional":false},{"name":"Linux","optional":false},{"name":"Machine Learning","optional":false},{"name":"Multimodal AI","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"SGLang","optional":false},{"name":"TensorRT","optional":false},{"name":"TensorRT-LLM","optional":false},{"name":"vLLM","optional":false},{"name":"CUDA","optional":true},{"name":"LoRA","optional":true},{"name":"PEFT","optional":true},{"name":"Quantization","optional":true},{"name":"Speculative Decoding","optional":true},{"name":"Triton","optional":true}],"status":"live","first_seen_at":"2026-09-09T12:18:58Z","employer_posted_date":"2026-09-09","last_verified_at":"2026-10-27T21:44:27Z","board_verified":true,"closed_at":null,"days_open":48,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":48},"description":"This position is available only under an employment (labor) agreement. \nThe world’s digital experiences run on something invisible: the infrastructure and software that keep them fast, reliable, and secure. At Gcore,you’ll help design and deliver that foundation for an AI-driven world.\nWe’re a global provider of infrastructure and software solutions for AI, cloud, network, and security, powering everything from real-time communication and streaming to enterprise AI and secure web applications. With 210+ edge locations, 50+ cloud regions, and thousands of GPUs, your work here can reach users and businesses across the globe.\nYou’ll collaborate with leading technology partners such as Intel, NVIDIA, Dell, and Equinix, and work on platforms that power digital products used around the world. Our vision is simple: to connect the world to AI, anywhere, anytime.\nWant to work on technology that goes beyond a single product or industry? Join a global team of 550+ professionals building infrastructure and software that supports the entire digital ecosystem.\nWe are currently looking fora Python Inference Engineer to join our Edge Cloud&AI Team.\n What You’ll Do\nBuild and improve the inference layer of the Gcore Inference platform.\nIntegrate and operate inference frameworks such as vLLM, SGLang, NVIDIA Dynamo, and TensorRT-LLM.\nBring new language and multimodal models into production.\nImprove inference latency, throughput, memory use, GPU utilization, and cost efficiency.\nDebug performance and reliability issues across model code, inference frameworks, GPU execution, networking, and Kubernetes.\nWork with platform, infrastructure, product, and customer-facing teams to turn inference improvements into reliable product features.\nContribute improvements to open-source inference projects when appropriate.\n What We’re Looking For\n5+ years of experience writing reliable, well-tested production code.\nStrong Python skills and experience designing production systems.\nHands-on experience with PyTorch and deploying machine learning models.\nExperience with Linux, Docker, and Kubernetes.\nExperience in at least one relevant area: distributed systems, GPU computing, ML runtimes, model optimization, or cluster scheduling.\nAbility to debug complex problems across software, infrastructure, and hardware.\nStrong sense of developer experience: you think about how systems are used, not just how they work.\nGenuine interest in inference engineering. You do not need direct experience with inference engines, but you should be motivated to learn.\nGood communication and collaboration skills.\nNice to Have\nExperience with vLLM, SGLang, NVIDIA Dynamo, TensorRT-LLM, or a similar inference framework.\nExperience running GPU workloads in production.\nKnowledge of inference techniques such as quantization, continuous batching, speculative decoding, prefix caching, chunked prefill, or LoRA serving.\nExperience with CUDA, Triton, TensorRT, or other GPU programming tools.\nExperience profiling and improving model latency, throughput, memory use, or GPU utilization.\nExperience with distributed inference, multi-GPU systems, scheduling, or autoscaling.\nContributions to open-source ML, inference, or infrastructure projects.\n Benefits\nAt Gcore, we want you to do your best work and enjoy the journey. Our benefits are designed to support your growth, well-being, and life beyond work:\nCompetitive compensation \nFlexible working hours and hybrid or remote options, depending on your role\nCompetitive compensation \nWork from anywhere in the world for up to 45 days per year \nPrivate medical insurance for you and your family* \nExtra paid vacation and sick leave days* \nSupport for life’s important moments and celebrations \nLanguage courses to help you connect and grow \nModern, welcoming offices with snacks, drinks, and entertainment* \nTeam sports and social activities* \n*Benefits may vary depending on your location.\nEqual Opportunity Employer\nWe provide equal opportunity to all applicants without regard to race, color, religion, sex, sexual orientation, age, gender identity, gender expression, national origin, disability, or any other legally protected characteristics.","description_format":"text","description_chars":4174,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":["Flexible schedule","Health insurance"],"hiring_locations":[{"name":"Cyprus","iso":"CY","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Cloud Platforms (IaaS & PaaS)","CDN & Edge Delivery","AI Compute & Inference","Web Security & DDoS Protection"],"lifecycle":[{"event":"open","at":"2026-09-11T09:56:32Z"}],"visa":[],"liveness":{"score":28,"band":"fade","label":"Fading","p_open":1,"p_active":0.796,"p_room":0.35,"age_days":47,"expected_fill_days":22,"reasons":["conf:2","velocity","win:tail"],"computed_at":"2026-10-27T05:46:45Z"},"pay":null,"html_url":"https://alion.io/job/g-core-labs-s-a-python-inference-engineer","json_url":"https://alion.io/job/g-core-labs-s-a-python-inference-engineer.json","meta":{"generated_at":"2026-10-27T22:14:21Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13845,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-28T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6268},"rest":"https://alion.io/mcp/rest/get_company?id=6268"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fg-core-labs-s-a-python-inference-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fg-core-labs-s-a-python-inference-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fg-core-labs-s-a-python-inference-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/g-core-labs-s-a-python-inference-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fg-core-labs-s-a-python-inference-engineer"}]}