{"id":2870710,"url":"https://alion.io/job/farcana-backend-engineer-llm-inference","title":"Backend Engineer (LLM inference)","company":{"id":4430105,"name":"Farcana","domain":"farcana.com","url":"https://alion.io/company/farcana","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"PeopleForce","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["United Arab Emirates"],"countries":["AE"],"hiring_countries":["AE"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":37000,"max_usd":96000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2216},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon S3","optional":false},{"name":"Auth0","optional":false},{"name":"Cloudflare","optional":false},{"name":"Go","optional":false},{"name":"gRPC","optional":false},{"name":"JavaScript","optional":false},{"name":"Jest","optional":false},{"name":"LLM","optional":false},{"name":"Node JS","optional":false},{"name":"OpenAI","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"Redis","optional":false},{"name":"Rest API","optional":false},{"name":"Stripe","optional":false},{"name":"Supertest","optional":false},{"name":"Testcontainers","optional":false},{"name":"TypeScript","optional":false},{"name":"WebSockets","optional":false},{"name":"Java","optional":true},{"name":"KV Cache","optional":true},{"name":"SGLang","optional":true},{"name":"TGI","optional":true},{"name":"vLLM","optional":true}],"status":"live","first_seen_at":"2026-10-19T19:33:56Z","employer_posted_date":"2026-10-19","last_verified_at":"2026-10-21T19:03:07Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":"01. ABOUT THE COMPANYDizzaract is a product-driven company operating at the intersection of gaming, digital platforms, and AI. We build and scale multiple products, including FAR Labs & Gamed - each exploring a different space, yet united by a shared approach: moving fast, staying curious, and focusing on things that people actually use.\nWe operate as a collaborative, non-hierarchical team where ideas are valued based on their impact, not their origin, and where AI is embedded across everything we build, from infrastructure to product decisions.\n02. ABOUT THE ROLE\nFAR Labs is building a distributed inference platform that serves large language models across a heterogeneous GPU fleet through a unified, OpenAI-compatible API. Latency, throughput, cost, and reliability are at the core of the product.\nWe're looking for a Senior Backend Engineer to own the architecture and evolution of our core backend services. This is a hands-on role with real technical ownership. You'll turn ambiguous problems into clear technical plans, make architectural decisions, and take responsibility for what happens after your code ships.\n03. WHAT YOU'LL OWN\nBackend Architecture & Development\nDesign, build, and maintain backend services in Go and TypeScript/JavaScript (Node.js), plus Python where it fits\nBuild and scale distributed systems that stay reliable as traffic and complexity grow\nOwn features end to end, from design docs and implementation through testing and release\nIdentify tech debt, bottlenecks, and reliability risks before they become problems\nLLM Serving & APIsDesign and maintain OpenAI-compatible APIs for chat completions, streaming, and tool calls\nBuild token streaming over SSE/WebSockets with proper cancellation, disconnect handling, and partial responses\nBuild request routing and load balancing across inference backends by model, capacity, latency, and region\nImplement backpressure, queueing, and admission control for variable-cost LLM workloads\nDesign REST and gRPC interfaces between internal services\nData & StorageDesign and optimize data models in PostgreSQL\nUse Redis/Valkey for caching, state, and high-performance workloads\nIntegrate with S3-compatible storage and Cloudflare R2\nAuth, Billing & IntegrationsBuild authentication and authorization flows with Auth0 and JWT\nBuild token-based rate limiting and usage metering for multi-tenant APIs\nBuild reliable third-party integrations, including Stripe payments, with retries, idempotency, and proper failure handling\n Performance & QualityProfile and optimize services for latency (TTFT, inter-token latency), throughput, and resource usage\nImplement caching, concurrency, rate limiting, and timeout strategies\nWrite automated tests using Go testing tools, Jest/Supertest, pytest, and Testcontainers\nMentor engineers and raise the bar through code reviews and design discussions\n04. REQUIREMENTS\n5+ years of professional backend engineering experience\nStrong commercial experience with both Go and TypeScript/JavaScript (Node.js); Python is a plus\nProven experience building and operating distributed systems, with an understanding of consistency, fault tolerance, and service-to-service communication\nDeep understanding of concurrency models and how they work under the hood: Go's goroutines, channels, and scheduler, and Node.js's event loop and async/await model, including the trade-offs between them\nStrong database knowledge: schema design, indexing, query optimization, transactions and isolation levels, and locking, primarily in PostgreSQL\nExperience with Redis, Valkey, or similar in-memory stores\nExperience building backend systems that serve LLM inference, or a strong understanding of the request lifecycle, token streaming, and long-running requests\nExperience building streaming APIs (SSE/WebSockets), including cancellation and client disconnect handling\nUnderstanding of OpenAI-compatible API design and its streaming and error semantics\nExperience with request routing, load balancing, backpressure, and admission control for workloads where request cost varies widely\nHands-on experience designing REST and/or gRPC APIs\nExperience building auth systems with JWT, Auth0, or similar\nTrack record of leading the design of systems or major features end to end, including writing design docs and driving decisions across teams\nExperience debugging and resolving complex production issues in systems you owned\nAbility to make trade-offs between speed, reliability, and maintainability, and to explain them clearly\n05. NICE TO HAVE\nFamiliarity with inference engines like vLLM, SGLang, or TGI, and concepts like continuous batching and KV cache\nExperience with fair scheduling and tenant isolation on shared inference capacity\nExperience with failover and retries for inference requests without duplicating billing or output\nExperience with usage metering and billing for AI or developer APIs\nStripe or other payment infrastructure\nS3-compatible storage or Cloudflare R2\nBuilding developer-facing APIs or platform products\n06. WHAT WE OFFER\nReal ownership of the backend that powers FAR Labs' inference platform\nInfluence over backend architecture and product direction\nHands-on work on hard problems in distributed systems, real-time streaming, and LLM serving\nA small, senior team with fast execution and low bureaucracy\nCompetitive salary with performance-based incentives\n24 days annual leave plus public holidays\nHealth insurance\nModern office in Yas Creative Hub","description_format":"text","description_chars":5464,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Annual leave","Health insurance"],"hiring_locations":[{"name":"United Arab Emirates","iso":"AE","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Web3 & dApps"],"lifecycle":[{"event":"open","at":"2026-10-19T19:33:56Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":1,"expected_fill_days":30,"reasons":["conf:1","velocity","win:early"],"computed_at":"2026-10-21T05:46:15Z"},"pay":null,"html_url":"https://alion.io/job/farcana-backend-engineer-llm-inference","json_url":"https://alion.io/job/farcana-backend-engineer-llm-inference.json","meta":{"generated_at":"2026-10-21T21:20:56Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":30349,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4430105},"rest":"https://alion.io/mcp/rest/get_company?id=4430105"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ffarcana-backend-engineer-llm-inference"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ffarcana-backend-engineer-llm-inference"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ffarcana-backend-engineer-llm-inference"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/farcana-backend-engineer-llm-inference\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ffarcana-backend-engineer-llm-inference"}]}