{"id":35522,"url":"https://alion.io/job/yottalabs-gpu-cloud-platform-engineer","title":"GPU Cloud Platform Engineer","company":{"id":8214,"name":"Yotta Labs","domain":"yottalabs.com","url":"https://alion.io/company/yottalabs","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"B","score":75,"open_postings":3,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-16T05:45:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"inferred_payroll_markers","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":["Hong Kong","Singapore"],"countries":["HK","SG"],"hiring_countries":["US","CA","HK","SG"],"hiring_countries_total":4,"salary":null,"salary_estimate":{"min_usd":134000,"max_usd":243000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":314},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"AWS Trainium","optional":false},{"name":"Azure","optional":false},{"name":"Docker","optional":false},{"name":"GCP","optional":false},{"name":"Grafana","optional":false},{"name":"Helm","optional":false},{"name":"kubectl","optional":false},{"name":"Kubernetes","optional":false},{"name":"Prometheus","optional":false},{"name":"Rancher","optional":false},{"name":"Ray","optional":false},{"name":"SLURM","optional":false},{"name":"CUDA","optional":true},{"name":"CUDA Toolkit","optional":true},{"name":"GitHub","optional":true},{"name":"Go","optional":true},{"name":"gRPC","optional":true},{"name":"Hugging Face","optional":true},{"name":"NCCL","optional":true},{"name":"NVLink","optional":true},{"name":"Python","optional":true},{"name":"Quantization","optional":true},{"name":"SGLang","optional":true},{"name":"Triton","optional":true},{"name":"vLLM","optional":true}],"status":"live","first_seen_at":"2025-07-20T19:47:19Z","employer_posted_date":"2025-07-20","last_verified_at":"2026-10-16T19:17:10Z","board_verified":true,"closed_at":null,"days_open":453,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":452},"description":"Location: Remote (Global)\nType: Full-time\nCompany: Yotta Labs\nApply: \nAbout Yotta Labs\nYotta Labs is building the next generation multi-silicon AI cloud and runtime platform to power the world’s most demanding AI workloads. We enable training and inference across NVIDIA GPUs, AMD GPUs, and AWS Trainium, helping AI companies achieve the best performance and economics across heterogeneous hardware. Our mission is to provide high-performance AI computing and Model API services, enabling AI companies, research labs, and enterprises to train, deploy and integrate cutting-edge models at scale.\nRole Overview\nWe are seeking a GPU Cloud Platform Engineer to join our core infrastructure team and help build the next-generation AI compute cloud. In this role, you will design, deploy, and operate large-scale, multi-cluster GPU infrastructure across data centers and cloud environments. You will be responsible for ensuring high availability, performance, and efficiency of containerized AI workloads-ranging from LLMs to generative models-deployed in Kubernetes-based GPU clusters. If you're passionate about high-performance systems, distributed orchestration, and scaling real-world AI infrastructure, this role offers a unique opportunity to shape the backbone of our AI cloud platform.\nResponsibilities\nBuild and operate large-scale, high-performance GPU clusters; ensure stable operation of compute, network, and storage systems; monitor and troubleshoot online issues.\n\nConduct performance testing and evaluation of multi-node GPU clusters using standard benchmarking tools to identify and resolve performance bottlenecks.\n\nDeploy and orchestrate large models (e.g., LLMs, video generation models) across multi-cluster environments using Kubernetes; implement elastic scaling and cross-cluster load balancing to ensure efficient service response under high concurrency for global users.\n\nParticipate in the design, development, and iteration of GPU cluster scheduling and optimization systems. Define and lead Kubernetes multi-cluster configuration standards; Optimize scheduling strategies (e.g., node affinity, taints/tolerations) to improve GPU resource utilization.\n\nBuild a unified multi-cluster management and monitoring system to support cross-region resource monitoring, traffic scheduling, and fault failover. Collect key metrics such as GPU memory usage, QPS, and response latency in real time; configure alert mechanisms.\n\nCoordinate with IDC providers for planning and deploying large-scale GPU clusters, networks, and storage infrastructure to support internal cloud platforms and external customer needs.\n\nQualifications\nBachelor's degree or higher in Computer Science, Software Engineering, Electronic Engineering, or related fields; 3+ years of experience in system engineering or DevOps.\n\n5+ years of experience in cloud-native development or AI engineering, with at least 2 years of hands-on experience in Kubernetes multi-cluster management and orchestration.\n\nFamiliarity with the Kubernetes ecosystem; hands-on experience with tools such as kubectl, Helm, and expertise in multi-cluster deployment, upgrade, scaling, and disaster recovery.\n\nProficient in Docker and containerization technologies; knowledge of image management and cross-cluster distribution.\n\nExperience with monitoring tools such as Prometheus and Grafana; Has practical experience in GPU fault monitoring and alerting.\n\nHands-on experience with cloud platforms such as AWS, GCP, or Azure; understanding of cloud-native multi-cluster architecture.\n\nExperience with cluster management tools such as Ray, Slurm, KubeSphere, Rancher, Karmada is a plus.\n\nFamiliarity with distributed file systems such as NFS, JuiceFS, CephFS, or Lustre; ability to diagnose and resolve performance bottlenecks.\n\nUnderstanding of high-performance communication protocols such as IB, RoCE, NVLink, and PCIe.\n\nStrong communication skills, self-motivation, and team collaboration\n\nPreferred Experience\nExperience in developing and operating MaaS platforms or large-scale model inference clusters. Proven track record of leading multi-cluster system development or performance optimization projects.\n\nProficiency in CUDA programming and the NCCL communication library; understanding of high-performance GPUs like H100.\n\nAbility to develop standardized inference APIs (RESTful/gRPC) and automation tools using Golang or Python.\n\nHands-on experience with optimization techniques such as model quantization, static compilation, and multi-GPU parallelism; capable of profiling inference processes in multi-cluster setups and identifying bottlenecks like memory fragmentation and low compute efficiency.\n\nActive engagement with open-source communities such as Hugging Face and GitHub; deep understanding of the design principles of inference frameworks like Triton, vLLM, and SGLang; ability to perform secondary development and optimization based on open-source projects and quickly translate cutting-edge techniques into production-ready multi-cluster solutions.\n\nWhy Join Yotta Labs?\nBe part of a visionary team aiming to redefine AI infrastructure.\n\nWork on cutting-edge technologies that bridge AI and decentralized computing.\n\nCollaborate with experts from leading institutions and tech companies.\n\nEnjoy a flexible, remote work environment that values innovation and autonomy.\n\nHow to Apply\nInterested candidates should apply directly or send their resume and a brief cover letter to . Please include links to any relevant projects or contributions.","description_format":"text","description_chars":5560,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"},{"name":"Canada","iso":"CA","kind":"country"},{"name":"Hong Kong","iso":"HK","kind":"country"},{"name":"Singapore","iso":"SG","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Cloud Platforms (IaaS & PaaS)","AI Compute & Inference"],"lifecycle":[{"event":"open","at":"2025-07-20T19:47:19Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 1","filings_12m":1,"filings_prev_12m":1,"green_card_filings_12m":0,"median_offered_wage_usd":167500,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":1}],"liveness":{"score":5,"band":"cold","label":"Long shot","p_open":1,"p_active":0.161,"p_room":0.28,"age_days":452,"expected_fill_days":29,"reasons":["conf:3","win:tail","crowd:"],"computed_at":"2026-10-16T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/yottalabs-gpu-cloud-platform-engineer","json_url":"https://alion.io/job/yottalabs-gpu-cloud-platform-engineer.json","meta":{"generated_at":"2026-10-16T20:25:23Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":953,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":8214},"rest":"https://alion.io/mcp/rest/get_company?id=8214"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fyottalabs-gpu-cloud-platform-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fyottalabs-gpu-cloud-platform-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fyottalabs-gpu-cloud-platform-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/yottalabs-gpu-cloud-platform-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fyottalabs-gpu-cloud-platform-engineer"}]}