{"id":1911166,"url":"https://alion.io/job/breakmark-hr-ai-compute-engineer","title":"AI Compute Engineer","company":{"id":669676,"name":"Breakmark HR","domain":"breakmarkhr.com","url":"https://alion.io/company/breakmarkhr","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"B","score":80,"open_postings":5,"ghost_share":0,"stale_share":0.8,"repost_share":0,"time_to_fill_p50_days":22,"computed_at":"2026-10-12T06:55:09Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Colombia"],"countries":[],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CUDA","optional":false},{"name":"CUDA Toolkit","optional":false},{"name":"Linux","optional":false},{"name":"Mixture of Experts","optional":false},{"name":"NCCL","optional":false},{"name":"NVLink","optional":false},{"name":"Bash","optional":true},{"name":"InfiniBand","optional":true},{"name":"Kubernetes","optional":true},{"name":"Megatron-LM","optional":true},{"name":"NVIDIA NeMo","optional":true},{"name":"Python","optional":true},{"name":"PyTorch","optional":true},{"name":"SLURM","optional":true},{"name":"TensorRT","optional":true},{"name":"TensorRT-LLM","optional":true},{"name":"vLLM","optional":true}],"status":"live","first_seen_at":"2026-10-05T13:23:46Z","employer_posted_date":"2026-10-05","last_verified_at":"2026-10-12T11:46:55Z","board_verified":true,"closed_at":null,"days_open":6,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":6},"description":"AI Compute Architect\nMedellín, Colombia\nAbout the Role\nWe're building a next-generation AI infrastructure platform that delivers high-performance bare-metal GPU compute for large-scale AI training and inference.\nAs our AI Compute Architect, you'll lead the architecture, qualification, and operational readiness of our GPU infrastructure across rapidly scaling data centers. You'll make the platform work as an integrated production system that connects GPU servers, firmware, OS, NVIDIA software, high-performance fabrics, storage, provisioning, scheduling, observability, and on-site operations.\nYou won't replace our networking, storage, facilities, DevOps, or site-ops specialists, and you won't build every automation pipeline yourself. Your job is to provide the technical model that connects these domains. You'll define requirements, interpret the evidence, find where failures originate, and decide when infrastructure is ready for production. This is a hands-on architecture role, close to the hardware but with a platform-wide view.\nWhat You'll Do\nDefine the architecture: Set lifecycle standards for NVIDIA HGX platforms and validated baselines for firmware, BIOS, BMC, OS, drivers, CUDA, and NCCL. Own compatibility requirements and the model of GPU/CPU/memory/PCIe/NVLink/NVSwitch/NIC/storage relationships. Decide what testing each platform change requires before production.\n\nLead qualification and burn-in: Design the strategy for new clusters, new GPU platforms, repaired nodes, and major changes. That includes load profiles, duration, coverage, and pass criteria. Analyze fleet-wide distributions and outliers to separate isolated failures from systemic issues in hardware, firmware, software, topology, power, thermals, or test configuration.\n\nDiagnose health and performance: Interpret NVIDIA diagnostics and telemetry, covering GPU, NVLink, NVSwitch, PCIe, memory, network, thermal, and power signals. Lead root-cause analysis for intermittent, multi-node, and fleet-wide issues, including collective and point-to-point communication problems.\n\nValidate with real workloads: Define representative training and inference workloads, including dense, MoE, and different parallelism strategies. Set reproducible baselines for throughput, scaling, latency, and numerical behavior, and pinpoint whether degradation comes from compute, communication, storage, scheduling, or configuration.\n\nIntegrate across domains: Work with Network (topology, GPU-to-NIC locality, RDMA), Storage (access, checkpointing, recovery), Platform/DevOps (scheduler, containers, provisioning), and Facilities (power, thermal correlation). Route issues to the right specialists with solid evidence.\n\nOwn operational readiness and acceptance: Define health, readiness, quarantine, and return-to-service gates. Guide automation teams in building reproducible workflows and interpret their results. Translate customer requirements into validation strategies, rule platforms ready, degraded, conditional, or unsuitable, define remediation and re-test scope, and communicate risks to engineering, vendors, customers, and leadership.\n\nRequired Qualifications\nStrong hands-on experience with NVIDIA GPU infrastructure, including HGX or comparable large GPU server platforms.\n\nDemonstrated experience designing, executing, or leading burn-in and qualification across multi-node GPU clusters on H100, H200, B200, B300, or a comparable platform (direct B300 experience not required).\n\nExperience analyzing fleet-level qualification results, performance distributions, and hardware/software failures.\n\nStrong Linux systems administration and troubleshooting.\n\nExperience with NVIDIA drivers, CUDA, NCCL, DCGM, and GPU platform tooling.\n\nExperience diagnosing GPU, NVLink, NVSwitch, PCIe, thermal, power, or firmware problems.\n\nExperience validating intra-node and multi-node GPU communication, plus a working understanding of RDMA, GPUDirect RDMA, and high-performance AI fabrics.\n\nExperience deploying, provisioning, or operationalizing GPU clusters.\n\nExperience defining firmware, BIOS, OS, and software baselines, as well as health, quarantine, readiness, and return-to-service criteria.\n\nExperience interpreting distributed training or inference workload behavior.\n\nAbility to troubleshoot performance across GPU, host, network, storage, and software boundaries.\n\nAbility to define requirements for automation teams and interpret the outputs of automated validation systems.\n\nStrong root-cause analysis and problem-solving skills.\n\nClear communication of technical findings, risk, and remediation requirements.\n\nComfortable in fast-moving deployment, commissioning, and production environments.\n\nPreferred Qualifications\nNVIDIA B200 or B300 infrastructure.\n\nConnectX adapters, NVIDIA Quantum, InfiniBand, UFM, RoCE, or comparable networking.\n\nLarge-scale NCCL and distributed workload qualification.\n\nPyTorch, NeMo, Megatron, vLLM, or TensorRT-LLM.\n\nGPU schedulers such as Slurm, Kubernetes, Run:ai, Base Command, or equivalent.\n\nValidating shared storage and distributed checkpointing on high-performance platforms such as WEKA, VAST, or equivalent.\n\nInfrastructure automation, observability, telemetry, or fleet-management platforms.\n\nFormal customer acceptance testing.\n\nOperating GPU infrastructure across multiple data centers.\n\nPython, Bash, or equivalent scripting for troubleshooting infrastructure workflows.\n\nWhat We Value\nEngineers who have qualified and operated real GPU clusters and who understand what a test reveals, not just how to run it. We value evidence-based judgment, strong ownership of platform integrity, cross-domain leadership without overreach, disciplined and reproducible operations, clear communication of risk and uncertainty, and curiosity across GPU generations.","description_format":"text","description_chars":5783,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Colombia","iso":null,"kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Human Resources","Recruiting & Staffing"],"lifecycle":[{"event":"open","at":"2026-10-05T14:42:05Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.897,"p_room":1,"age_days":6,"expected_fill_days":22,"reasons":["conf:2","velocity","win:early"],"computed_at":"2026-10-12T06:55:09Z"},"pay":null,"html_url":"https://alion.io/job/breakmark-hr-ai-compute-engineer","json_url":"https://alion.io/job/breakmark-hr-ai-compute-engineer.json","meta":{"generated_at":"2026-10-12T12:42:39Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":19806,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":669676},"rest":"https://alion.io/mcp/rest/get_company?id=669676"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbreakmark-hr-ai-compute-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbreakmark-hr-ai-compute-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbreakmark-hr-ai-compute-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/breakmark-hr-ai-compute-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbreakmark-hr-ai-compute-engineer"}]}