{"id":4161684,"url":"https://alion.io/job/mercari-software-engineer-platform-engineering-aigpu-infra-on-prem-mercari","title":"Software Engineer, Platform Engineering - AI/GPU Infra (On-Prem) - Mercari","company":{"id":914,"name":"Mercari","domain":"mercari.com","url":"https://alion.io/company/mercari","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":{"grade":"A","score":85,"open_postings":119,"ghost_share":0.168,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":91,"computed_at":"2026-11-15T07:52:55Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Minato, Japan"],"countries":["JP"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"Bash","optional":false},{"name":"BGP","optional":false},{"name":"DNS","optional":false},{"name":"FinOps","optional":false},{"name":"GCP","optional":false},{"name":"Google GKE","optional":false},{"name":"InfiniBand","optional":false},{"name":"Istio","optional":false},{"name":"Linux","optional":false},{"name":"LLM","optional":false},{"name":"OSPF","optional":false},{"name":"PCI DSS","optional":false},{"name":"Platform Engineering","optional":false},{"name":"Python","optional":false},{"name":"Service Mesh","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"TCP/IP","optional":false},{"name":"TPU","optional":false},{"name":"VLAN","optional":false},{"name":"VPN","optional":false},{"name":"Cloudflare","optional":true},{"name":"CUDA","optional":true},{"name":"DHCP","optional":true},{"name":"Gemma","optional":true},{"name":"GitHub","optional":true},{"name":"HPC","optional":true},{"name":"Kubernetes","optional":true},{"name":"Llama","optional":true},{"name":"NCCL","optional":true},{"name":"NVIDIA NIM","optional":true},{"name":"Qwen","optional":true},{"name":"SLURM","optional":true},{"name":"Triton","optional":true},{"name":"vLLM","optional":true}],"status":"live","first_seen_at":"2026-11-12T12:29:01Z","employer_posted_date":"2026-11-12","last_verified_at":"2026-11-15T10:15:00Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":1},"description":"JD in Japanese follows. 英文の後に和文JDをご覧いただけます。\nSoftware Engineer, Platform Engineering - AI/GPU Infra (On-Prem) - Mercari\nEmployment Status: Permanent\n Work Hours: Full Flextime (no core time)\nOffice: Roppongi\nFor more details, see the Overview of Our Positions section on our Careers site.\nAbout Mercari\nCirculate all forms of value to unleash the potential in all people\n\"What can I do to help society thrive with the finite resources we have?\" The Mercari marketplace app was born in 2013 out of this thought by our founder Shintaro Yamada as he traveled the world. We believe that by circulating all forms of value, not just physical things and money, we can create opportunities for anyone to realize their dreams and contribute to society and the people around them. Mercari aims to use technology to connect people all over the world and create a world where anyone can unleash their potential. For more information about Mercari Group's mission, see Mercari’s Culture Doc.\nOrganization/Team Mission\nMercari Engineering Principles\nMercari Engineering Principles are a shared understanding that serves as the foundation of engineering beliefs and behavior at Mercari. The Engineering Principles are designed to complement the organizational identity (Mercari's mission, values, and culture) from an engineering viewpoint. These principles ultimately help us achieve Mercari's mission by defining the ideal state we seek to realize in the long term.\nPassion For The Product\nGrow Together\nSolve Through Mechanisms\nCollaborate Openly\nFor more details, please see Engineering Culture.\nSee here for more information about our mission and values.\nThe Platform team helps Mercari engineers deliver more reliable services and improve development efficiency by managing the entire network - from edge areas such as the CDN to the cloud, service mesh (Istio), and physical data centers. As Mercari invests in self-hosted compute for its AI/LLM initiatives, we are building a new on-premises GPU infrastructure capability within the team. This role owns the on-prem side: securing data-center facilities and building the network foundation that enables GPU compute, and integrating it securely with our existing cloud and platform networks. We are primarily looking for a data-center (DC) network engineer - ideally with hands-on GPU installation and maintenance experience - who will also collaborate closely with our Corporate IT team on facilities, connectivity, and on-site operations.\nWork Responsibilities\nDesign, build, and operate Mercari's on-prem DC/GPU infrastructure, including data-center facilities (racks, power, cooling) and the supporting network\nDesign and build the network foundation for GPU workloads: compute fabric (InfiniBand/RoCE), storage/in-band, service network, and isolated OOB management\nDesign, configure, and operate routing for the on-prem GPU fabric and its cloud/platform interconnects using BGP (and OSPF/IS-IS, VLAN/VRF as needed), including ASN planning, route summarization, and routing policy\nCoordinate with data-center providers and SI partners on facility readiness, equipment procurement, lead times, and remote-hands/installation work\nManage Mercari's internal data center end to end, including vendor/SI discussions, commercial negotiations, and contract & procurement handling\nPerform hands-on, on-site data-center networking work - running and changing cabling, and configuring routers, switches, firewalls, and other network devices (this role requires regular physical visits to our data center)\nIntegrate the on-prem DC/GPU environment securely with existing corporate, cloud (GCP/AWS), and platform networks\nEstablish monitoring, alerting, logging, and operational handoff for GPU systems and network devices\nSupport GPU PoC execution and help define the path from PoC to production\nAutomate provisioning and operations, and manage configuration as code (IaC)\nCollaborate closely with the Corporate IT team on data-center facilities, connectivity, and on-site operations (this collaboration is required for the role)\nCollaborate with ML Platform, Infrastructure, Security, and Procurement stakeholders\nOwn data-center facility readiness (rack, power, cooling, carry-in routes), including NVIDIA pre-delivery site survey confirmation for DGX B200/B300-class nodes\nDrive RFP, quotation, and vendor selection cycles with partners, and own NDA, R&R/RACI, contract, and PO handling together with Procurement\nPrepare technical and cost materials for internal approval gates (JB Engineering board, investment committee, Procurement Team), including TCO/ROI comparison against cloud GPU/TPU\nBuild and operate storage and dataset paths for models and checkpoints, and keep the stack portable between on-prem and GCP/GKE so workloads can fall back to cloud\nDefine and operate SLOs, on-call, incident response, runbooks, and BCP/DR for the on-prem inference environment, aligned with Mercari SRE practices\nBring on-prem GPU and compute nodes to parity with Mercari's cloud security posture (asset visibility, endpoint/posture tooling, audited bastion, isolated OOB access) together with Enterprise Security\nTrack and report GPU utilization, power, and token-cost savings with FinOps as capacity scales from the first node to multi-node\nUnique Challenges\nStand up Mercari's first on-premises GPU infrastructure largely from the ground up, owning facility, network, and operational readiness end to end\nBridge cloud-native networking practices with traditional data-center and on-prem operations\nWork with high-density compute systems (e.g., DGX B200-class) and high-speed fabrics (e.g., 400G InfiniBand/RoCE)\nMake pragmatic decisions under evolving requirements and procurement timelines, while keeping the management plane isolated and the environment secure and supportable\nScale from a single 8-GPU PoC node to a multi-node environment without redesigning the foundation\nOperate a hybrid model where on-prem small language models and external frontier LLMs are routed per use case and cost/sensitivity policy\nEstablish on-prem operational practice inside a fully cloud-native organization, including compliance expectations such as PCI-DSS and ISMS\nQualifications\nRequired Experience/Skills\nStrong networking fundamentals (TCP/IP, IP address management, OSI layers 2-7, routing, DNS, TLS, HTTP)\nHands-on experience designing, configuring, and troubleshooting data-center routing and switching, especially BGP (ASN planning, route summarization, and routing policy), as well as OSPF, VLAN/VRF\nHands-on experience designing and operating physical/data-center networking (switches, routers, firewalls, structured cabling)\nProduction experience operating Linux servers\nHands-on data-center experience, including for GPU/high-density systems: physically installing and changing cabling and configuring routers, switches, and firewalls on-site (this role requires regular in-person visits to our data center)\nExperience with data-center operations: racks, power, cooling, cross-connects, and coordinating remote-hands / installation work\nHands-on experience with data-center physical/facility operations, including power equipment and circuit switching (PDUs, breakers, circuit changes), and responding to outages and production incidents\nExperience managing data-center vendors and SI partners, including commercial discussions and contract/procurement handling\nExperience integrating on-prem and cloud networks (GCP or AWS), including VPN, proxies, and routing\nSecurity mindset in network design and operations: firewall rule design and management, egress/outbound policies, and network segmentation/isolation\nAbility to automate workflows using Python or Bash and to manage configuration using Infrastructure as Code (IaC)\nExperience writing design documents and working with internal stakeholders and external vendors/SIers\nExperience running production infrastructure in Japanese data centers, including carry-in planning, site surveys, and facility coordination conducted in Japanese\nExperience operating Linux/GPU nodes as a fleet: provisioning, firmware and driver lifecycle, monitoring, and incident response\nExperience defining SLOs and participating in on-call for a production platform\nExperience producing internal approval and procurement documentation (cost model, ROI, risks) for executive-level review\nEmpathy with Mercari's mission and values\nPreferred Experience/Skills\nExperience with GPU/HPC infrastructure and high-performance fabrics such as InfiniBand or RoCE\nExperience designing modern data-center fabrics: spine/leaf and border-leaf architectures, and EVPN-VXLAN (GPU environments preferred, CPU/general-purpose environments also welcome)\nExperience with networking for bare-metal provisioning, such as DHCP-relay and PXE boot design\nHands-on experience installing and maintaining GPU systems/servers in a data center - physical installation, cabling, and ongoing maintenance (strongly preferred)\nExperience operating NVIDIA DGX or similar GPU appliances\nExperience with out-of-band management (BMC/Redfish/IPMI) and PDU management\nExperience designing high-density data-center environments (high kW/rack, cooling strategy)\nKnowledge of ML/LLM serving infrastructure and GPU scheduling\nExperience working with SI partners and procurement processes\nExperience developing infrastructure or middleware using Go or Python\nExperience operating LLM inference in production with vLLM, NVIDIA NIM/Triton, or similar, using OSS models such as Qwen, Gemma, or Llama\nExperience with GPU scheduling and orchestration: Kubernetes with GPU Operator, Run:ai, or Slurm\nExperience with hybrid GCP integration: GKE, Workload Identity Federation, split-horizon DNS, and cloud fallback paths\nFamiliarity with NVIDIA AI Enterprise licensing and support contracts, and with Japanese vendor/SI management\nExperience extending security posture tooling (asset inventory, EDR, CSPM) from a cloud estate to on-prem nodes\nKnowledge of PCI-DSS or ISMS requirements as they apply to in-scope network and data-center environments\nExperience with high-performance storage for AI workloads (Lustre, VAST, WEKA) and object-storage/GCS dataset pipelines\nLanguage\nJapanese: Proficient (CEFR - C1) \nrequired for this role (frequent communication with domestic data-center and vendor partners)\nEnglish: Independent（CEFR-B1） \nBusiness communication level is sufficient (fluency is not required)\nFor details about CEFR, see here.\nLearn More About Mercari Group\nCareers site: https://careers.mercari.com/\nMercan: https://mercan.mercari.com/\nSocial media: X https://twitter.com/mercari_eng / LinkedIn https://www.linkedin.com/company/mercari/\nHow we reorganize the platform team\nLegacy Image Provider to Cloudflare Images: Traffic Estimation and Safe Rollout\nKubernetes Cluster migration on the Mercari Microservices Platform\nRecruiting at Mercari\nAt Mercari Group, we value empathizing with and embodying the mission and values of the Group and each company. To promote the creation of an organization that maximizes the total amount of value exhibited by all members, we would like to understand the experience and skills of each candidate as accurately as possible.\nRecruiting cycle at Mercari Group\nApplication screening\nSkill assessment: For engineering positions, you will be asked to complete a skill assessment on HackerRank or GitHub. For non-engineering positions, you may be asked to complete an assessment depending on the position. (The timing of the assessment may coincide with the interview process.)\nInterview: The number of interviews may vary depending on the position.\nReference check: We will ask for online references around the timing of the final interview.\nOffer: Offers will be determined carefully in consideration of the final interview and the reference check.\nLearn more about our recruiting process here.\nEqual Opportunity Hiring\nHere at Mercari, we work to realize a world in which no one's potential is limited by their background and everyone has the...","description_format":"text","description_chars":18760,"description_truncated":true,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"Japanese","level":"All levels","optional":false},{"language":"English","level":"All levels","optional":false}]},"benefits":[],"hiring_locations":[{"name":"Japan","iso":"JP","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Marketplaces","Secondhand"],"lifecycle":[{"event":"open","at":"2026-11-12T12:29:01Z"}],"visa":[{"country":"JP","licensed_sponsor":false,"adverts_offering_sponsorship_24m":3,"sanctioned_now":false,"evidence":"Offered visa sponsorship in 3 of its adverts here in 24 months","filings_12m":null,"filings_prev_12m":null,"green_card_filings_12m":null,"median_offered_wage_usd":null,"route":null,"cap_exempt":false,"checked_at":"2026-11-15T09:21:55+00:00","sources":["Alion: sponsorship offered in the employer's own job adverts (24 months)"],"filings_for_role_12m":0}],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":2,"expected_fill_days":91,"reasons":["conf:5","velocity","win:early","comp:brand"],"computed_at":"2026-11-15T07:52:55Z"},"pay":null,"html_url":"https://alion.io/job/mercari-software-engineer-platform-engineering-aigpu-infra-on-prem-mercari","json_url":"https://alion.io/job/mercari-software-engineer-platform-engineering-aigpu-infra-on-prem-mercari.json","meta":{"generated_at":"2026-11-15T12:07:24Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1868,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-16T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":914},"rest":"https://alion.io/mcp/rest/get_company?id=914"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmercari-software-engineer-platform-engineering-aigpu-infra-on-prem-mercari"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmercari-software-engineer-platform-engineering-aigpu-infra-on-prem-mercari"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmercari-software-engineer-platform-engineering-aigpu-infra-on-prem-mercari"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/mercari-software-engineer-platform-engineering-aigpu-infra-on-prem-mercari\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmercari-software-engineer-platform-engineering-aigpu-infra-on-prem-mercari"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4161684}},{"tool":"search_jobs","arguments":{"company":"mercari.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4161684},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}