{"id":2599160,"url":"https://alion.io/job/credo-senior-ai-system-architect","title":"Senior AI System Architect","company":{"id":1958633,"name":"Credo","domain":"credosemi.com","url":"https://alion.io/company/credosemi","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"HiBob","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"staff","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Jose, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":160000,"max":220000,"currency":"USD","period":"year","gross":null,"usd_annual":220000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"LLM","optional":false}],"status":"live","first_seen_at":"2026-10-13T17:40:33Z","employer_posted_date":"2026-10-15","last_verified_at":"2026-10-15T19:30:34Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":"Team Credo is looking for a Senior AI System Architect to join our team in San Jose, CA, reporting to AVP, XPU system AI interface. This role needs to solve the system-level interconnection challenges that connect XPUs (NPU/GPU/custom silicon) into working AI infrastructure. This role needs to follow and define how compute elements are wired, networked, and orchestrated together at node, rack, and cluster scale so that large-scale LLM training and inference run efficiently across the platform. We strongly prefer candidates with a hands-on NPU hardware architect background and real experience taking NPU silicon into production deployment at scale. \nBase salary range is $160,000 - $220,000 a year. The base salary offer will depend on factors such as education, experience, training, skills, qualifications, and location. This position is also eligible for a discretionary bonus, equity and a full range of medical and other benefits.\n\nWhy Credo\nPurpose: We invest in what matters. From meaningful-future shaping projects to competitive compensation, we empower you to grow your career while making a lasting impact.\nPeople: Connection starts within. We collaborate, celebrate wins, and create an environment where everyone can do their best work.\n Possibilities: Our belief shapes what’s next. Our technology powers the most reliable and energy-efficient connections around the world - and our team powers new products and markets that come next.\nResponsibilities\nModel the memory and interconnection architecture linking XPUs to memory and across node, rack, and cluster boundaries - not the internal design of the NPUs/GPUs/CPUs themselves.\nSolve communication and topology bottlenecks that arise from all kinds of parallelism strategies during distributed LLM training and inference.\nDefine how XPUs utilize the memory and interconnect fabric, ensuring workloads map cleanly onto the network topology.\nWork with silicon, memory, networking, and software teams to specify interconnect fabric requirements and resolve integration issues between compute nodes.\nBring hands-on NPU hardware architecture judgment to interconnect and system design decisions, informed by direct experience taking NPU silicon from definition through bring-up, validation, and production deployment.\nTrack leading open LLM architectures to anticipate how model structure will stress interconnect and system topology.\nQualifications\nBasic QualificationsBachelor's degree in Computer Engineering, EE, CS, or related field required.\nThree years in XPU or AI interconnect system architecture and micro architecture working experience.\nStrong foundational understanding of computer architecture, including GPU, NPU, and/or CPU design principles.\nFamiliarity with large language model architectures and distributed training/inference concepts (e.g., parallelism strategies, model serving) through coursework, research, or personal projects.\nDemonstrated analytical ability - for example, through published research, thesis work, or quantitative project work - with a track record of independently studying and synthesizing technical material.\nStrong cross-functional leadership and communication skills, daily experience working with compiler, software, SOC & backend team preferred.\nPreferred QualificationsMaster's or PhD in Computer Science, Artificial Intelligence, Engineering, or a related field.\nDeep, hands-on NPU hardware architecture expertise.\nReal, hands-on NPU architecture background, with direct experience participating in an NPU design from architecture definition through silicon bring-up, validation, and volume production deployment.\nWorking knowledge of high-speed interconnect or networking concepts (e.g., PCIe, Ethernet, RDMA) is a plus.\nAbout Credo\nCredo’s mission is to transform connectivity at scale through fast, reliable, and energy-efficient system solutions. Our high-speed copper and optical interconnect products deliver industry-leading power and performance at up to 1.6T to meet the ever-expanding data infrastructure demands of AI. \nOur product portfolio includes ZeroFlap (ZF) Active Electrical Cables (AECs) and ZF optical transceivers, OmniConnect memory solutions, and a suite of retimers and DSPs for optical and copper Ethernet and PCIe, all leveraging the PILOT diagnostic and analytics software platform. Credo innovations enable our customers to connect the systems that connect the world.\n\nCredo is committed to creating an inclusive environment for all employees and welcome applicants from diverse backgrounds without regard to race, color, religion, gender, sex, gender identity, sexual orientation, pregnancy, marital status, national origin, ethnicity, genetic information, age, disability, veteran status, or any other legally protected basis. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email .","description_format":"text","description_chars":4935,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Cybersecurity","Hardware"],"lifecycle":[{"event":"open","at":"2026-10-15T07:54:35Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":2,"expected_fill_days":48,"reasons":["conf:0","win:early"],"computed_at":"2026-10-15T19:44:42Z"},"pay":{"stated_usd_annual":220000,"is_top_pay":false},"html_url":"https://alion.io/job/credo-senior-ai-system-architect","json_url":"https://alion.io/job/credo-senior-ai-system-architect.json","meta":{"generated_at":"2026-10-15T19:44:42Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":29957,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-16T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1958633},"rest":"https://alion.io/mcp/rest/get_company?id=1958633"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcredo-senior-ai-system-architect"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcredo-senior-ai-system-architect"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcredo-senior-ai-system-architect"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/credo-senior-ai-system-architect\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcredo-senior-ai-system-architect"}]}