{"id":1235979,"url":"https://alion.io/job/bytedance-backend-inference-framework-engineer-graduate-aml-inference-2027-start-2","title":"Backend Inference Framework Engineer Graduate (AML Inference) - 2027 Start","company":{"id":13,"name":"ByteDance","domain":"bytedance.com","url":"https://alion.io/company/bytedance","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Feishu","truth_index":{"grade":"A","score":88,"open_postings":9846,"ghost_share":0.118,"stale_share":0,"repost_share":0.003,"time_to_fill_p50_days":295,"computed_at":"2026-11-02T06:13:15Z"}},"role":"Backend","role_family":"Backend","seniority":"junior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Jose, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":153000,"max_usd":315000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":1118},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"Canary Release","optional":false},{"name":"Linux","optional":false},{"name":"Machine Learning","optional":false},{"name":"gRPC","optional":true},{"name":"Redis","optional":true},{"name":"RocksDB","optional":true}],"status":"live","first_seen_at":"2026-08-03T05:19:58Z","employer_posted_date":"2026-09-25","last_verified_at":"2026-11-02T07:19:20Z","board_verified":true,"closed_at":null,"days_open":91,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":91},"description":"岗位职责 / Responsibilities\nData AML is ByteDance's Machine Learning mid-platform, providing training and inference systems for recommendation/advertising for businesses such as Douyin, Jinri Toutiao, and Xigua Video. It provides powerful Machine Learning computing power for internal business units within the company and conducts research on some general and innovative algorithms for issues in these businesses.\nWe are looking for talented individuals to join our team. As a graduate, you will get opportunities to pursue bold ideas, tackle complex challenges, and unlock limitless growth.\nSuccessful candidates must be able to commit to an onboarding date by the end of the year. Please state your availability and graduation date clearly in your resume.\nCandidates can apply to a maximum of two positions and will be considered for jobs in the order you apply. The application limit is applicable to our Company and its affiliates' jobs globally. Applications will be reviewed on a rolling basis - we encourage you to apply early.\nResponsibilities:\n- Responsible for the overall architecture design and implementation of model inference services, building a high-performance, highly available, and scalable enterprise-level inference system for large-parameter, high-complexity AI models, overcoming various architectural challenges in the implementation of complex model inference, and supporting the efficient launch of models across all business scenarios.\n- Responsible for the R&D and optimization of the core modules of the inference framework, covering core capabilities such as inference engine scheduling, monitoring and alerting, canary release, etc., continuously iterating on the framework performance, and resolving performance bottlenecks, resource bottlenecks, and stability issues in high-concurrency and large-model inference scenarios.\n- Keep track of the latest inference technologies in the industry, conduct technology selection and innovation in combination with business scenarios, accumulate distributed high-concurrency service architecture solutions, and promote the upgrade and standardization of the team's technical system.\n任职要求 / Requirements\nMinimum Qualifications:\n- Individuals who are completing or have recently completed a Bachelor's/ Master's degree in Software Development, Computer Science, Computer Engineering, or a related technical discipline, or a related discipline.\n- Familiar with basic Linux commands, with solid C/C++ programming skills and knowledge of data structures and algorithms;\n- Familiar with the basic principles of multi-threaded concurrency, proficient in basic usages such as thread usage, synchronization locks, and thread pools, able to identify common concurrency issues, and possess the ability to perform basic performance tuning in multi-threaded scenarios;\n- Have experience in R&D projects of high-concurrency distributed services, and be familiar with service latency and resource optimization;\n- Possess good learning and execution abilities, be willing to proactively understand the model inference service architecture, and have problem analysis and abstraction capabilities;\n- Possess good cross-team collaboration skills, communication and presentation skills, and document writing skills, have strong sense of responsibility and stress tolerance, and be able to drive the resolution of complex technical issues and the implementation of projects;\nPreferred Qualifications:\n- Have practical project experience and understanding of source code in high-concurrency services/frameworks such as Redis, RocksDB, BRPC, GRPC, etc.;\n- Understand the operating mechanism of GPUs, and have relevant project experience and optimization capabilities in GPU service resource management and control;","description_format":"text","description_chars":3762,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Advertising","Recommendation Systems","Digital Media","Video & Photo Sharing"],"lifecycle":[{"event":"open","at":"2026-09-25T16:14:41Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 747 · green card filings: 451","filings_12m":747,"filings_prev_12m":1302,"green_card_filings_12m":451,"median_offered_wage_usd":210559,"route":null,"cap_exempt":false,"checked_at":"2026-10-29T16:27:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":356}],"liveness":{"score":71,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.887,"p_room":0.8,"age_days":91,"expected_fill_days":295,"reasons":["conf:3","velocity","win:early","crowd:junior,brand"],"computed_at":"2026-11-02T06:13:15Z"},"pay":null,"html_url":"https://alion.io/job/bytedance-backend-inference-framework-engineer-graduate-aml-inference-2027-start-2","json_url":"https://alion.io/job/bytedance-backend-inference-framework-engineer-graduate-aml-inference-2027-start-2.json","meta":{"generated_at":"2026-11-02T11:52:46Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":16342,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-03T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":13},"rest":"https://alion.io/mcp/rest/get_company?id=13"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbytedance-backend-inference-framework-engineer-graduate-aml-inference-2027-start-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbytedance-backend-inference-framework-engineer-graduate-aml-inference-2027-start-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbytedance-backend-inference-framework-engineer-graduate-aml-inference-2027-start-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/bytedance-backend-inference-framework-engineer-graduate-aml-inference-2027-start-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbytedance-backend-inference-framework-engineer-graduate-aml-inference-2027-start-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":1235979}},{"tool":"search_jobs","arguments":{"company":"bytedance.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":1235979},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}