{"id":4644623,"url":"https://alion.io/job/openai-certification-assessment-specialist","title":"Certification Assessment Specialist","company":{"id":2,"name":"OpenAI","domain":"openai.com","url":"https://alion.io/company/openai","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"B","score":81,"open_postings":223,"ghost_share":0,"stale_share":0.767,"repost_share":0.004,"time_to_fill_p50_days":52,"computed_at":"2026-11-20T05:46:30Z"}},"role":"HR","role_family":"HR","seniority":null,"employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":207000,"max":230000,"currency":"USD","period":"year","gross":null,"usd_annual":230000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"OpenAI","optional":false}],"status":"live","first_seen_at":"2026-11-19T21:27:54Z","employer_posted_date":"2026-11-19","last_verified_at":"2026-11-21T12:44:48Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"About the Team\nCustomer Education helps customers build the practical skills and confidence to use AI and OpenAI products safely and effectively. We bring together customer insight, learning and enablement expertise, product signals, and measurement to help organizations move from access to durable adoption.\nWithin Customer Education, the Certification team helps individuals demonstrate competence for in-demand AI skills and helps customers and partners validate that their workforce has the skills they need to meet their AI-enabled business goals. Our work centers on the belief that learners should understand where to go to build skills and capabilities, how to demonstrate them, and what to pursue next. Similarly, Enterprise leaders should understand what each credential signifies and how it supports workforce readiness. We do this with transparency for the overall OpenAI credential framework and providing trusted, role-based certifications that verify practical capability.\nAbout the Role\nAs a Certification Assessment Specialist, you will design, build, test, launch, and maintain the hands-on assessments behind an OpenAI technical role-based certification. Your work will help candidates demonstrate what they can do in realistic scenarios and give reviewers reliable evidence to score their work.\nThis is a hands-on individual contributor role reporting to the Technical Certification Lead. You will turn competency models, assessment blueprints and scoring rubrics into working tasks, assessment environments and workflows that capture candidate evidence and produce results reviewers can verify. You will use scripting and automation and partner with engineering on software development and delivery integrations.\nYou will work with the certification, measurement, engineering and operations teams, as well as technical subject matter experts and external delivery providers. The Technical Certification Lead will coordinate alignment with learning content while keeping confidential assessment details separate from learning materials.\nYou will take assessments from prototype through pilot, launch, and ongoing maintenance across live and virtual delivery. As products and tools change, you will update tasks, environments, and scoring together so candidates are assessed against the intended skills.\nSuccess means candidates have the opportunity to demonstrate the competencies required for the certification, and reviewers can consistently score that work using evidence they can trace back to the submission.\nIn this role, you will:\nTranslate assessment blueprints into realistic scenarios, candidate instructions, and hands-on tasks. Work with subject matter experts to check that the tasks reflect the job and elicit the appropriate evidence for each rubric.\n\nDefine assessment environment requirements and build or configure the environments candidates will use. Establish repeatable provisioning and reset workflows for accounts, tools, data, and permissions so candidates start from consistent conditions.\n\nBuild and maintain pipelines that capture candidate submissions and other scoring evidence, apply scoring rules, and route results for review. Make scores traceable to the underlying evidence and protect sensitive data under approved controls.\n\nBuild and test model-assisted scoring with qualified human reviewers using established validation criteria. Compare model scores with calibrated expert judgments, investigate disagreements, implement agreed rules for routing cases to human review, and rerun validation tests after material changes to the model, task, or rubric.\n\nTest assessments end to end, from environment setup to evidence capture and scoring. Use dry runs and pilots to check instructions, timing, accessibility, and failure recovery; fix defects and verify the fixes before release. Test scoring against multiple valid approaches, partial and incorrect submissions, and failures in the assessment environment, so a platform issue isn’t mistaken for a candidate error.\n\nTranslate assessment needs into requirements for delivery integrations. Partner with engineering and delivery providers to test candidate access, submission and results handoffs and troubleshoot issues.\n\nPrepare assessments for launch with platform and operations partners. Document setup, version dependencies, and troubleshooting so delivery teams can run assessments consistently and respond when something breaks.\n\nMaintain versioned tasks, environments, scoring configurations, and test fixtures. Use candidate feedback and delivery and scoring data to identify issues, update or retire tasks, and check that changes preserve the intended skills and difficulty.\n\nInvestigate technical issues raised during delivery or candidate review. Reproduce defects where possible, document what was affected, and test fixes with the relevant delivery partners.\n\nYou might thrive in this role if you:\nHave personally designed and built performance-based, hands-on assessments, labs or simulations for technical roles, such as software developers or solution architects, and taken them through testing, launch and maintenance. Experience creating question-and-answer tests alone does not meet this requirement.\n\nHave used scripting and automation to build and troubleshoot technical assessment environments. You can work with technical subject matter experts to translate realistic solutions into assessments; deep AI-engineering expertise or prior experience with a particular language or delivery platform is not required.\n\nHave experience working at a technology company in a fast-paced environment, setting priorities and delivering work amid changing requirements and evolving business needs.\n\nCan use a blueprint and rubric to design realistic tasks and specify what evidence distinguishes competent performance from task completion.\n\nHave built or maintained workflows that capture submissions, process evidence, and produce traceable scores or reviewer outputs.\n\nHave implemented or validated model-assisted scoring or evaluation against expert human judgments, and can explain when a score should go to human review.\n\nHave worked directly with external technical experts or delivery providers and can translate requirements into integrations you can test end to end.\n\nHave used pilot results, candidate feedback, and scoring or delivery data to improve assessment quality.\n\nUnderstand how to build for accessibility and protect candidate evidence and confidential assessment content.\n\nCommunicate technical tradeoffs clearly to subject matter experts, measurement specialists, platform engineers, and operations teams.\n\nIt’s a plus if you have experience:\nBuilding hands-on assessments for AI application development, agentic workflows, or customer deployments.\n\nWorking with psychometricians or measurement specialists on rubric calibration, scoring consistency, or validation of performance assessments.\n\nLaunching performance-based certification assessments across both live and remote delivery.\n\nAbout OpenAI\nOpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.\nWe are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.\nFor additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.\nBackground checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.\nTo notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.\nWe are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.\nOpenAI Global Applicant Privacy Policy\nAt OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.","description_format":"text","description_chars":9558,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Conversational AI","Code Intelligence","Foundation Models","AI Research Labs"],"lifecycle":[{"event":"open","at":"2026-11-19T23:55:00Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 309 · green card filings: 2","filings_12m":309,"filings_prev_12m":117,"green_card_filings_12m":2,"median_offered_wage_usd":252468,"route":null,"cap_exempt":false,"checked_at":"2026-11-20T07:30:35+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":0}],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":0,"expected_fill_days":52,"reasons":["conf:2","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-11-20T05:46:30Z"},"pay":{"stated_usd_annual":230000,"is_top_pay":true},"html_url":"https://alion.io/job/openai-certification-assessment-specialist","json_url":"https://alion.io/job/openai-certification-assessment-specialist.json","meta":{"generated_at":"2026-11-21T13:44:17Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":22835,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2},"rest":"https://alion.io/mcp/rest/get_company?id=2"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fopenai-certification-assessment-specialist"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fopenai-certification-assessment-specialist"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fopenai-certification-assessment-specialist"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/openai-certification-assessment-specialist\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fopenai-certification-assessment-specialist"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4644623}},{"tool":"search_jobs","arguments":{"company":"openai.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4644623},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}