{"id":1101389,"url":"https://alion.io/job/g2-intern-ai-agent-evaluations","title":"Intern, AI Agent Evaluations","company":{"id":6012,"name":"G2","domain":"g2.com","url":"https://alion.io/company/g2","size_band":null,"is_staffing_agency":false,"is_intermediary":false,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":95,"open_postings":5,"ghost_share":0,"stale_share":0.2,"repost_share":0,"time_to_fill_p50_days":44,"computed_at":"2026-09-23T05:45:00Z"}},"role":"Early Careers","role_family":"Early Careers","seniority":"intern","employment_type":"internship","work_mode":"on_site","remote_scope":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":24,"max":24,"currency":"USD","period":"hour","gross":null,"usd_annual":48000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"LLM","optional":false}],"status":"live","first_seen_at":"2026-09-21T22:14:43Z","employer_posted_date":"2026-09-21","last_verified_at":"2026-09-23T11:13:48Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"About G2 - The Company\nG2 is the world's largest and most trusted software marketplace. When you join G2, you’re joining the industry’s leading team that helps businesses reach their peak potential by powering decisions and strategies with trusted insights from real software users.\nNow, we have joined forces with Capterra, SoftwareAdvice, and GetApp to create the largest source of online data and software insights to fuel intelligent buying in the age of AI. With 200M+ combined annual visitors and 6M verified reviews, we are now the centralized place to enable software buyers to make better and faster decisions with confidence.\nAnd we are just getting started! We are setting out to transform the global B2B software industry and become the most trusted data foundation for buyers and sellers of software for the age of AI.\nDoes that sound exciting to you? Come join us as we try to reach our next PEAK!\nAbout G2 - Our People\nAt G2, everything we are and what we do is grounded in our PEAK values- (Performance + Entrepreneurship + Authenticity + Kindness. Working at G2 means you are part of a value-driven, growing global community that climbs PEAKs together. We cheer for each other’s successes, learn from our mistakes, and support and lean on one another during challenging times. With ambition and entrepreneurial spirit we push each other to take on challenging work, which will help us all to grow and learn.\nYou will be part of a global, diverse team of smart, dedicated, and kind individuals - each with unique talents, aspirations, and life experiences. At the heart of our community and culture are our people-led ERGs, which celebrate and highlight the diverse identities of our global team. As an organization, we are intentional about our DEI and philanthropic work (like our G2 Gives program) because it encourages us all to be better people.\nSummary of Responsibilities:\nG2 evaluates AI agents on real tasks and publishes the results as leaderboards on g2.ai. This intern role helps the Agentic Marketplace team grow that program: supporting the evaluation method, working with AI agent vendors, tracking other evaluators, and monitoring market trends. Reports to the Head of Product, Agentic Marketplace. Works with product, data science, and engineering.\nDetailed Responsibilities:\n Responsibility Area: Evaluation method (about 50% of time)\nBreak an AI agent's job (for example, outbound sales) into steps that can be tested. Write the tasks, test data, and scoring rules for those steps.\n\nReview the scores our AI judge and human reviewers give.\n\n Responsibility Area: Vendor relationships (about 25% of time)\nSupport scaling system to engage with hundreds of vendors.\n\nPrepare the results packet we share with each vendor before we publish, and keep the vendor pipeline current every week.\n\n Responsibility Area: Market landscape (about 25% of time)\nTrack who else evaluates AI agents (AI labs, benchmark groups, evaluation startups, analyst firms) and what they publish.\n\nQualifications:\nCurrently enrolled in a MBA.\n\nHave built with or used AI tools such as LLM APIs, chat assistants, or agents, and can explain how they work and where they fail.\n\nWrite clearly and briefly.\n\nComfortable talking with startup founders and product leaders. Able to hold your view when someone pushes back, and to change it when the facts say so.\n\nAble to make progress on problems that have no set process yet.\n\nBased in the San Francisco Bay Area.\n\nAvailable 10 to 15 hours a week during the school year.\n\nThe internship starts October or November 2026.\n\nWhat Can Help Your Application Stand Out:\nYou have built an AI agent, an evaluation, or a benchmark, even as a class or side project.\n\nYou have worked at or with a B2B software company in any role: startup, venture, sales, or product.\n\nYou have worked in customer support, sales, or marketing (the jobs the agents we evaluate are built to do).\n\nYou have written about AI or software for a public audience (blog, newsletter, research).\n\nYou already know the AI startup scene in San Francisco.\n\nOur Commitment to Inclusivity and Diversity\nAt G2, we are committed to creating an inclusive and diverse environment where people of every background can thrive and feel welcome. We consider applicants without regard to race, color, creed, religion, national origin, genetic information, gender identity or expression, sexual orientation, pregnancy, age, or marital, veteran, or physical or mental disability status. Learn more about our commitments here.\n--\nFor job applicants in California, the United Kingdom, and the European Union, please review this applicant privacy notice before applying to this job.\nHow We Use AI Technology in Our Hiring Process\nG2 incorporates AI-powered technology to enhance our candidate evaluation process. These tools may assist with initial application screening, skills assessment analysis, and identifying candidates whose qualifications align with specific role requirements. While AI technology supports our recruitment workflow, all final hiring decisions remain under human oversight and judgment.\nYour Choice Matters: If you would prefer that your application be reviewed without AI assistance, you can opt out by entering your email address in the email entry field at the bottom of the Automated Processing Legal Notice. Choosing to opt out will not disadvantage your application in any way-we will ensure your materials receive a thorough manual review by our hiring team.\nFor additional details about how we handle your information throughout the application process, please review G2's Applicant Privacy Notice.","description_format":"text","description_chars":5621,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Marketplaces"],"lifecycle":[{"event":"open","at":"2026-09-21T23:06:36Z"}],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":1,"expected_fill_days":44,"reasons":["conf:0","velocity","win:early","comp:junior"],"computed_at":"2026-09-23T05:45:00Z"},"pay":{"stated_usd_annual":48000,"is_top_pay":false},"html_url":"https://alion.io/job/g2-intern-ai-agent-evaluations","json_url":"https://alion.io/job/g2-intern-ai-agent-evaluations.json","meta":{"generated_at":"2026-09-23T11:35:05Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers"}}