{"id":1673835,"url":"https://alion.io/job/hewlett-packard-agentic-ai-systems-evaluation-engineer","title":"[Agentic AI] Systems Evaluation Engineer","company":{"id":2088298,"name":"HP","domain":"hewlett-packard.de","url":"https://alion.io/company/hewlett-packard-de","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Houston, United States","Austin, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":130700,"max":205200,"currency":"USD","period":"year","gross":null,"usd_annual":205200},"salary_estimate":null,"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Agile","optional":true},{"name":"Azure","optional":true},{"name":"C++","optional":true},{"name":"Docker","optional":true},{"name":"JavaScript","optional":true},{"name":"Kubernetes","optional":true},{"name":"Python","optional":true},{"name":"React.js","optional":true},{"name":"SQL","optional":true},{"name":"Windows","optional":true}],"status":"live","first_seen_at":"2026-09-30T00:00:00Z","employer_posted_date":"2026-09-30","last_verified_at":"2026-10-10T23:16:49Z","board_verified":true,"closed_at":null,"days_open":11,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":11},"description":"[Agentic AI] Systems Evaluation EngineerDescription -\nThis role is responsible for defining measurement methodology and benchmarks to quantify customer outcomes, platform performance, and AI workload effectiveness ensuring the technical design, development, installation, and maintenance of state-of-the-art software applications and services for our products. The role plays a crucial role in building technical solutions to help other developers/engineers deliver faster with modern software and application development tools. The role builds & maintains relationships with stakeholders across different departments and provide guidance & coaching to reportees in executing their tasks/responsibilities.\n*Houston in-office requirement: 4-days\nResponsibilities\nDefine success metrics. • Create benchmarking frameworks. • Analyze customer outcomes. • Produce executive performance reports.\nContributes to technology strategy and engineering roadmaps around software engineering; executes strategic software engineering proof of concepts. • Interacts with user management regarding project status and user requirements to promote an environment with improved productivity and satisfaction. • Supervises the work of external engineering vendors, analyzing the testing performed by vendors, and provides feedback and expertise to technicians. • Identifies, recommends and implements changes to enhance effectiveness of engineering, implementation and service strategies Education & Experience Recommended • Four-year or Graduate Degree in Computer Science, Statistics, Software Engineering, or any other related discipline or commensurate work experience or demonstrated competence. • Typically has 7-10 years of work experience, preferably in software designing & development, software architecture, programming languages, or a related field.\nStrong analytical skills\nExperience with benchmarking methodologies\nPreferred Qualifications\nAI systems evaluation.\nTelemetry analytics\nPerformance benchmarking.\nLinux and Windows validation experience\nPreferred Certifications\nProgramming Language/s Certification (Java, C++, Python, JavaScript, or similar) Knowledge & Skills\nAgile Methodology\nAmazon Web Services \nApplication Programming Interface (API)\nAutomation\nC++\nComputer Science\nDevOps\nDocker (Software)\nFull Stack Development\nJava (Programming Language)\nJavaScript (Programming Language)\nKubernetes\nMicroservices \nMicrosoft Azure\nPython (Programming Language)\nReact.js\nScalability\nSoftware Development\nSoftware Engineering\nSQL (Programming Language) The pay range for this role is $130,700 to $205,200 USD annually with additional opportunities for pay in the form of bonus and/or equity (applies to United States of America candidates only). Pay varies by work location, job-related knowledge, skills, and experience. Benefits: HP offers a comprehensive benefits package for this position, including:\nHealth insurance\nDental insurance\nVision insurance\nLong term/short term disability insurance\nEmployee assistance program\nFlexible spending account\nLife insurance\nGenerous time off policies, including;\n4-12 weeks fully paid parental leave based on tenure\n11 paid holidays\nAdditional flexible paid vacation and sick leave (US benefits overview)\nThe compensation and benefits information is accurate as of the date of this posting. The Company reserves the right to modify this information at any time, with or without notice, subject to applicable law.\nJob -\nSoftwareSchedule -\nFull timeShift -\nNo shift premium (United States of America)Travel -\n25%Relocation -\nEqual Opportunity Employer (EEO)-\nHP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).\nPlease be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.\nFor more information, review HP’sEEO Policy or read about your rights as an applicant under the law here: “ Know Your Rights: Workplace Discrimination is Illegal \"","description_format":"text","description_chars":4516,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Dental insurance","Equity","Health insurance","Life insurance","Parental leave","Vision insurance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":true,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-02T07:36:16Z"}],"visa":[],"liveness":{"score":76,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.849,"p_room":0.9,"age_days":10,"expected_fill_days":22,"reasons":["conf:1","velocity","win:mid","comp:brand"],"computed_at":"2026-10-10T05:45:15Z"},"pay":{"stated_usd_annual":205200,"is_top_pay":false},"html_url":"https://alion.io/job/hewlett-packard-agentic-ai-systems-evaluation-engineer","json_url":"https://alion.io/job/hewlett-packard-agentic-ai-systems-evaluation-engineer.json","meta":{"generated_at":"2026-10-11T03:11:58Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":586,"day_limit":5000,"remaining_today":4414,"minute_limit":60,"resets_at":"2026-10-12T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2088298},"rest":"https://alion.io/mcp/rest/get_company?id=2088298"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fhewlett-packard-agentic-ai-systems-evaluation-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fhewlett-packard-agentic-ai-systems-evaluation-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fhewlett-packard-agentic-ai-systems-evaluation-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/hewlett-packard-agentic-ai-systems-evaluation-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fhewlett-packard-agentic-ai-systems-evaluation-engineer"}]}