{"id":3174679,"url":"https://alion.io/job/weekday-engineering-expert","title":"Engineering Expert","company":{"id":7097,"name":"Weekday","domain":"weekday.works","url":"https://alion.io/company/weekday","size_band":"51-200","is_staffing_agency":true,"employer_type":"agency","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":{"grade":"B","score":81,"open_postings":90,"ghost_share":0,"stale_share":0.978,"repost_share":0,"time_to_fill_p50_days":6,"computed_at":"2026-10-26T05:57:25Z"}},"role":"Science & Research","role_family":"Science & Research","seniority":"senior","employment_type":"contractor","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":{"label":"PST","utc_offset_min":-8,"utc_offset_max":-8},"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["US","IN","CO","EG","ID","NG"],"hiring_countries_total":6,"salary":null,"salary_estimate":{"min_usd":18500,"max_usd":42000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":1296},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Ngspice","optional":false},{"name":"OpenFOAM","optional":false},{"name":"Python","optional":false}],"status":"live","first_seen_at":"2026-10-19T00:00:00Z","employer_posted_date":"2026-10-19","last_verified_at":"2026-10-26T09:36:16Z","board_verified":true,"closed_at":null,"days_open":7,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":7},"description":"This role is for one of our clients\nWe are seeking experienced Engineering Experts to design, develop, and validate complex engineering simulation problems for training and evaluating advanced AI models and coding agents. This role combines deep engineering expertise, scientific computing, simulation-based design, and AI evaluation to create challenging tasks that test an AI system's ability to interpret technical requirements, solve engineering problems, use simulation tools, and produce physically valid solutions.\nExperts will work across Electrical, Mechanical, and Aerospace Engineering, developing realistic, multi-constraint problems with measurable objectives and objectively verifiable outcomes. The role also involves analyzing AI execution logs, identifying reasoning and tool-use failures, and refining evaluation benchmarks to improve model performance.\nJob Details\nRole: Engineering Expert\nExperience: 10+ years of hands-on engineering design experience\nEducation: Master's degree or PhD in Electrical, Mechanical, Aerospace Engineering, or a closely related discipline\nLocations: Bangladesh, India, Indonesia, Egypt, Ghana, Nigeria, Turkey, Brazil, Colombia, and approved US states\nEmployment Type: Short-term contractor engagement\nContract Duration: Up to 24 weeks\nStart Date: Immediate\nCompensation: USD 500 per task, based on an estimated 30-40 hours of work per task\n Availability: Approximately 40 hours per week, with at least 4 hours of overlap with US Pacific Time (PST)\nWork Arrangement: Remote, with access to a personal computer and reliable high-speed internet\nRequirements\nKey Responsibilities\n1. Engineering Problem Design\nDevelop original, self-contained engineering design problems with realistic technical requirements, competing constraints, and clearly defined optimization objectives.\nCreate challenging tasks that require AI models to interpret specifications, evaluate design trade-offs, configure simulation environments, and iteratively improve engineering solutions.\nEstablish validated reference solutions and objective automated grading mechanisms to assess correctness, performance, and compliance with engineering requirements.\n2. Simulation and Computational Engineering\nBuild, configure, execute, and validate simulation-based problem environments using relevant open-source engineering tools.\nDevelop Python scripts, custom test benches, and supporting utilities to automate simulations and verify expected results.\nEnsure that simulation outputs satisfy physical plausibility, dimensional consistency, boundary conditions, convergence requirements, and other domain-specific constraints.\nTroubleshoot simulation failures, numerical instability, dependency issues, and computational errors.\n3. AI Evaluation and Failure Analysis\nEvaluate the performance of large language models (LLMs) and coding agents across repeated engineering problem-solving trials.\nAnalyze execution trajectories, tool interactions, simulator feedback, and intermediate outputs to identify systematic reasoning failures.\nInvestigate issues such as incorrect interpretation of engineering specifications, premature convergence, invalid geometries, inconsistent units, and physically impossible solutions.\nApply evaluation concepts such as pass@k, failure-mode classification, and analysis of nondeterministic model behavior.\n4. Benchmark Development and Refinement\nCalibrate task difficulty using empirical model performance and evaluation results.\nRefine engineering problems to improve their ability to distinguish between successful and unsuccessful AI solutions.\nEnsure that tasks remain unambiguous, technically rigorous, reproducible, and objectively gradable.\nCollaborate with AI researchers, technical leads, and subject-matter experts to integrate validated benchmarks into AI evaluation workflows.\nRequired Qualifications and Skills\nMaster's degree or PhD in Electrical Engineering, Mechanical Engineering, Aerospace Engineering, or a closely related technical discipline.\nAt least 10 years of practical engineering design experience.\nStrong Python programming and scripting skills.\nHands-on proficiency with at least one relevant open-source engineering simulation or design tool, such as:\nElectrical simulation: ngspice, PySpice\nMechanical and computational engineering: OpenFOAM, FEniCSx, CalculiX\nControl systems: python-control, OpenModelica\nCAD and design automation: CadQuery, build123d\n Thermodynamics and meshing: Cantera, Gmsh\nExperience developing, executing, debugging, and validating simulation-based engineering workflows.\nFamiliarity with modern LLMs, AI coding agents, and AI evaluation methodologies.\nAbility to analyze model execution logs and identify underlying reasoning, planning, and tool-use failures.\nStrong understanding of physical constraints, units, boundary conditions, numerical convergence, and engineering validation.\nExcellent analytical, problem-solving, and technical documentation skills.\nAbility to work independently and deliver technically accurate results within defined timelines.\nPreferred Qualifications\nExperience in AI model evaluation, benchmark development, automated grading, or coding-agent assessment.\nFamiliarity with repeated-trial evaluation, pass@k metrics, failure taxonomies, and nondeterministic model behavior.\nExperience building automated testing frameworks and reproducible computational environments.\nKnowledge of optimization methods, numerical analysis, simulation automation, and engineering design validation.\nExperience collaborating with multidisciplinary engineering and AI research teams.\nEngineering Domains\nCandidates should have strong expertise in one or more of the following areas:\nElectrical Engineering\nMechanical Engineering\nAerospace Engineering\nWork Commitment and Contract Terms\nExpected commitment of approximately 40 hours per week.\nAt least 4 hours of daily overlap with US Pacific Time.\nWeekend on-call availability is required; part-time engagement may be acceptable where agreed.\nThe engagement is contractor-based and may last up to 24 weeks.\nCandidates must have a personal desktop or laptop and a stable, high-speed internet connection.\nCompensation is USD 500 per task, with an estimated 30-40 hours of effort per task. Actual task allocation and payment terms should be confirmed before engagement.","description_format":"text","description_chars":6327,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"},{"name":"India","iso":"IN","kind":"country"},{"name":"Colombia","iso":"CO","kind":"country"},{"name":"Egypt","iso":"EG","kind":"country"},{"name":"Indonesia","iso":"ID","kind":"country"},{"name":"Nigeria","iso":"NG","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Space & Aerospace"],"lifecycle":[{"event":"open","at":"2026-10-23T19:34:51Z"}],"visa":[],"liveness":{"score":20,"band":"cold","label":"Long shot","p_open":1,"p_active":0.361,"p_room":0.55,"age_days":7,"expected_fill_days":6,"reasons":["conf:0","agency","stale_co","velocity","win:tail","comp:brand"],"computed_at":"2026-10-26T05:57:25Z"},"pay":null,"html_url":"https://alion.io/job/weekday-engineering-expert","json_url":"https://alion.io/job/weekday-engineering-expert.json","meta":{"generated_at":"2026-10-26T13:19:13Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":18511,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-27T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":7097},"rest":"https://alion.io/mcp/rest/get_company?id=7097"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fweekday-engineering-expert"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fweekday-engineering-expert"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fweekday-engineering-expert"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/weekday-engineering-expert\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fweekday-engineering-expert"}]}