{"id":331756,"url":"https://alion.io/job/parallel-wireless-senior-applied-ai-evaluation-engineer-ran-ticket-intelligence","title":"Senior Applied AI Evaluation Engineer - RAN Ticket Intelligence","company":{"id":4814,"name":"Parallel Wireless","domain":"parallelwireless.com","url":"https://alion.io/company/parallel-wireless","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Lever","truth_index":{"grade":"B","score":81,"open_postings":17,"ghost_share":0,"stale_share":0.706,"repost_share":0.118,"time_to_fill_p50_days":41,"computed_at":"2026-10-21T05:46:15Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Kfar Saba, Israel"],"countries":["IL"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":93000,"max_usd":240000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2216},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CI/CD","optional":false},{"name":"Embeddings","optional":false},{"name":"Function Calling","optional":false},{"name":"Hybrid Search","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Machine Learning","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Reranking","optional":false},{"name":"SQL","optional":false},{"name":"Structured Outputs","optional":false},{"name":"Bitbucket","optional":true},{"name":"Git","optional":true},{"name":"Jira","optional":true},{"name":"Knowledge Graph","optional":true}],"status":"live","first_seen_at":"2026-08-03T06:56:16Z","employer_posted_date":"2026-08-03","last_verified_at":"2026-10-22T04:46:57Z","board_verified":true,"closed_at":null,"days_open":79,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":79},"description":"We are looking for a hands-on Senior Applied AI Evaluation Engineer to improve how our RAN R&D organization analyzes engineering tickets, supports Root-Cause Analysis, recommends ownership, and learns from resolved cases.\nYou will build rigorous evaluation datasets, establish meaningful baselines, compare internal and approved external tools, analyze failure modes, and prototype improvements across retrieval, classification, prompting, agent workflows, and model selection.\nThis role is focused on measurable, evidence-based improvement rather than AI demonstrations. You will assess whether AI-generated conclusions are accurate, grounded in evidence, appropriately calibrated, and useful to engineering teams.\nAs a secondary area of focus, you will analyze engineering workflows at case and team level to identify bottlenecks, handoffs, dependencies, and opportunities for process improvement.\nWhat you will do:\nDefine high-value RAN ticket-intelligence use cases, acceptance criteria, evaluation metrics, and quality guardrails.\nBuild and maintain representative, versioned evaluation datasets using resolved tickets, Root-Cause Analysis, logs, test evidence, code changes, reviews, reassignment history, and outcomes.\nEstablish current-tool and non-AI baselines before evaluating new LLM, RAG, search, or agent-based approaches.\nEvaluate approved internal, commercial, local, and open-source solutions using secure and reproducible data-handling processes.\nMeasure retrieval quality, groundedness, diagnosis accuracy, citation support, routing recommendations, calibration, abstention, latency, cost, and human effort.\nDesign held-out, time-based, edge, and adversarial test cases while preventing data leakage and future-outcome contamination.\nAnalyze failures and turn incorrect conclusions, misrouting, unsupported claims, and missed evidence into prioritized improvements.\nPrototype improvements in search, metadata, context construction, prompting, reranking, classification, agent workflows, and model selection.\nDevelop reusable evaluation pipelines, tools, services, APIs, dashboards, or documented workflows.\nWork closely with AI, RAN, QA, System Integration, Release, Field, data, and engineering teams to review results and support evidence-based decisions.\nWhat you should have:\nBSc or MSc in Computer Science, Data Science, Machine Learning, Statistics, Electrical Engineering, or a related field, or equivalent practical experience.\n5+ years of hands-on experience in applied machine learning, data science, search, natural-language processing, analytics engineering, or AI-enabled software systems.\nRecent experience evaluating LLM, RAG, search, or agent systems using representative datasets, task-specific metrics, human review, failure analysis, and regression testing.\nStrong Python and SQL skills, with experience building maintainable data pipelines, experiment workflows, services, or analytical tools.\nPractical experience with several areas such as information retrieval, embeddings, hybrid search, reranking, classification, structured outputs, tool calling, or common LLM failure modes.\nStrong statistical judgment, including sampling, leakage prevention, uncertainty, calibration, precision and recall, temporal drift, and controlled comparison of competing approaches.\nAbility to work with semi-structured engineering data from issue-tracking systems, source control, code reviews, continuous integration, logs, dashboards, and test systems.\nClear communication skills and the ability to explain results, limitations, and tradeoffs to technical and business stakeholders.\nPreferred qualifications:\nKnowledge of LTE, 5G NR, Open RAN, telecom-support workflows, or demonstrated ability to learn a technically complex domain through close collaboration with subject-matter experts.\nExperience with enterprise search, RAG evaluation, knowledge graphs, process mining, anomaly detection, or graph-based analysis.\nFamiliarity with Jira, Git or Bitbucket, CI/CD telemetry, software-delivery analytics, evaluation frameworks, experiment tracking, or data versioning.\nExperience working with open-weight LLMs, commercial model APIs, local inference, proprietary code, customer logs, or access-controlled engineering data.\nExperience handling privacy-sensitive or regulated data in secure enterprise environments.","description_format":"text","description_chars":4339,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Mobile Networks","Network Equipment"],"lifecycle":[{"event":"open","at":"2026-09-05T17:28:51Z"}],"visa":[],"liveness":{"score":19,"band":"cold","label":"Long shot","p_open":1,"p_active":0.523,"p_room":0.36,"age_days":78,"expected_fill_days":41,"reasons":["conf:2","stale_co","velocity","win:tail","crowd:"],"computed_at":"2026-10-21T05:46:15Z"},"pay":null,"html_url":"https://alion.io/job/parallel-wireless-senior-applied-ai-evaluation-engineer-ran-ticket-intelligence","json_url":"https://alion.io/job/parallel-wireless-senior-applied-ai-evaluation-engineer-ran-ticket-intelligence.json","meta":{"generated_at":"2026-10-22T05:55:08Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":498,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-23T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4814},"rest":"https://alion.io/mcp/rest/get_company?id=4814"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fparallel-wireless-senior-applied-ai-evaluation-engineer-ran-ticket-intelligence"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fparallel-wireless-senior-applied-ai-evaluation-engineer-ran-ticket-intelligence"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fparallel-wireless-senior-applied-ai-evaluation-engineer-ran-ticket-intelligence"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/parallel-wireless-senior-applied-ai-evaluation-engineer-ran-ticket-intelligence\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fparallel-wireless-senior-applied-ai-evaluation-engineer-ran-ticket-intelligence"}]}