{"id":4468710,"url":"https://alion.io/job/blackthorn-vision-senior-ai-engineer","title":"Senior AI Engineer","company":{"id":2397435,"name":"Blackthorn Vision","domain":"blackthorn-vision.com","url":"https://alion.io/company/blackthorn-vision","size_band":null,"is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["Lviv, Ukraine"],"countries":["UA"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"ASP.NET Core","optional":false},{"name":"Azure","optional":false},{"name":"Azure DevOps","optional":false},{"name":"C#","optional":false},{"name":"Copilot","optional":false},{"name":"Function Calling","optional":false},{"name":"Kubernetes","optional":false},{"name":"LangGraph","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"OpenAI","optional":false},{"name":"OpenAI Agents SDK","optional":false},{"name":"PowerShell","optional":false},{"name":"Python","optional":false},{"name":"RabbitMQ","optional":false},{"name":"Redis","optional":false},{"name":"Semantic Kernel","optional":false},{"name":"Structured Outputs","optional":false},{"name":"CVE","optional":true},{"name":"Docker","optional":true},{"name":"EPSS","optional":true},{"name":"GitHub Actions","optional":true},{"name":"KEV","optional":true},{"name":"LangChain","optional":true},{"name":"OpenTelemetry","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-11-17T15:42:30Z","employer_posted_date":null,"last_verified_at":"2026-11-17T15:42:30Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"Blackthorn Vision is looking for a Senior AI Engineer. Our client, established in 2011 and based in Colorado, is a leading player in the U.S. application management market. We’ve had a successful partnership with this client and are seeking someone who is passionate about exploring the potential of AI, solving real customer problems, and bringing impactful AI capabilities to a product trusted by over 6,000 enterprises.\n\nWhat you’ll work on\n\nBuild AI Insights and agentic product experiences\n\nDevelop our AI orchestration microservice using C# / .NET 10, MongoDB, Redis, RabbitMQ, and Kubernetes, working closely with architects and technical leads.\n\nIntegrate LLMs using Microsoft Agent Framework and Microsoft.Extensions.AI with Azure AI Foundry / Azure OpenAI, including the Responses API.\n\nDesign prompt templates and structured JSON-schema outputs, select the right model for each task, and implement token metering, cost estimation, and budget controls.\n\nDecide what customer data an LLM should see for each task, including devices, vulnerabilities, installed applications, and patch deployments, and design efficient retrieval strategies that balance context quality with token cost.\n\nEvolve the platform from batch-generated insights toward chat and agentic workflows, including tool calling over customer data, multi-step agents, and appropriate guardrails.\n\nMake AI quality measurable through evaluation datasets, prompt A/B experiments on real tenant data, LLM-as-judge evaluation, duplicate detection, source attribution, and latency benchmarking.\n\nManage AI model deployments and capacity across development, staging, and production environments in US and EU Azure regions.\nImprove AI-assisted software development\n\nWe also use AI inside the engineering process itself.\n\nYou’ll help maintain a shared GitHub Copilot instruction and tooling catalog used across 40+ engineering repositories, covering:\n\ncoding, security, and testing conventions;\n\nreusable prompts;\n\nagents and skills;\n\nCopilot plugins.\n\nYou’ll evolve the delivery pipeline that distributes updates to consumer repositories through automated PRs, while supporting repository-specific overrides and opt-outs using Azure DevOps YAML, PowerShell, and CI guards.\n\nDiscover and ship new AI opportunities\n\nIdentify product problems where AI can provide capabilities that conventional software cannot.\n\nResearch ideas and test their feasibility against real product data.\n\nBuild prototypes and compare them against meaningful baselines.\n\nTake successful experiments through production rather than stopping at the demo stage.\n\nHelp other engineering teams design and integrate AI capabilities.\n\nWrite technical proposals for product and engineering leadership.\n\nTurn ambiguous ideas into scoped, deliverable engineering work.\n\nWhat we’re looking for\n\n5+ years of professional software engineering or ML engineering experience.\n\n2+ years building and shipping LLM-powered features to production, with hands-on experience in areas such as:prompt design;\n\nstructured outputs;\n\noffline evaluation datasets;\n\nA/B experimentation;\n\nLLM-as-judge evaluation;\n\nlatency and cost optimization.\nExperience building at least one tool-calling agent or conversational assistant over real data, using a framework such as Microsoft Agent Framework, Semantic Kernel, LangGraph, OpenAI Agents SDK, or equivalent.\n\nStrong experimental discipline: you can define a baseline, choose meaningful metrics, run experiments on real data, and interpret disappointing results as honestly as successful ones.\n\nStrong Python skills for experimentation, evaluation, and data analysis.\n\nPractical C# / .NET experience. You should be comfortable implementing production features in an existing ASP.NET Core codebase with support from technical leads.\n\nHands-on experience using GitHub Copilot or another AI coding assistant as part of your daily engineering workflow, ideally including custom instructions, prompts, agents, or similar extensions.\n\nAbility to explain LLM behavior, limitations, costs, and engineering trade-offs to non-AI specialists and product leadership.\n\nStrong ownership. Given an open-ended product problem, you can turn it into a testable question, evaluate it on real data, and independently drive a useful result to completion.\n\nNice to have\n\nMicrosoft Agent Framework\n\nMicrosoft.Extensions.AI\n\nAzure OpenAI / Azure AI Foundry\n\nOpenTelemetry\n\nMicroservices architecture\n\nRabbitMQ\n\nDocker and Kubernetes\n\nAzure DevOps YAML or GitHub Actions\n\nPowerShell\n\nTerraform\n\nRolling out AI coding assistants across multiple engineering teams\n\nEndpoint management, patching, or vulnerability management\n\nMicrosoft Intune or Configuration Manager\n\nCVE, EPSS, or CISA KEV data","description_format":"text","description_chars":4725,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Outsourcing & Dedicated Teams","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-11-17T15:42:30Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":30,"reasons":["seen:0","win:early"],"computed_at":"2026-11-17T18:37:06Z"},"pay":null,"html_url":"https://alion.io/job/blackthorn-vision-senior-ai-engineer","json_url":"https://alion.io/job/blackthorn-vision-senior-ai-engineer.json","meta":{"generated_at":"2026-11-17T18:37:06Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":32700,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2397435},"rest":"https://alion.io/mcp/rest/get_company?id=2397435"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fblackthorn-vision-senior-ai-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fblackthorn-vision-senior-ai-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fblackthorn-vision-senior-ai-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/blackthorn-vision-senior-ai-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fblackthorn-vision-senior-ai-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4468710}},{"tool":"search_jobs","arguments":{"company":"blackthorn-vision.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4468710},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}