{"id":2455239,"url":"https://alion.io/job/benchmarkit-ai-technical-lead","title":"AI Technical Lead","company":{"id":4423825,"name":"Benchmark IT Solutions LLC","domain":"benchmarkit.solutions","url":"https://alion.io/company/benchmarkit-2","size_band":null,"is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"Zoho Recruit","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"lead","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pune, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":22000,"max_usd":55000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":31},"experience_years_min":1,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Azure AKS","optional":false},{"name":"Computer Vision","optional":false},{"name":"DINOv2","optional":false},{"name":"GCP","optional":false},{"name":"HIPAA","optional":false},{"name":"ISO 27001","optional":false},{"name":"Least Privilege","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"OCR","optional":false},{"name":"OpenAI","optional":false},{"name":"PCI DSS","optional":false},{"name":"Playwright","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"SOC 2","optional":false},{"name":"Tool Use","optional":false},{"name":"Kubernetes","optional":true}],"status":"live","first_seen_at":"2026-10-13T15:53:14Z","employer_posted_date":"2026-10-13","last_verified_at":"2026-10-14T16:37:34Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"The role\nWe need senior hands now. The AI practice runs several concurrent client platforms in regulated industries, and the engineering team supporting them is early-career. The Technical Lead becomes the day-to-day technical owner of that team: the person who turns architecture decisions into implementable designs, runs the design gate, reviews the code, unblocks the hard problems personally, and tells the Chief Architect and delivery leadership the truth about risk.\nExpect the split to be roughly half hands-on engineering and half oversight. The hands-on half is the difficult half: retrieval architecture, agent orchestration, extraction accuracy, performance and cost. The oversight half is where you multiply - three to five engineers with one to two years of experience become independent owners of their workstreams within six months because of how you review, mentor and set standards.\nWhat will you do\nOwn technical delivery of AI workstreams across concurrent client engagements: scope, design, sequencing, quality and honest estimates.\n\nRun the pre-implementation design gate: review engineers' design notes, apply the tiered checklist, maintain the decisions register, and approve or send back before code is written.\n\nSet and enforce engineering standards for LLM systems - evaluation suites as release gates, prompt and model versioning, cost and latency budgets, guardrails and injection defenses, human approval gates, evidence and audit trails.\n\nPersonally build the hardest components: retrieval and re-ranking architecture, tool-calling and agent orchestration on Temporal, document extraction pipelines, on-premises and offline deployments.\n\nReview code at scale, including code produced with AI coding tools; catch invalidated model output, leaked secrets, missing tests and silent behavioral change before they merge.\n\nMentor early-career engineers with a deliberate plan: pair on design, grade their design notes, expand their ownership as they earn it.\n\nRepresent engineering with clients: explain trade-offs in plain language, push back on unsafe or unbounded asks, and turn vague requirements into a bounded phase-one scope.\n\nHold the security posture: secrets management via Vault and Key Vault, data residency, least-privilege access, and client confidentiality on on-premises work.\n\nBuild reusable Centre of Excellence assets - evaluation harness, RAG reference implementation, guardrail library, extraction patterns - so that the method travels across clients even when the code cannot.\n\nAssess codebases and delivery risk candidly and communicate upward early, including when the news is unwelcome.\n\nWhat you must bring\nTwo or more LLM systems that you shipped to production and operated, each with measurable quality gates. You can describe the incidents, what you measured, what you changed, and what you would do differently.\n\nDeep Python and strong system design: multi-tenant SaaS, asynchronous pipelines, event- or workflow-driven orchestration, data modelling on document and relational stores.\n\nEvaluation rigor as a habit: you have built eval datasets, chosen the metrics, and used them to block a release.\n\nCloud depth on Azure preferred (Azure AI Foundry, Azure OpenAI, AKS or App Service, Key Vault); AWS or GCP equivalents acceptable if the principles transfer.\n\nLed a team of three or more engineers through delivery, including design reviews and code reviews you were accountable for.\n\nJudgment about where a model does not belong, and the standing to say so to a client who wants one everywhere.\n\nClear written communication: design documents, decision records, risk memos. Comfortable in client-facing technical conversations.\n\nWhat would set you apart\nTemporal in production; durable, idempotent, resumable workflow design.\n\nDocument AI at depth: tiered OCR strategies, layout analysis, extraction accuracy measurement on real-world scanned records.\n\nComputer vision for inspection or verification use cases (DETR-family detectors, DINOv2 backbones, ensembling and box-fusion methods) and release gates expressed as per-class recall.\n\nCompliance frameworks applied to software delivery: GxP and 21 CFR Part 11, SOC 2, ISO 27001, HIPAA, PCI-DSS.\n\nTest automation strategy with AI-assisted authoring (Playwright), and the governance of AI coding tools inside an engineering team.\n\nExperience running a small engineering practice or CoE: standards, reusable assets, training, hiring.","description_format":"text","description_chars":4436,"description_truncated":false,"requirements":{"experience_years_min":1,"management_years_min":null,"team_size_min":3,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-13T15:53:14Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":23,"reasons":["conf:2","win:early"],"computed_at":"2026-10-14T06:34:16Z"},"pay":null,"html_url":"https://alion.io/job/benchmarkit-ai-technical-lead","json_url":"https://alion.io/job/benchmarkit-ai-technical-lead.json","meta":{"generated_at":"2026-10-14T17:35:49Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":22481,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4423825},"rest":"https://alion.io/mcp/rest/get_company?id=4423825"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbenchmarkit-ai-technical-lead"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbenchmarkit-ai-technical-lead"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbenchmarkit-ai-technical-lead"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/benchmarkit-ai-technical-lead\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbenchmarkit-ai-technical-lead"}]}