654,929open jobs
38,112companies
91,902added this week
Browse all
Location
In office
Seniority
Senior · 5+ years exp
Overview
Company
Impact
Profile match
Inabia is an American technology consulting and staffing company that supplies software engineers, data specialists and analysts to enterprise and public sector clients. Its work covers custom application development, data engineering and analytics, cloud infrastructure and increasingly applied artificial intelligence, delivered both as consulting engagements and as direct placement of specialists into client teams. Headquartered in Columbus, Ohio with delivery capability in India, it posts a continuous volume of technical vacancies on behalf of client employers across the United States.

We are seeking an experienced AI/LLM Software Engineer to design, develop, and deploy enterprise-grade AI applications, assistants, agents, and intelligent workflows. The ideal candidate will have strong hands-on Python and software engineering experience combined with practical expertise in LLMs, RAG, agentic AI, orchestration frameworks, tool integration, and AI observability.

This is a highly collaborative, stakeholder-facing role requiring the ability to translate business requirements into secure, scalable, and production-ready AI solutions.

Key Responsibilities

  • Design and develop enterprise AI/LLM applications, assistants, agents, and intelligent workflows.
  • Build scalable and production-ready solutions using Python and modern software engineering practices.
  • Develop agentic AI workflows using frameworks such as LangGraph or similar orchestration technologies.
  • Implement tool integrations using MCP/FastMCP or comparable protocols and frameworks.
  • Build and integrate REST APIs, enterprise systems, databases, and SQL-based solutions.
  • Develop RAG (Retrieval-Augmented Generation) solutions using structured and unstructured data sources.
  • Design secure data-access patterns incorporating authentication, authorization, and enterprise security requirements.
  • Implement AI evaluation, monitoring, tracing, and observability using tools such as LangSmith, Weights & Biases (W&B), OpenTelemetry, or similar platforms.
  • Establish mechanisms to evaluate LLM accuracy, reliability, latency, cost, and overall application performance.
  • Incorporate Human-in-the-Loop (HITL) processes into AI workflows where appropriate.
  • Apply principles of AI governance, responsible AI, privacy, security, and compliance throughout the development lifecycle.
  • Collaborate directly with business stakeholders, product teams, architects, and engineering teams to identify opportunities and deliver AI solutions.
  • Act as a forward-deployed engineer, working closely with stakeholders to understand problems, prototype solutions, gather feedback, and rapidly iterate.
  • Troubleshoot, optimize, and continuously improve AI applications in production environments.
  • Contribute to technical documentation, architecture decisions, development standards, and best practices.
Required Qualifications
  • 5-8 years of professional software engineering experience.
  • Strong hands-on experience with Python and software development.
  • Demonstrated experience building AI/LLM-powered applications in enterprise or production environments.
  • Experience developing AI assistants, agents, agentic workflows, or LLM applications.
  • Hands-on experience with MCP/FastMCP or similar tool-integration technologies.
  • Experience with LangGraph or comparable AI/agent orchestration frameworks.
  • Strong understanding of APIs, SQL, databases, and enterprise system integration.
  • Experience implementing RAG solutions using structured and/or unstructured data.
  • Experience with LLM evaluation, monitoring, tracing, or observability tools such as LangSmith, W&B, OpenTelemetry, or similar.
  • Understanding of authentication, authorization, secure data access, and enterprise security practices.
  • Strong understanding of AI governance, responsible AI, privacy, security, and Human-in-the-Loop concepts.
  • Excellent communication and stakeholder-management skills.
  • Ability to work directly with customers/business stakeholders in a forward-deployed engineering capacity.
Preferred Qualifications
  • Experience working with major LLM platforms and APIs such as OpenAI, Azure OpenAI, Anthropic, or similar.
  • Experience with vector databases, embeddings, semantic search, and retrieval pipelines.
  • Experience deploying AI applications in cloud environments such as Azure, AWS, or GCP.
  • Familiarity with CI/CD, Git, containers, and modern DevOps practices.
  • Experience building enterprise-grade AI solutions with strong emphasis on security, scalability, reliability, and governance.
  • Experience working in consulting, professional services, or customer-facing engineering environments.
Key Technologies

Python | LLMs | Generative AI | AI Agents | AI Assistants | MCP / FastMCP | LangGraph | RAG | APIs | SQL | Databases | LangSmith | W&B | OpenTelemetry | Authentication | Authorization | AI Governance | Responsible AI | HITL | Enterprise Integration

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
654,929 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
In your city
In office • 12+ years exp
Python
SQL
Databases
Weaviate
Databricks
Pinecone
AI/ML
Spark
MLFlow
Vertex AI
AI Agents
NLP
Kubeflow
RAG
DevOps
GCP
Apply
$178k – $268k per year • Equity • Remote • Full-Time • 10+ years exp • High School Diploma • Asheville
Python
SQL
Databases
PostgreSQL
DevOps
Podman
Docker
Analytics
Tableau
Power BI
Management
Agile
Apply
Software Engineer 1 day ago
$38k – $87k per year (Estimated) • In office • Full-Time • 3+ years exp • Bachelor's Degree • Tokyo
Python
Go
JavaScript
TypeScript
SQL
Databases
PostgreSQL
DynamoDB
Amazon Aurora
Frontend
React.js
DevOps
Terraform
GitHub Actions
OpenTelemetry
Prometheus
CI/CD
Git
AWS
Docker
Kubernetes
AWS Lambda
Cortex
SLI/SLO/SLA
GitHub
Amazon S3
Amazon EventBridge
API Gateway
IoT
MQTT
Management
Agile
Apply
Data Scientist 1 day ago
$56k – $155k per year (Estimated) • In office • Full-Time • 2+ years exp • Sydney
Python
SQL
Databases
Google BigQuery
BigQuery
AI/ML
Scikit-learn
NumPy
DevOps
Git
AWS
Docker
Management
Confluence
Jira
Apply
$13k – $23k per year (Estimated) • In office • Internship • Bachelor's Degree • Pune
Python
SQL
AI/ML
AI Agents
DevOps
CI/CD
Git
Analytics
Power BI
Apply
In office • 5+ years exp • Bachelor's Degree
SQL
Analytics
Tableau
Apply
In office • 12+ years exp
JavaScript
TypeScript
SQL
C#
C#
.NET
Databases
PostgreSQL
AI/ML
Copilot
Cursor
Claude Code
AI Agents
Frontend
Angular
DevOps
Splunk
Azure DevOps
Datadog
Azure
CI/CD
AWS
Kubernetes
Amazon EKS
AWS Lambda
Amazon S3
Amazon ECS
Amazon CloudWatch
API Gateway
Analytics
ETL/ELT
QA
Selenium
Playwright
Postman
Rest-Assured
Apply
$64k per year • In office • 2+ years exp
DevOps
Incident Management
Management
ServiceNow
Apply
In office • Full-Time • 7+ years exp • Bachelor's Degree
Apply
In office • 12+ years exp
Python
SQL
Databases
Weaviate
Databricks
Pinecone
AI/ML
Spark
MLFlow
Vertex AI
AI Agents
NLP
Kubeflow
RAG
DevOps
GCP
Apply
See all jobs
This is one of many
654,929 more open roles from verified company boards, updated every day.