{"id":142081,"url":"https://alion.io/job/monte-carlo-applied-ai-engineer","title":"Applied AI Engineer","company":{"id":48429,"name":"Monte Carlo","domain":"montecarlo.ai","url":"https://alion.io/company/montecarlo","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"middle","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_regions","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["US","AR","BR","CA","CO","MX","AI","AG","AW","BS","BB","BZ","BM","BO","VG","BQ","KY","CL","CR","CW","DM","DO","EC","SV","FK","GF","GL","GD","GP","GT","GY","HT","HN","JM","MQ","MS","NI","PA","PY","PE"],"hiring_countries_total":51,"salary":{"min":200000,"max":260000,"currency":"USD","period":"year","gross":null,"usd_annual":260000},"salary_estimate":null,"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Claude","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Model Context Protocol","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Anthropic","optional":true},{"name":"Databricks","optional":true},{"name":"dbt","optional":true},{"name":"LLM","optional":true},{"name":"Snowflake","optional":true}],"status":"live","first_seen_at":"2026-08-27T18:53:38Z","employer_posted_date":"2026-08-27","last_verified_at":"2026-10-21T14:14:16Z","board_verified":true,"closed_at":null,"days_open":54,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":54},"description":"About Monte Carlo\nMonte Carlo is the agent trust platform that unifies data and agent observability to monitor, troubleshoot, and improve production AI systems. As enterprises prepare to deploy thousands of agents across business-critical use cases, Monte Carlo provides the reliability infrastructure to support them along this AI transformation, from human-guided agents to fully autonomous operations. Founded in 2019 and backed by leading investors, Monte Carlo empowers data and AI teams to ship trusted AI at scale. Learn more at montecarlo.ai\nThe Role\nWe're building the products that tell enterprises whether their AI agents can be trusted - and we need someone who works end to end, from an ambiguous problem statement through research, prototyping, and production. You'd get the problem, not the spec: research the approaches, prototype, prove what works, build it, and integrate it into the platform alongside our engineering and data science teams. This role exists because agent observability moved from roadmap to revenue faster than anyone predicted, and the work is now on the critical path.\nWhat You'll Do\nTake an open problem end-to-end - from research and prototyping through production, killing what doesn't work before it becomes someone's roadmap\n\nDesign and ship agent-powered features - root-cause analysis, incident triage, monitor generation - and integrate them into the platform with our engineering team\n\nBuild the eval infrastructure that makes those features safe to change: golden datasets, regression suites, offline and online scoring, and the judgment calls about what \"good\" means\n\nOwn retrieval and context pipelines over customer metadata, lineage, and query history, and instrument agent behavior in production - traces, failure taxonomies, cost and latency budgets - to close the loop on quality\n\nPartner with data science on detection quality and experiment design, and with PM on what an agent should do versus what it merely can do\n\nSet the technical bar for how we build with LLMs - patterns, guardrails, and the internal tooling other engineers reuse\n\nWhat We're Looking For\nYou've built agents in production with real users. Not integrated a framework. Not worked on a team that had one. Built them - agents with real autonomy and internal loops, where the model uses tools and decides what to do next without a human in the middle, and you kept them running once real users showed up. RAG with a wrapper doesn't count. Neither does a set of MCP tools point at an API.\n\nYou've run evals and monitored agents after launch. Agents are non-deterministic, so normal tests don't work on them. You've owned an eval framework - golden datasets, regression suites, offline and online scoring - not a folder of one-off scripts. And you've watched agents in production, not just in dev.\n\nPython, plus an ML or data science background. Python is your daily language and you're solid on the backend, though you don't need to be a distributed systems specialist. You understand models well enough to reason about how they behave - you're not an application engineer calling someone else's API.\n\n3+ years in ML, data science, or software engineering - at companies that ship quickly. Startups, AI-native teams, or high-growth product companies where the release cadence is measured in weeks, not quarters. If all of your experience sits inside large, process-heavy organizations with the platform already built for you, this seat will be a hard adjustment.\n\nYou work from a problem, not a spec. Handed an ambiguous problem statement, you design the experiment, build the smallest version to test it, and take what works into production.\n\nYou use AI tools every day. Claude or its equivalents are part of how you write code and do research, not something you tried once. This is backend and model layer work, by the way - no frontend.\n\nYou'd rather ship than polish. Most of this work needs a good answer quickly, not a perfect one eventually. You can tell which problems are the exception and deserve real depth - and you'll say no to the version that demos well and falls apart in production.\n\nNice to have: statistics and hypothesis testing, applied rather than theoretical. Building and maintaining MCP servers. Experience in the data and cloud space - Snowflake, Databricks, dbt, Airflow.\nThis Is Not For You If\nYour AI work is retrieval with a wrapper, or MCP tools pointed at an API - nothing that decides and acts on its own\n\nYour LLM experience is prototypes, notebooks, and demos that never carried production traffic\n\nYou need a fully specified problem before you start, or you're uncomfortable with the ambiguity of a category being invented in real time\n\nWhy Monte Carlo\nWe created the data observability category, and we're doing it again with agent trust - you'll build where the market is forming, not where it's settled\n\nSeries D, $236M raised, backed by Accel, Redpoint, Notable Capital, ICONIQ Growth, and Salesforce Ventures\n\nCustomers include HubSpot, Fox, Nasdaq, Toast, and Mercado Libre - your work ships to enterprises with real stakes\n\nSnowflake Partner of the Year and a verified connector in Anthropic's Claude AI directory\n\nRemote-first by design since day one, and recognized as a Best Workplace for it\n\nCompetitive compensation, equity, and a remote-first environment.\n\nCome As You Are\nEquality is a core tenet of Monte Carlo's culture. We are committed to building an inclusive global team that represents a variety of backgrounds, perspectives, beliefs, and experiences.\nMonte Carlo is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.\nWe are proud to be recognized for our world-class employee experience:\nMonte Carlo Named 2025 Databricks Data Governance Partner of the Year\nWe were recently recognized as the #1 Data Observability Platform by G2 for the 4th consecutive quarter. See our G2 reviews here!\nMonte Carlo Named to G2's Best Software Products of 2026\nMonte Carlo was featured on Database Trends and Applications (DBTA’s) Trend-Setting Products for 2025!\nWe are super proud to be named the 2026 Best Place to Work by Built In!\nBeware of Imposter Recruiters and Job Scams\nAll official communication from our recruiting team will come from an @montecarlodata.com email address.\n\nWe will never ask candidates to provide sensitive personal information (such as bank details, social security numbers, or payment) at any stage of the recruitment process.\n\nWe will never request payment for equipment, training, or application processing.\n\nOur open positions are always listed on our official careers page: https://jobs.ashbyhq.com/montecarlodata.\n\nIf you are contacted by someone claiming to represent Monte Carlo but you’re unsure of their legitimacy, please reach out to us directly at  before sharing any personal information.","description_format":"text","description_chars":6906,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"},{"name":"Argentina","iso":"AR","kind":"region"},{"name":"Brazil","iso":"BR","kind":"region"},{"name":"Canada","iso":"CA","kind":"region"},{"name":"Colombia","iso":"CO","kind":"region"},{"name":"Mexico","iso":"MX","kind":"region"},{"name":"Anguilla","iso":"AI","kind":"region"},{"name":"Antigua and Barbuda","iso":"AG","kind":"region"},{"name":"Aruba","iso":"AW","kind":"region"},{"name":"Bahamas","iso":"BS","kind":"region"},{"name":"Barbados","iso":"BB","kind":"region"},{"name":"Belize","iso":"BZ","kind":"region"},{"name":"Bermuda","iso":"BM","kind":"region"},{"name":"Bolivia","iso":"BO","kind":"region"},{"name":"British Virgin Islands","iso":"VG","kind":"region"},{"name":"Bonaire, Sint Eustatius and Saba","iso":"BQ","kind":"region"},{"name":"Cayman Islands","iso":"KY","kind":"region"},{"name":"Chile","iso":"CL","kind":"region"},{"name":"Costa Rica","iso":"CR","kind":"region"},{"name":"Curaçao","iso":"CW","kind":"region"},{"name":"Dominica","iso":"DM","kind":"region"},{"name":"Dominican Republic","iso":"DO","kind":"region"},{"name":"Ecuador","iso":"EC","kind":"region"},{"name":"El Salvador","iso":"SV","kind":"region"},{"name":"Falkland Islands","iso":"FK","kind":"region"},{"name":"French Guiana","iso":"GF","kind":"region"},{"name":"Greenland","iso":"GL","kind":"region"},{"name":"Grenada","iso":"GD","kind":"region"},{"name":"Guadeloupe","iso":"GP","kind":"region"},{"name":"Guatemala","iso":"GT","kind":"region"},{"name":"Guyana","iso":"GY","kind":"region"},{"name":"Haiti","iso":"HT","kind":"region"},{"name":"Honduras","iso":"HN","kind":"region"},{"name":"Jamaica","iso":"JM","kind":"region"},{"name":"Martinique","iso":"MQ","kind":"region"},{"name":"Montserrat","iso":"MS","kind":"region"},{"name":"Nicaragua","iso":"NI","kind":"region"},{"name":"Panama","iso":"PA","kind":"region"},{"name":"Paraguay","iso":"PY","kind":"region"},{"name":"Peru","iso":"PE","kind":"region"},{"name":"Puerto Rico","iso":"PR","kind":"region"},{"name":"Saint Kitts and Nevis","iso":"KN","kind":"region"},{"name":"Saint Lucia","iso":"LC","kind":"region"},{"name":"Saint Vincent and the Grenadines","iso":"VC","kind":"region"},{"name":"Saint-Pierre and Miquelon","iso":"PM","kind":"region"},{"name":"Sint Maarten","iso":"SX","kind":"region"},{"name":"Suriname","iso":"SR","kind":"region"},{"name":"Trinidad and Tobago","iso":"TT","kind":"region"},{"name":"Turks and Caicos Islands","iso":"TC","kind":"region"},{"name":"Uruguay","iso":"UY","kind":"region"},{"name":"United States Virgin Islands","iso":"VI","kind":"region"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Data Quality & Observability","Data Observability"],"lifecycle":[{"event":"open","at":"2026-08-27T18:53:38Z"}],"visa":[],"liveness":{"score":33,"band":"fade","label":"Fading","p_open":1,"p_active":0.741,"p_room":0.45,"age_days":54,"expected_fill_days":30,"reasons":["conf:1","win:tail"],"computed_at":"2026-10-21T05:46:15Z"},"pay":{"stated_usd_annual":260000,"is_top_pay":true},"html_url":"https://alion.io/job/monte-carlo-applied-ai-engineer","json_url":"https://alion.io/job/monte-carlo-applied-ai-engineer.json","meta":{"generated_at":"2026-10-21T16:17:09Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":23041,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":48429},"rest":"https://alion.io/mcp/rest/get_company?id=48429"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmonte-carlo-applied-ai-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmonte-carlo-applied-ai-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmonte-carlo-applied-ai-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/monte-carlo-applied-ai-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmonte-carlo-applied-ai-engineer"}]}