Actively hiring
AI Development Tools
AI Evaluation & Observability
As featured in
Follow
Overview
News
Salaries
Products
People
Growth
Offices
Financials
Funding and backers
Team
11-50
employees, estimated range
Backers
1
ScOp Venture Capital
Momentum
0/100
no fresh signals
Last sign of life
this month
a posting or a news item
The story so fareach stage dated by its source: the company's releases, the press, registers, filings
Jan 4, 2023
Launched on Hacker News Show HN: Be a 10x (prompt) engineer. Utilize your GPT-3.5 history
2022
Founded
Tractionpublic signals, read monthly
Backed byfrom the funds' portfolios and accelerator catalogs
Investors in similar startupsfunds that back the companies most like this one
Similar startupsby what they do, their industry and backers

Vellum is a San Francisco company founded in 2023 that provides a development platform for large language model applications. It combines…

Respan, which launched as Keywords AI, builds the observability and evaluation layer that engineers rely on to trace, debug and improve…

Braintrust is a San Francisco company founded in 2023 that provides evaluation and observability tooling for teams shipping large language…

Build better AI systems with evals, RAG, agents, synthetic data, fine-tuning, and prompt optimization. Free app + open-source library.

Open-source AI agent monitoring platform. Full observability into what.

Vals AI runs private, domain-specific benchmarks that measure how language models perform on legal, tax and finance work. Its public…
Overview
PromptLayer is a New York company founded in 2022 that provides prompt management and observability for language model applications. It logs every request, versions prompts outside of code so non-engineers can edit them and runs regression evaluations when a prompt or model changes. The product is used by product teams that treat prompts as shared assets rather than buried strings.
News
Why We Transitioned Our Dashboard Assistant from Claude Code SDK to Tools
Discover why we transitioned our Dashboard Assistant from Claude Code SDK to a simpler prompt and tool-based approach. This post offers insights into our decision-making process, improvements in simplicity, and enhanced functionality for your AI projects.
Read more
Report
How OpenAI Codex Works Behind-the-Scenes (and How It Compares to Claude Code)
Suddenly everyone is switching from Claude Code to OpenAI Codex. I'm not sure which is better (I use both). But it's not just the model. They are made in different ways. The agentic architecture Codex uses will help us understand when to use it, and how t
Read more
Report
In-depth Exploration of Claude Code's Master Agent Loop for AI Teams
Explore the intricate architecture of Claude Code in our latest post. Designed for AI teams and developers, this article dives into the master agent loop mechanics and examines why Anthropic's Claude Code ran 24/7. Unlock practical insights for building r
Read more
Report
Understanding LLM Idioms: Optimizing AI Language Models for Better Prompt Engineering
Explore the concept of LLM idioms, patterns that large language models understand implicitly. Learn how these native AI languages can optimize prompt engineering and improve the performance of your LLM applications. Perfect for developers and AI teams aim
Read more
Report
Evaluating AI Engineers for LLM Multi-Agent Systems: Key Interview Strategies
So you need a team to build an LLM multi-agent system... how do you interview candidates? I'll try to provide some ideas and strategies in this article.Firstly... What is an AI Engineer?AI engineers build the future. They create scalable AI systems and ag
Read more
Report
PromptLayer is building tools to put non-techies in the driver's seat of AI app development
The GenAI boom of the last few years has unleashed a wave of startups promising to support the process of prompt engineering -- i.e., coming up with
Read more
Report
Fine-Tuning Challenges: Reassessing Your LLM Approach
Discover why fine-tuning might not be the best choice for your LLM applications. This article guides AI developers through the pitfalls of custom-trained models, offering alternatives that prioritize efficiency and effectiveness. Ideal for teams focused o
Read more
Report
Speeding up iteration with PromptLayer's CMS (tips for prompt management)
This post was cross-posted with permission from Greg Baugues. You can find the original at https://www.haihai.ai/friction/
Read more
Report
Show more news
Offices
Where the company hires and what each office is for
Cities
1
Hiring now
0
Countries
1
New York
United States
HQ
10-50 est. staff

ScOp Venture Capital 



