Participate in our State of AI Development Surveyfor a chance to win a MacBook M4 Pro!Take 4-min Survey →
SaaS
Q&A across knowledge bases

Process documents with OCR, test different search strategies, and orchestrate multiple agents to work together to answer questions.

Input Variables
Question
How do I pass inputs into an API node?
Run the prompt to see the model response...

Look for relevant context on multiple Document Indexes in parallel to reduce latency.

User passes question

We feed context from each Search result to different agents and have them answer the user’s question as well as possible.

We let a Supervisor Agent see the user’s original question and each of the Support Agent’s responses. The Supervisor picks the best response, if any.

To pass inputs into an API Node, you can use URL parameters or a JSON body. For URL parameters, you can define them directly in the URL field of the API Node. For a JSON body, you can specify the body content in the designated field of the API Node.

For more detailed instructions, you can refer to the [Node Types Help Doc](https://docs.vellum.ai/help/node-types).

How it works
step
1
Document Search

Look for relevant context on multiple Document Indexes in parallel to reduce latency.

step
2
Support Agents

We feed context from each Search result to different agents and have them answer the user’s question as well as possible.

step
3
Supervisor Agent

We let a Supervisor Agent see the user’s original question and each of the Support Agent’s responses. The Supervisor picks the best response, if any.

Tools used
Tools
RAG
Agent
Chat
Evaluator

Customize this workflow

1/ Add additional data sources

2/ Use advanced document chunking to process complex PDFs with images, charts, spreadsheets, etc.

3/ Add routing → escalate to humans when no good answer is available

4/ Add out of the box metrics to evaluate the quality of your RAG

5/ Add Tools so your LLMs can perform actions on behalf of your users

talk with aI Expert
See what else you can build
View More

Experiment, Evaluate, Deploy, Repeat.

AI development doesn’t end once you've defined your system. Learn how Vellum helps you manage the entire AI development lifecycle.

Talk with us