Vellum is coming to the AI Engineering World's Fair in SF. Come visit our booth and get a live demo!

Partnering with Composio to Help You Build Better AI Agents

Building AI agents is 10x easier with 10,000+ tools and built-in LLM tooling support

6 min
Written by
Reviewed by
No items found.

AI agent building just got easier with Vellum and Composio. Today, we’re excited to share our partnership with Composio, a leading AI connector platform with 10,000+ tools (Google Drive, Notion, Jira, Linear, Trello, etc.) that can adapt to your AI solutions.

We’re now offering first-class support for Composio tools in our newly launched Agent Node, enabling our customers to build even more powerful agents.

Thanks to this partnership, hundreds of agentic use cases just became 100x easier to build with Vellum. Sing up here, and start building! Here are some ideas to get you started:

  • An agent that researches competitor profiles and sends a report straight to your inbox
  • An agent that gathers all Jira tickets and sends a weekly report to the team
  • An agent that searches the internet and creates SEO-optimized articles in your Notion
  • An agent that monitors all new Jira bugs and sends Slack notifications to the team

Tomorrow (9/13) at 4 pm EST, Vargas, our founding engineer, will demo how to start building agents using the Agent Node and your Composio tools. Save your spot here!

The sections below provide a full tutorial on how the Agent node works, how to integrate with Composio and start using it today.

Quick primer on the Agent Node

The Agent Node streamlines tool calling within Vellum Workflows by automatically handling OpenAPI schema generation, loop logic, and function call output parsing. This eliminates the tedious manual work traditionally required for implementing function calling patterns.

Key Features

The Agent Node provides several advantages over manual function calling implementation:

  • Automatic Schema Generation: No need to manually define OpenAPI schemas for your tools
  • Built-in Loop Logic: Automatically handles the iterative calling pattern until a text response is received
  • Output Parsing: Automatically parses function call outputs without manual intervention
  • Multiple Tool Support: Configure multiple tools within a single node

Configuration

The Agent Node requires two main components:

1. Model and Prompt Configuration

Configure the LLM model and prompt that will determine when and how to call the available tools.

2. Tool Definitions

Define the tools that the model can call. The node automatically infers the required schema for each tool type. The Agent Node supports three types of tools:

For more context about each of the tool types, and the outputs you can get from this Node, you can read in the official documentation page.

How to use the Agent Node with Composio tools

To use the Agent Node with Composio, you’ll need to have:

  • An account with Composio (they have a free tier with up to 20k tool calls/m)
  • An account with Vellum

Composio setup

Now, to start using tools from Composio in Vellum, you’ll need to do two things:

  1. You’ll need to authenticate the tools in your Composio account
  2. Create and copy your Composio API key

Tool authentication

To do that, head to your profile, and go into the Auth Configs section. Once you’re there, click on the “Create Auth Config” button:

Once you click that button, you’ll be able to select the tool that you want to authenticate with (see first image). From there if you select “Gmail” for example as your tool, you’ll be able to use the OATH 2 option. You don’t change anything in the settings, and just click on “Create Gmail Auth Config” (see second image):

Once you initialize the Gmail tool, you’ll arrive to the configuration for that specific tool. In it you’ll need to add your account by clicking on “Connect Account” where you’ll be asked to connect your gmail account via OAUTH 2 authorization:

Once you click “Connect Account” you’ll see a pop up asking you to add a User ID. Just type “default” here, and you should be able to authenticate:

If the authentication was successful, you’ll be able to see your account listed under this configuration, with status “Active”:

Getting your Composio API

Before you go into your Vellum workspace, you’ll need to create an API key from Composio. To do that, navigate to “Settings” and click “Create API key”. Once you have the API key, copy it to your clipboard.

The next steps are going to happen in Vellum.

Vellum setup

In Vellum, you’ll need to do two things:

  • Setup your Composio secret as an environment variable once (You can do this from your Workspace setting, or directly on the Agent node. Bellow we show the former example)
  • Add an Agent Node, select the Composio tool type and connect with your tools

Adding your Composio secret

In Vellum, navigate to your Workspace Settings, where you’ll find the Environment variables section. Then, click on “Add Environment Variable”:

From there you can add your API key, and create a Variable:

Now you’re ready to use your Composio account in Vellum Workflows, in the Agent Node!

Using Composio tools in the Agent Node

Now that you have Composio connected with Vellum, you can start giving your LLMs tools to work with. Once you select the Agent Node, in a given workflow, and you select “Composio tools” from the Tool dropdown, you’ll be able to select specific tools that you’d like to enable for a given LLM call:

Once you enable one tool, for example “Create an email draft” you’re going to see the tool selection in the side-nav, and the LLM call will be ready to use it under the hood:

So for example, if you write in the prompt something like “ Send an email draft with 5 quotes to "sam@open.ai”, the LLM model will know to create the 5 quotes, and open an email draft in Sam’s inbox containing that output!

And there you have it folks! Looking forward to what you can build next! Signup to Vellum today!

ABOUT THE AUTHOR
Anita Kirkovska
Founding Growth Lead

An AI expert with a strong ML background, specializing in GenAI and LLM education. A former Fulbright scholar, she leads Growth and Education at Vellum, helping companies build and scale AI products. She conducts LLM evaluations and writes extensively on AI best practices, empowering business leaders to drive effective AI adoption.

ABOUT THE reviewer

No items found.
lAST UPDATED
Aug 12, 2025
share post
Expert verified
Related Posts
Guides
October 21, 2025
15 min
AI transformation playbook
LLM basics
October 20, 2025
8 min
The Top Enterprise AI Automation Platforms (Guide)
LLM basics
October 10, 2025
7 min
The Best AI Workflow Builders for Automating Business Processes
LLM basics
October 7, 2025
8 min
The Complete Guide to No‑Code AI Workflow Automation Tools
All
October 6, 2025
6 min
OpenAI's Agent Builder Explained
Product Updates
October 1, 2025
7
Vellum Product Update | September
The Best AI Tips — Direct To Your Inbox

Latest AI news, tips, and techniques

Specific tips for Your AI use cases

No spam

Oops! Something went wrong while submitting the form.

Each issue is packed with valuable resources, tools, and insights that help us stay ahead in AI development. We've discovered strategies and frameworks that boosted our efficiency by 30%, making it a must-read for anyone in the field.

Marina Trajkovska
Head of Engineering

This is just a great newsletter. The content is so helpful, even when I’m busy I read them.

Jeremy Hicks
Solutions Architect

Experiment, Evaluate, Deploy, Repeat.

AI development doesn’t end once you've defined your system. Learn how Vellum helps you manage the entire AI development lifecycle.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Build AI agents in minutes with Vellum
Build agents that take on the busywork and free up hundreds of hours. No coding needed, just start creating.

General CTA component, Use {{general-cta}}

Build AI agents in minutes with Vellum
Build agents that take on the busywork and free up hundreds of hours. No coding needed, just start creating.

General CTA component  [For enterprise], Use {{general-cta-enterprise}}

The best AI agent platform for enterprises
Production-grade rigor in one platform: prompt builder, agent sandbox, and built-in evals and monitoring so your whole org can go AI native.

[Dynamic] Ebook CTA component using the Ebook CMS filtered by name of ebook.
Use {{ebook-cta}} and add a Ebook reference in the article

Thank you!
Your submission has been received!
Oops! Something went wrong while submitting the form.
Button Text

LLM leaderboard CTA component. Use {{llm-cta}}

Check our LLM leaderboard
Compare all open-source and proprietary model across different tasks like coding, math, reasoning and others.

Case study CTA component (ROI)

40% cost reduction on AI investment
Learn how Drata’s team uses Vellum and moves fast with AI initiatives, without sacrificing accuracy and security.

Case study CTA component (cutting eng overhead) = {{coursemojo-cta}}

6+ months on engineering time saved
Learn how CourseMojo uses Vellum to enable their domain experts to collaborate on AI initiatives, reaching 10x of business growth without expanding the engineering team.

Case study CTA component (Time to value) = {{time-cta}}

100x faster time to deployment for AI agents
See how RelyHealth uses Vellum to deliver hundreds of custom healthcare agents with the speed customers expect and the reliability healthcare demands.

[Dynamic] Guide CTA component using Blog Post CMS, filtering on Guides’ names

100x faster time to deployment for AI agents
See how RelyHealth uses Vellum to deliver hundreds of custom healthcare agents with the speed customers expect and the reliability healthcare demands.
New CTA
Sorts the trigger and email categories

Dynamic template box for healthcare, Use {{healthcare}}

Start with some of these healthcare examples

Healthcare explanations of a patient-doctor match
Summarize why a patient was matched with a specific provider.
SOAP Note Generation Agent
Extract subjective and objective info, assess and output a treatment plan.

Dynamic template box for insurance, Use {{insurance}}

Start with some of these insurance examples

AI agent for claims review
Review healthcare claims, detect anomalies and benchmark pricing.
Agent that summarizes lengthy reports (PDF -> Summary)
Summarize all kinds of PDFs into easily digestible summaries.
Insurance claims automation agent
Collect and analyze claim information, assess risk and verify policy details.

Dynamic template box for eCommerce, Use {{ecommerce}}

Start with some of these eCommerce examples

E-commerce shopping agent
Check order status, manage shopping carts and process returns.

Dynamic template box for Marketing, Use {{marketing}}

Start with some of these marketing examples

LinkedIn Content Planning Agent
Create a 30-day Linkedin content plan based on your goals and target audience.
Competitor research agent
Scrape relevant case studies from competitors and extract ICP details.

Dynamic template box for Sales, Use {{sales}}

Start with some of these sales examples

Research agent for sales demos
Company research based on Linkedin and public data as a prep for sales demo.

Dynamic template box for Legal, Use {{legal}}

Start with some of these legal examples

Legal document processing agent
Process long and complex legal documents and generate legal research memorandum.
Legal contract review AI agent
Asses legal contracts and check for required classes, asses risk and generate report.

Dynamic template box for Supply Chain/Logistics, Use {{supply}}

Start with some of these supply chain examples

Risk assessment agent for supply chain operations
Comprehensive risk assessment for suppliers based on various data inputs.

Dynamic template box for Edtech, Use {{edtech}}

Start with some of these edtech examples

Turn LinkedIn Posts into Articles and Push to Notion
Convert your best Linkedin posts into long form content.

Dynamic template box for Compliance, Use {{compliance}}

Start with some of these compliance examples

No items found.

Dynamic template box for Customer Support, Use {{customer}}

Start with some of these customer support examples

Q&A RAG Chatbot with Cohere reranking
Trust Center RAG Chatbot
Read from a vector database, and instantly answer questions about your security policies.

Template box, 2 random templates, Use {{templates}}

Start with some of these agents

SOAP Note Generation Agent
Extract subjective and objective info, assess and output a treatment plan.
Turn LinkedIn Posts into Articles and Push to Notion
Convert your best Linkedin posts into long form content.

Template box, 6 random templates, Use {{templates-plus}}

Build AI agents in minutes

Insurance claims automation agent
Collect and analyze claim information, assess risk and verify policy details.
Research agent for sales demos
Company research based on Linkedin and public data as a prep for sales demo.
SOAP Note Generation Agent
Extract subjective and objective info, assess and output a treatment plan.
Q&A RAG Chatbot with Cohere reranking
Synthetic Dataset Generator
Generate a synthetic dataset for testing your AI engineered logic.
Legal RAG chatbot
Chatbot that provides answers based on user queries and legal documents.

Build AI agents in minutes for

{{industry_name}}

Clinical trial matchmaker
Match patients to relevant clinical trials based on EHR.
Prior authorization navigator
Automate the prior authorization process for medical claims.
Population health insights reporter
Combine healthcare sources and structure data for population health management.
Legal document processing agent
Process long and complex legal documents and generate legal research memorandum.
Legal contract review AI agent
Asses legal contracts and check for required classes, asses risk and generate report.
Legal RAG chatbot
Chatbot that provides answers based on user queries and legal documents.

Case study results overview (usually added at top of case study)

What we did:

1-click

This is some text inside of a div block.

28,000+

Separate vector databases managed per tenant.

100+

Real-world eval tests run before every release.