Introduction to the Agent Connect Framework
An introduction to the Agent Connect Framework
What is the Agent Connect Framework?
The Agent Connect Framework (ACF) is a comprehensive specification that enables seamless collaboration between AI agents in multi-agent applications, including specifications like APIs and open-source middleware services. It provides the foundation for connecting agents built with different frameworks and technologies within the IBM watsonx ecosystem. ACF is built on five core principles:
- Interoperability: Enable agents built with any framework to communicate and collaborate.
- Standardization: Provide consistent interfaces and protocols for agent interaction.
- Simplicity: Make integration as straightforward as possible for developers.
- Extensibility: Allow for future expansion and adaptation as agent technologies evolve.
- Security: Ensure secure communication and data handling between agents.
Architecture Overview
The ACF architecture consists of several key components that enable agent collaboration:
1. Agent Connect Protocol
The Agent Connect Protocol defines the standard interfaces and communication patterns for agents to interact with each other and with the watsonx Orchestrate platform. It is designed to be compatible with existing agent frameworks and to provide a consistent experience for developers.
2. Chat API
The Chat API is the primary interface for agent-to-agent communication. It follows the familiar OpenAI chat completions format, facilitating implementation and integration with existing agent frameworks. It supports both synchronous and streaming responses for real-time interaction between agents.
3. Agent Discovery
The Agent Discovery component allows agents to discover and learn about other agents in the ecosystem. This enables dynamic collaboration between agents without requiring hardcoded knowledge of each other.
4. AI Gateway
The AI Gateway provides centralized access to AI models such as LLMs, voice models, and embeddings models. It simplifies the implementation and management of multi-agent systems by providing shared access to these models and collecting telemetry across agents.
Core components
- Agent Connect API: API endpoints for agent discovery and communication
- Your AI Agent: Any AI agent that implements the Agent Connect APIs
- AI Gateway: Centralized access to AI models and telemetry coordination (optional)
Key Benefits
- Framework Agnostic: Integrate agents built with any framework, including LangChain, LangGraph, CrewAI, Copilot Studio, and custom frameworks.
- Standardized Communication: Use familiar chat completion-style APIs with streaming capabilities.
- Multi-Agent Collaboration: Enable your agents to work together with other specialized agents.
- Enterprise Integration: Leverage IBM watsonx Orchestrate’s enterprise features for security, governance, and scalability.
- Simplified Development: Reduce integration complexity with standardized protocols and specifications.
Use Cases
Agent Connect Framework enables a wide range of use cases, including:
- Agent Specialization: Create specialized agents that excel at specific tasks.
- Multi-Agent Workflows: Combine multiple agents to solve complex problems.
- Enterprise Integration: Connect agents to enterprise systems and data sources.
- Collaborative Problem Solving: Enable agents to work together on complex tasks.
- Skill Sharing: Allow agents to leverage capabilities from other agents.
How it works
To integrate your agent with Agent Connect, follow these steps:
- Implement Agent Connect API endpoints: Implement the Agent Connect API endpoints (primarily the chat completion endpoint) in your agent.
- Enable discovery: Enable your agent to be discovered by watsonx Orchestrate and other agents.
- Participate in multi-agent workflows: Participate in multi-agent workflows, receiving requests and returning responses.
- Optional: Leverage shared AI models: Optionally leverage shared AI models through the AI Gateway, which collects agent telemetry for end-to-end monitoring and governance of multi-agent systems.
How ACF enables collaboration
ACF enables collaboration between agents through several mechanisms:
1. Standardized communication
Agents communicate using a standardized chat completions API, which follows familiar patterns from OpenAI and other LLM providers. This standard facilitates the implementation of the required endpoints and maintains consistency in the communication between agents.
2. Tool call context sharing
Agents can share tool calling details with other agents using Agent Connect events.
3. Streaming Intermediate Steps
Agents can stream their intermediate thinking steps and tool calls, providing visibility into their reasoning process and enabling more effective collaboration.
4. Stateful Conversations
Agents can maintain state across multiple interactions using thread IDs, allowing for complex, multi-turn conversations and workflows.
Implementation Considerations
When implementing ACF in your agents, consider the following practices:
- API Compatibility: Ensure your agent implements the required endpoints according to the specification.
- Streaming Support: Implement streaming responses for better user experience and collaboration.
- Tool Integration: Design your agent to consume tools effectively and share tool calling context when appropriate.
- Error Handling: Implement robust error handling for resilient agent interactions.
- Security: Follow security best practices for agent communication and data handling.
Next Steps
To learn more about specific components of ACF, explore the following sections:
Chat Protocol
Learn about the chat completion protocol for agent communication
Agent Discovery
Understand how agents discover and interact with each other
AI Gateway
Explore the AI gateway for shared model access and telemetry
Relationship with other protocols
See how ACF relates to other agent collaboration protocols
Examples
See a few examples that show how you can implement the ACF in your agents