Skip to content

Integration: Clarvia AEO scoring for agent tool quality validation #592

@digitamaz

Description

@digitamaz

Integration Request: Clarvia AEO for ChatDev Agent Tool Quality

About Clarvia

Clarvia is an AEO (Agent Experience Optimization) platform that scores 27,000+ tools and APIs for autonomous agent use. Score 0-100: 60+ = reliable for production agents.

Why ChatDev?

ChatDev's multi-role agents (CEO, CTO, Programmer, Reviewer) collaborate to build software. When these agents need external tools or APIs during development, Clarvia can pre-qualify tool quality.

Simple Integration

import requests

def check_tool_before_use(tool_name: str) -> bool:
    """Pre-flight check: is this tool agent-ready?"""
    try:
        data = requests.get(
            f"https://clarvia-api.onrender.com/v1/check/{tool_name}",
            timeout=3
        ).json()
        return data.get("score", 0) >= 50
    except:
        return True  # Don't block if unavailable

# Example usage
if check_tool_before_use("github-api"):
    # Use tool normally
    pass

MCP Server

ChatDev can also use Clarvia as an MCP server:

npx -y clarvia-mcp-server@latest

Remote: https://clarvia-api.onrender.com/mcp/

Stats: 27,000+ indexed tools, 714 npm weekly downloads
GitHub: https://github.com/clarvia-project/clarvia-mcp-server

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions