๐ค
LEADERBOARD
Agent Frameworks
Frameworks for building autonomous AI agents
18tools ranked
Agent Frameworks Rankings
Ranked by overall ToolRoute Score across all benchmark dimensions
| Rank | Tool Name | ToolRoute Score | Output | Reliability | Efficiency | Cost | Trust | Stars |
|---|---|---|---|---|---|---|---|---|
| ๐ฅ | CrewAI | 49.8 | 84.0 | 78.0 | 84.0 | 92.0 | 10.0 | 46,257 |
| ๐ฅ | LangChain | 49.7 | 84.0 | 80.0 | 82.0 | 90.0 | 10.0 | 129,781 |
| ๐ฅ | LlamaIndex Agents | 49.7 | 84.0 | 80.0 | 82.0 | 90.0 | 10.0 | 47,716 |
| #4 | PydanticAI | 48.8 | 78.0 | 80.0 | 84.0 | 92.0 | 10.0 | 15,502 |
| #5 | AutoGen | 48.7 | 82.0 | 78.0 | 80.0 | 90.0 | 10.0 | 55,709 |
| #6 | Phidata | 48.6 | 80.0 | 76.0 | 84.0 | 92.0 | 10.0 | 38,730 |
| #7 | Haystack Agents | 48.6 | 80.0 | 78.0 | 80.0 | 92.0 | 10.0 | 24,531 |
| #8 | Composio | 48.5 | 82.0 | 78.0 | 82.0 | 85.0 | 10.0 | 27,400 |
| #9 | Semantic KernelOfficial | 48.4 | 78.0 | 82.0 | 80.0 | 88.0 | 10.0 | 27,474 |
| #10 | Agno | 48.4 | 78.0 | 74.0 | 86.0 | 95.0 | 10.0 | 38,730 |
| #11 | SmolAgents | 48.3 | 76.0 | 76.0 | 88.0 | 95.0 | 10.0 | 26,078 |
| #12 | Letta | 48.0 | 78.0 | 76.0 | 82.0 | 92.0 | 10.0 | 21,607 |
| #13 | CAMEL | 47.5 | 78.0 | 72.0 | 80.0 | 95.0 | 10.0 | 16,374 |
| #14 | Bee AgentOfficial | 46.9 | 76.0 | 78.0 | 80.0 | 90.0 | 10.0 | 3,169 |
| #15 | SuperAGI | 44.9 | 76.0 | 70.0 | 78.0 | 95.0 | 10.0 | 17,275 |
| #16 | Playwright MCPOfficial | 9.4 | 9.3 | 9.2 | 8.8 | 8.5 | 9.0 | 29,042 |
| #17 | Puppeteer MCPOfficial | 9.2 | 8.8 | 8.5 | 8.5 | 9.0 | 9.0 | 81,246 |
| #18 | Browserbase MCPOfficial | 8.3 | 8.5 | 8.8 | 8.2 | 7.5 | 8.7 | 3,190 |
Score Guide
9.0+ Exceptional
8.0+ Excellent
7.0+ Good
6.0+ Fair
<6.0 Below Average
Contribute Benchmark Data
Help improve these rankings by submitting real-world telemetry. Contributors earn routing credits for every data point.