Agent Testing Network
50 agents continuously test every API in our directory across 10 domains. Every test is public, reproducible, and auditable. Watch them work.
Methodology
50
Benchmark agents across 10 domains
499
Standardized queries (simple → complex)
24,936
Total benchmark tests run
Agents — 50 agents using Claude, GPT-4, Gemini, DeepSeek, and Llama model families
Queries — 499 standardized queries across 10 domains, graded by complexity
Evaluation — LLM-judged relevance, freshness, and completeness (0–5 scale)
Frequency — Every 2 hours, automated via cron
Benchmarks by Domain
Recent Batch Comparisons
937b074a…e-commercecompare top tools for seo workflows (3)2 toolsSep 10, 03:30 AM▼
edb3beba…healthcarehealthcare best practices for insurance (2)3 toolsSep 10, 03:00 AM▼
| Tool | Relevance | Freshness | Completeness | Latency | Results |
|---|---|---|---|---|---|
| Exa Search | 5.0/5 | 3.0/5 | 5.0/5 | 416ms | 10 |
| Firecrawl | 0.0/5 | 0.0/5 | 0.0/5 | 335ms | 0 |
| Tavily | 0.0/5 | 0.0/5 | 0.0/5 | 218ms | 0 |
a5bb5626…legalfind primary sources about compliance in legal (20)2 toolsSep 10, 02:30 AM▼
| Tool | Relevance | Freshness | Completeness | Latency | Results |
|---|---|---|---|---|---|
| Exa Search | 5.0/5 | 3.0/5 | 5.0/5 | 353ms | 10 |
| Tavily | 0.0/5 | 0.0/5 | 0.0/5 | 232ms | 0 |
738eade9…financefinance regulations impacting regulatory (19)2 toolsSep 10, 02:00 AM▼
| Tool | Relevance | Freshness | Completeness | Latency | Results |
|---|---|---|---|---|---|
| Exa Search | 5.0/5 | 3.0/5 | 5.0/5 | 439ms | 10 |
| Tavily | 0.0/5 | 0.0/5 | 0.0/5 | 207ms | 0 |
4f9891a1…embeddingembedding best practices for query-embed (17)2 toolsSep 10, 01:30 AM▼
| Tool | Relevance | Freshness | Completeness | Latency | Results |
|---|---|---|---|---|---|
| Voyage Embeddings | 2.0/5 | 3.0/5 | 5.0/5 | 169ms | 1 |
| Jina Embeddings | 0.0/5 | 0.0/5 | 0.0/5 | 448ms | 0 |
Recent Tests
🔬Exa Searchhealthcare best practices for insurance (2)
416ms
🔬Exa Searchfind primary sources about compliance in legal (20)
353ms
🔬Exa Searchfinance regulations impacting regulatory (19)
439ms
🔬Voyage Embeddingsembedding best practices for query-embed (17)
169ms
🔬Polygon.ioSHOP
198ms
🔬Alpha VantageSHOP
196ms
🔬Exa Searchcompare top tools for regional-news workflows (13)
692ms
🔬Exa Searchlatest general changes affecting research (11)
286ms
Benchmarks by Task
Reproduce These Tests
All benchmark configurations are public. Your agent can download query sets and reproduce any test with its own infrastructure.