Vendor website benchmark · category
LLM observability and evaluation vendors, measured on their own websites
Tracing, evaluation and prompt management for language models. Website measurement only.
Listed
13
Currently measurable
13
Median website score
79
Categories are editorial and unscored; membership never moves a score. Ungraded vendors sort after measured ones and are never coerced to zero. Score version 28.
| Vendor | Website score | Reach | Read | Quote | Findings | llms.txt | Entity map | Measured |
|---|---|---|---|---|---|---|---|---|
| Arize AI arize.com | 89 C | 90 | 85 | 91 | 2 | present | absent | 2026-10-04 12:22Z |
| Braintrust braintrust.dev | 86 C | 96 | 82 | 77 | 2 | present | absent | 2026-10-04 13:19Z |
| PromptLayer promptlayer.com | 86 C | 93 | 80 | 84 | 3 | present | absent | 2026-10-04 15:19Z |
| OpenRouter openrouter.ai | 84 C | 90 | 84 | 75 | 2 | present | absent | 2026-10-04 05:02Z |
| Fiddler AI fiddler.ai | 80 B | 87 | 80 | 69 | 0 | present | absent | 2026-10-06 18:19Z |
| Vellum vellum.ai | 80 C | 88 | 82 | 66 | 3 | present | absent | 2026-10-05 11:18Z |
| LiteLLM litellm.ai | 79 B | 87 | 75 | 71 | 2 | absent | absent | 2026-10-07 11:18Z |
| Helicone helicone.ai | 74 C | 85 | 85 | 47 | 3 | present | absent | 2026-10-07 01:18Z |
| Patronus AI patronus.ai | 74 C | 91 | 73 | 53 | 5 | absent | absent | 2026-10-04 11:17Z |
| Portkey portkey.ai | 71 C | 90 | 73 | 44 | 3 | present | absent | 2026-10-04 14:18Z |
| Humanloop humanloop.com | 69 C | 91 | 77 | 33 | 1 | present | absent | 2026-10-07 03:18Z |
| Langfuse langfuse.com | 68 C | 90 | 65 | 43 | 2 | present | absent | 2026-10-07 10:18Z |
| WhyLabs whylabs.ai | 63 D | 77 | 88 | 20 | 6 | absent | absent | 2026-10-05 13:18Z |
Compare within this category
Open any two to four of these side by side: /directory/compare/arize/braintrust — slugs in any order resolve to one canonical page.