Vendor website benchmark · category
LLM observability and evaluation vendors, measured on their own websites
Tracing, evaluation and prompt management for language models. Website measurement only.
Listed
13
Currently measurable
13
Median website score
82
Categories are editorial and unscored; membership never moves a score. Ungraded vendors sort after measured ones and are never coerced to zero. Score version 34.
| Vendor | Website score | Reach | Read | Quote | Findings | llms.txt | Entity map | Measured |
|---|---|---|---|---|---|---|---|---|
| Arize AI arize.com | 90 C | 93 | 86 | 91 | 2 | present | absent | 2026-11-02 12:36Z |
| Patronus AI patronus.ai | 88 C | 92 | 89 | 83 | 4 | present | absent | 2026-10-31 21:34Z |
| PromptLayer promptlayer.com | 87 C | 94 | 78 | 85 | 4 | present | absent | 2026-10-27 10:33Z |
| Braintrust braintrust.dev | 86 C | 94 | 84 | 77 | 4 | present | absent | 2026-10-26 14:34Z |
| OpenRouter openrouter.ai | 86 D | 94 | 86 | 76 | 5 | present | absent | 2026-10-31 19:34Z |
| Fiddler AI fiddler.ai | 82 B | 91 | 83 | 70 | 3 | present | absent | 2026-10-30 02:33Z |
| Vellum vellum.ai | 82 C | 91 | 84 | 67 | 3 | present | absent | 2026-10-25 13:05Z |
| LiteLLM litellm.ai | 80 B | 89 | 75 | 74 | 2 | present | absent | 2026-10-30 16:04Z |
| Helicone helicone.ai | 75 C | 88 | 84 | 50 | 4 | present | absent | 2026-10-30 05:33Z |
| Humanloop humanloop.com | 73 B | 95 | 79 | 36 | 2 | present | absent | 2026-10-30 07:04Z |
| Langfuse langfuse.com | 72 C | 96 | 66 | 46 | 3 | present | absent | 2026-10-30 15:03Z |
| Portkey portkey.ai | 72 C | 91 | 73 | 46 | 4 | present | absent | 2026-10-31 13:35Z |
| WhyLabs whylabs.ai | 64 D | 82 | 80 | 25 | 5 | absent | absent | 2026-10-27 15:04Z |
Compare within this category
Open any two to four of these side by side: /directory/compare/arize/patronus — slugs in any order resolve to one canonical page.