{"kind":"crawlcheck-rights","v":2,"domain":"vast.ai","path":"/","agent":null,"read_at":"2026-10-19T23:22:54.059Z","uses":{"train":{"value":"denied","decided_by":{"signal":"Content-Signal","url":"https://vast.ai/robots.txt","evidence":"Content-Signal: search=yes, ai-train=no, ai-input=yes","line":64},"agents_considered":["GPTBot","ClaudeBot","Google-Extended","CCBot","Applebot-Extended","meta-externalagent"],"signals":[{"signal":"robots.txt","url":"https://vast.ai/robots.txt","says":"access allowed","agents_denied":[],"agents_allowed":["GPTBot","ClaudeBot","Google-Extended","CCBot","Applebot-Extended","meta-externalagent"],"evidence":"Allow: / (group for GPTBot, its own group)","line":8},{"signal":"Content-Signal","url":"https://vast.ai/robots.txt","says":"denied","evidence":"Content-Signal: search=yes, ai-train=no, ai-input=yes","line":64,"group":"*"},{"signal":"terms page","url":"https://vast.ai/terms","says":"restricted","evidence":"Without limiting the foregoing, except to determine the pricing of your own products or services as expressly permitted above, you may not use Authorized Data (or any value derived therefrom) alone or together with other data, as an input to or for the construction, calculation, publication, maintenance, or administration of any index, benchmark, pricing index, price-comparison database, or other product or service that measures, compares, tracks, summarizes or reflects pricing, availability, capacity or market conditions, or to train or improve any machine-learning or artificial-intelligence model for any such purpose, unless Company expressly agrees otherwise in a separate written agreemen"}],"conflicts":[]},"ground":{"value":"allowed","decided_by":{"signal":"Content-Signal","url":"https://vast.ai/robots.txt","evidence":"Content-Signal: search=yes, ai-train=no, ai-input=yes","line":64},"agents_considered":["OAI-SearchBot","ChatGPT-User","Claude-SearchBot","Claude-User","PerplexityBot","Perplexity-User"],"signals":[{"signal":"robots.txt","url":"https://vast.ai/robots.txt","says":"access allowed","agents_denied":[],"agents_allowed":["OAI-SearchBot","ChatGPT-User","Claude-SearchBot","Claude-User","PerplexityBot","Perplexity-User"],"evidence":"Allow: / (group for OAI-SearchBot, its own group)","line":8},{"signal":"Content-Signal","url":"https://vast.ai/robots.txt","says":"allowed","evidence":"Content-Signal: search=yes, ai-train=no, ai-input=yes","line":64,"group":"*"}],"conflicts":[]},"summarize":{"value":"allowed","decided_by":{"signal":"Content-Signal","url":"https://vast.ai/robots.txt","evidence":"Content-Signal: search=yes, ai-train=no, ai-input=yes","line":64},"agents_considered":["OAI-SearchBot","ChatGPT-User","Claude-SearchBot","Claude-User","PerplexityBot","Perplexity-User"],"signals":[{"signal":"robots.txt","url":"https://vast.ai/robots.txt","says":"access allowed","agents_denied":[],"agents_allowed":["OAI-SearchBot","ChatGPT-User","Claude-SearchBot","Claude-User","PerplexityBot","Perplexity-User"],"evidence":"Allow: / (group for OAI-SearchBot, its own group)","line":8},{"signal":"Content-Signal","url":"https://vast.ai/robots.txt","says":"allowed","evidence":"Content-Signal: search=yes, ai-train=no, ai-input=yes","line":64,"group":"*"}],"conflicts":[]},"cite":{"value":"allowed","decided_by":{"signal":"Content-Signal","url":"https://vast.ai/robots.txt","evidence":"Content-Signal: search=yes, ai-train=no, ai-input=yes","line":64},"agents_considered":["OAI-SearchBot","Claude-SearchBot","PerplexityBot","Googlebot","Bingbot"],"signals":[{"signal":"robots.txt","url":"https://vast.ai/robots.txt","says":"access allowed","agents_denied":[],"agents_allowed":["OAI-SearchBot","Claude-SearchBot","PerplexityBot","Googlebot","Bingbot"],"evidence":"Allow: / (group for OAI-SearchBot, its own group)","line":8},{"signal":"Content-Signal","url":"https://vast.ai/robots.txt","says":"allowed","evidence":"Content-Signal: search=yes, ai-train=no, ai-input=yes","line":64,"group":"*"}],"conflicts":[]},"transact":{"value":"not_declared","decided_by":{"signal":"robots.txt","url":"https://vast.ai/robots.txt","evidence":"access is open to ChatGPT-User, Claude-User, Perplexity-User on / and no signal states whether transact is allowed"},"agents_considered":["ChatGPT-User","Claude-User","Perplexity-User"],"signals":[{"signal":"robots.txt","url":"https://vast.ai/robots.txt","says":"access allowed","agents_denied":[],"agents_allowed":["ChatGPT-User","Claude-User","Perplexity-User"],"evidence":"Allow: / (group for ChatGPT-User, its own group)","line":8}],"conflicts":[]}},"terms":{"url":"https://vast.ai/terms","status":200,"ai_clauses":["Without limiting the foregoing, except to determine the pricing of your own products or services as expressly permitted above, you may not use Authorized Data (or any value derived therefrom) alone or together with other data, as an input to or for the construction, calculation, publication, maintenance, or administration of any index, benchmark, pricing index, price-comparison database, or other product or service that measures, compares, tracks, summarizes or reflects pricing, availability, capacity or market conditions, or to train or improve any machine-learning or artificial-intelligence model for any such purpose, unless Company expressly agrees otherwise in a separate written agreemen"],"automated_access_clauses":[]},"sources_read":[{"url":"https://vast.ai/robots.txt","status":200,"used":true},{"url":"https://vast.ai/","status":200},{"url":"https://vast.ai/.well-known/tdmrep.json","status":404},{"url":"https://vast.ai/ai.txt","status":404},{"url":"https://vast.ai/terms","status":200}],"page_status":200,"first_read":"2026-10-09T16:37:53.443Z","history":[],"values":{"train":"denied","ground":"allowed","summarize":"allowed","cite":"allowed","transact":"not_declared"},"read_now":false,"precedence":"unknown when robots.txt was refused or unreachable and nothing else answers; a denial in any signal denies; an explicit yes allows; a snippet limit limits; an AI clause in the terms restricts a use no machine-readable signal answers; anything else is not_declared. Access (robots.txt for each agent's own RFC 9309 group) and use (Content-Signal, ai.txt, TDM-Rep, robots meta, X-Robots-Tag) are both listed in signals[].","uses_defined":{"train":"collecting the page to train AI models (Content-Signal ai-train, TDM-Rep, ai.txt, noai)","ground":"fetching the page to ground an AI answer (Content-Signal ai-input, nosnippet)","summarize":"showing a summary or excerpt of the page in an AI answer (ai-input, nosnippet, max-snippet)","cite":"listing the page as a search or answer source (Content-Signal search, noindex)","transact":"an agent acting on the page for a user (user-initiated agents' robots.txt groups; no standard use signal exists)"},"reading":"What the site declares, read at read_at. Not legal advice and not a statement of what any crawler does.","code":{"version_id":"6929574e-df21-45a5-8a92-5b8ba41cc9aa","script_sha16":"85c9b9b6c9a512ed","state":"attested","deployed":{"at":"2026-10-18T20:02:49.319Z","commit":"2bf491f55991","run":"39161431635"},"build_log_entry":597,"score_version":32,"scoring_policy_sha256":"d3c9c95d409dae4e90b8e868ff113e631e445e33c14a0cc008dda144293821b3","decision_rules_sha256":"18dd5636e0896692ab518050cb401744edea2e6f1086dff94fead314959bdc3e","check":"https://crawlcheck.io/api/v1/builds/6929574e-df21-45a5-8a92-5b8ba41cc9aa"},"sha256":"2781c2c1386fab08382106015f03930289d015f0c4b14511d635bed8a4f077b3","signature":{"v":1,"alg":"Ed25519","kid":"1hHmE3fo1rg5Ig70wuFtJ5wBc7G-sUTgUJkxyPWFRps","over":"sha256","message":"crawlcheck-data-v1\n2781c2c1386fab08382106015f03930289d015f0c4b14511d635bed8a4f077b3","sig":"TVLpGlydTHe9L3vyTNuO2IDqeB7HrxYTo6YE_vIrSDNZvf4d1SckLdyHv9-EsiIDrrcAVk4da3LxIoAhcgLuDw","signed_at":"2026-10-20T03:52:02.333Z","key":{"kid":"1hHmE3fo1rg5Ig70wuFtJ5wBc7G-sUTgUJkxyPWFRps","jwk":{"kty":"OKP","crv":"Ed25519","x":"5TmKCOx0TTHepq7HwyXBHvGQpVCSBd2lV8cLzYVqFxQ"},"published_in":"https://crawlcheck.io/.well-known/http-message-signatures-directory"},"canonical":"sha256 over canonical JSON of every field except sha256 and signature"}}