---
type: policy
description: Content-Signal directives declaring that www.spiderstrategies.com public content is open to AI training, search indexing, and agent input
---

# Content signals skill

The Spider Strategies public website declares its AI-usage permissions
via the Content-Signal convention. The same directive is emitted in two
places so crawlers that read either surface pick it up:

1. `https://www.spiderstrategies.com/robots.txt` — primary location per the emerging convention
2. `Content-Signal:` HTTP response header on every public response — in-band signaling for crawlers that read headers before bodies

## Policy

```
Content-Signal: ai-train=yes, search=yes, ai-input=yes
```

| Directive | Value | Meaning |
| --- | --- | --- |
| `ai-train` | `yes` | Public page content may be included in AI training datasets |
| `search` | `yes` | Public page content may be indexed by search engines |
| `ai-input` | `yes` | Public page content may be passed to AI systems as context or retrieval source |

## What this covers

Content served from `www.spiderstrategies.com` (the public marketing site) and the canonical content corpus at `https://www.spiderstrategies.com/agent-corpus.ndjson`.

## What this does NOT cover

The permissive `ai-train=yes` signal is intentional for public marketing
content and does **not** imply any corresponding permission for:

- Customer data or any content stored inside Spider Impact tenant
  environments
- Authenticated product surfaces
- Internal tools, private repositories, or operational data

Those surfaces are governed by separate protections, contracts, and
policies. Content-Signal on `www.spiderstrategies.com` is a declaration
scoped to this host only.

## Stability

The Content Signals specification is based on an expired IETF
Internet-Draft, so this should be treated as best-effort signaling
rather than a final or universally enforced standard. The directive
may be extended or refined as the specification matures.

## Related

- [Link headers skill](https://www.spiderstrategies.com/.well-known/agent-skills/link-headers/SKILL.md) — complementary header-level discovery
- [API catalog skill](https://www.spiderstrategies.com/.well-known/agent-skills/api-catalog/SKILL.md)

## References

- [Content Signals IETF draft (expired)](https://datatracker.ietf.org/doc/draft-ietf-httpbis-content-signals/)