You.com crawlers
You.com operates 1 crawler that may reach your site. It does a specific job, so a generic blanket rule for it is often the wrong call.
| User-agent | Type | What it does |
|---|---|---|
YouBot | Search | Builds the index an assistant searches when it answers. |
What blocking each one costs
- Search
- Blocking removes you from answers happening right now.
robots.txt
To let every You.com crawler through:
User-agent: YouBot
Allow: /To block all of them:
User-agent: YouBot
Disallow: /robots.txt is honoured voluntarily. It is the right way to state your intent, and it is not an access control — treat anything you genuinely need kept out as needing authentication.
Sources
Is You.com allowed on your site?
We'll read your robots.txt and tell you which AI crawlers it lets through. No signup.