Skip to content

GLOSSARY

What is user-triggered fetcher?

DEFINITION

A user-triggered fetcher is a bot that visits a page because a person asked an assistant about it, not because it is crawling your site. Vendors say robots.txt rules may not apply to these requests.

Examples are ChatGPT-User, Claude-User and Perplexity-User. Use authentication, not robots.txt, to keep a page private.

Rated by our clients

Don't take our word for it.

Some of the businesses we have worked with

Your cookies, your call

We use only the cookies this site needs to work. If you say yes, we also turn on Google Analytics to see what works, and our live chat, which records how you use the site so we can help you faster. Nothing optional runs until you choose. See our cookie policy.