Glossary · Technical
PerplexityBot
Perplexity's web crawler, used to index content for retrieval when generating answers.
How it's different from a training crawler
Because Perplexity generates answers using live retrieval rather than relying only on pre-trained knowledge, PerplexityBot's crawling has a more immediate effect on visibility — newly indexed content can show up in answers relatively quickly.
Controlling access
Like other AI crawlers, PerplexityBot respects robots.txt directives targeting its specific user-agent, giving site owners the same allow/disallow control they have over any other bot.
See more terms in the full glossary, or read the AI Visibility 101 guide for the full picture.