Ahrefs

Once you've blocked AhrefsBot in robots.txt (please see <a href="https://ahrefs.com/robot" rel="nofollow noopener noreferrer" target="_blank">instructions</a>), we will stop crawling the site. Note: This is not immediate, and will take some time for AhrefsBot to read your robots.txt.

You can expect that we will begin to drop blocked pages from the index in about 2 months time.&nbsp;

Note: We will still continue to collect and show links pointing to this site from other domains, since blocking AhrefsBot in robots.txt does not prevent us from indexing backlinks from other websites.

<a href="https://help.ahrefs.com/site-explorer/crawling/how-do-i-control-your-bots-crawling-behaviour">How do I control your Bot's crawling behaviour?</a>

<a href="https://help.ahrefs.com/site-explorer/crawling/why-doesnt-ahrefs-crawl-or-index-my-website-fully">Why doesn't Ahrefs crawl or index my website fully?</a>

<a href="https://help.ahrefs.com/site-explorer/crawling/how-long-does-it-take-for-ahrefs-to-find-my-new-backlink">How long does it take for Ahrefs to find my new backlink?</a>

- <a href="https://help.ahrefs.com/site-explorer/crawling/how-do-i-control-your-bots-crawling-behaviour">How do I control your Bot's crawling behaviour?</a>
- <a href="https://help.ahrefs.com/site-explorer/crawling/why-doesnt-ahrefs-crawl-or-index-my-website-fully">Why doesn't Ahrefs crawl or index my website fully?</a>
- <a href="https://help.ahrefs.com/site-explorer/crawling/how-long-does-it-take-for-ahrefs-to-find-my-new-backlink">How long does it take for Ahrefs to find my new backlink?</a>

Find out what happens after you have blocked AhrefsBot in robots.txt

How long does it take for my site to be removed from Ahrefs?

Ahrefs Academy

Blog

YouTube

Pricing

Find answers and get help from Intercom Support and Community Experts

Empty Help Center

Uh oh. That page doesn’t exist.

Disappointed

Neutral

Smiley

Title

{assigneeName} needs more information from you

Related: