Site Audit and Yep.com now support IndexNow. You can follow this guide to set up IndexNow for your website, and submit URLs via Site Audit to search engines that support IndexNow so they can pick up the changes faster.
💡 Learn more about how IndexNow works
For Site Explorer and Content Explorer, It is not possible to manually submit any links/URLs or XML sitemap or ping our service for an on-demand crawl.
Crawl priority of websites by AhrefsBot
In general, the more “popular” a site is (ie. a higher Domain Rating (DR), more quality backlinks), the more likely a domain will be crawled. Domains that are less “popular” (ie. lower DR, less quality backlinks) will be partially crawled.
The speed of crawling and updating specific pages depends on their URL Rating (UR). Pages with higher UR have a higher chance of getting indexed and updated more often, as compared to pages with a low rating.