Short tutorial on How to Set Crawl Delay in Google Webmaster Tool?
In this article well discuss how you can set crawl delay for google
search bot in Google Webmasters Tool. Follow the steps below to set
crawl delay for google search engine bots for accessing your web pages.
Step 1: Log in to Google Webmaster Tools.
Step 2: Click on the website you'd like to manage.
Step 3: Click the top-right settings cog, then Site Settings
Step 4: Click on Limit Googles maximum crawl rate. Adjust the crawl rate to at least 30 seconds apart.
Step 5: Crawl delay settings are only saved for 90 days. Note down the date you'll need to set them again.