Googlebot can’t access your site?

googlebot can not access your site

Google BotDue to crawling issues where Googlebot can’t access one of our sites that’s why I wanted to share this scope, since experiences can be the best way to learn. To know more about its definition here’s Google answers :  access denied errors. This kind of issues must be noted and give solution immediately since it can lead to a serious effect on your website if you are going to take it for granted. Using the Google webmaster tool in the crawl errors section I received a notification (see the image below).

Googlebot can't access your site

You will see also below that the site has problem based on it’s crawl stat since it has a low rate of page index this week.

Crawl Stat

What I did?

• Read the notification and look at the overall error rate for DNS queries of the site. Is it 100% or below? As you see the site has an overall error rate of 33%, so what’s next?

• Read the recommended action for your error rate. Since according to Google webmaster on their post about from crawl error alerts, the reason are the following:

 Either down or misconfiguration in DNS server
 Firewall off on your web server
 Refusing connection of your server from Gbot
 Server is either down or overloaded
 Inaccessible site’s robot.txt

Since it’s less than 100%, I tried to consider the possibilities of checking the web server if it’s down or overloaded. Where in one of the recommended action to take is to contact the hosting provider and discuss or ask about this configuration issues in order that you can also talk about the possibility of allocation of more resources for the DNS service.

• Double check the real cause or do further investigation. In my case it was an overloading issue.
What if it’s a hundred percent you’ll just need to follow the recommendations given by Google just see the above image or simply do the following:

 Checking of the DNS setting
 Check if your hosting account is verified or active

• Do possible actions immediately. Before I contact the hosting service, I started to remove or lessen those insignificant plug-ins and test if can solve the issue but if not I will immediately connect with the hosting provider.

• Check if the solution found is effective through using Fetch as Google to verify if Googlebot can now access you’re site.

Fetch as Google

Luckily with just removing those insignificant plug-ins and check again the webmaster tool to fetch as Google the website can now be accessed by Gbot. But if you if you think that that plug-ins are still useful for you all you need to do is contact your hosting provider in order that you can talk about allocation of more resources for DNS.

An important reminder if you’re familiar about this and you have received this kind of notice it’s always an effective option to contact your hosting provider since they know if it’s their fault or it’s on your own, before contacting just make sure that your site is truly down, before checking make sure that you clear the cache and cookies.

Also take note if you’re continually getting high rate of DNS error, you must immediately talk to your hosting provider. It’s good if they can fix it immediately but what if not, just simply make a decision or it’s time to think about this: “maybe it’s time to change my hosting provider“.

online strategic solution

Al Gomez

SEO Consultant, Online Marketer & Blogger, Web Developer & DLINKERS Founder.

“Chose a job you love, and you will never have to work a day in your life.”