menu Home chevron_right
seo

Google Looking For Examples Of Refresh Crawl Surges Caused By GoogleBot

eddygates1 | August 17, 2021


Gary Illyes from Google posted on Reddit that he is looking for examples of where GoogleBot might not be behaving. Specifically he wants examples of “cases where refresh crawls are going nuts.” I assume this means where Googlebot is recrawling pages in a very aggressive manner.

There is a complaint on Reddit about Googlebot pinging an old article URL over and over again way too much. Now, it is very likely someone pretending to be Googlebot, but there is a chance it is an issue with Google. The complaint was:

I’m looking into the logs events from a news site, and i got an spike in one specific day in an article published on 2020.

Anyone have an idea on why would Googlebot access so many time in one particular article?

Gary Illyes from Google replied: “Wanna dm me the URL if you could confirm it’s indeed Googlebot? I’m looking for cases where refresh crawls are going nuts and would appreciate this example.”

He also shared how to verify Googlebot to ensure it is really Google accessing those pages.

So I guess if you have examples, share them with Gary on Reddit.

Forum discussion at Reddit.

Update: Later today, Google posted this on Twitter:



Written by eddygates1

Comments

This post currently has no comments.

Leave a Reply





MAde in Grenada and Design to Blaze we are Rebel Nation

Newsletter

  • cover play_circle_filled

    01. Tipsy Bar & Gril

  • cover play_circle_filled

    02. Digicel

  • cover play_circle_filled

    01. Communical Credit Union

  • cover play_circle_filled

    01. Digicel

  • cover play_circle_filled

    02.

  • cover play_circle_filled

    Live Podcast 010
    Kenny Bass

  • cover play_circle_filled

    Live Podcast 009
    Paula Richards

  • cover play_circle_filled

    Live Podcast 008
    R. Galvanize

  • cover play_circle_filled

    Live Podcast 007
    Kenny Bass

  • cover play_circle_filled

    Live Podcast 006
    J PierceR

  • cover play_circle_filled

    Live Podcast 005
    Gale Soldier

  • cover play_circle_filled

    Live Podcast 004
    Kelsey Love

  • cover play_circle_filled

    Live Podcast 003
    Rodney Waters

  • cover play_circle_filled

    Live Podcast 002
    Morris Play

  • cover play_circle_filled

    Live Podcast 001
    Baron Fury

play_arrow skip_previous skip_next volume_down
playlist_play