Most Googlebots are fake
Summary
The article argues that most traffic labeled as Googlebot is generated by impersonating bots rather than the real Googlebot. It explains that user-agent headers can be faked and provides verification methods such as checking host commands and Google's IP ranges. It also references RFC 3514 and Web Bot Auth HTTP Signatures as potential approaches to improve trust in user-agent identification.