By the way, my robots.txt file looks like this:
Set to allow only Google and Bing bots, and blocking all the rest.
It does not help with traffic originating from Brazil though, so I guess those are "bad bots" who ignore the robots.txt file maybe?
Code:
User-agent: *Disallow: /User-agent: BingbotDisallow:User-agent: GooglebotDisallow:It does not help with traffic originating from Brazil though, so I guess those are "bad bots" who ignore the robots.txt file maybe?
Statistics: Posted by sopas — Fri Feb 14, 2025 1:02 am