Quantcast
Channel: phpBB.com
Viewing all articles
Browse latest Browse all 1596

[3.3.x] Support Forum • Re: Excessive forum load time

$
0
0
By the way, my robots.txt file looks like this:

Code:

User-agent: *Disallow: /User-agent: BingbotDisallow:User-agent: GooglebotDisallow:
Set to allow only Google and Bing bots, and blocking all the rest.
It does not help with traffic originating from Brazil though, so I guess those are "bad bots" who ignore the robots.txt file maybe?

Statistics: Posted by sopas — Fri Feb 14, 2025 1:02 am



Viewing all articles
Browse latest Browse all 1596

Trending Articles