Exactly.Except that's not what those articles say. Or they are at least quick to clarify, "adherence to a robots.txt is entirely voluntary." You're not "blocking" anything.According to many of the articles found via https://www.google.com/search?q=block+ai+bots you can indeed block AI bots using robots.txt.
Which is what my point further into my post was talking about regarding photos where you try and prevent people from downloading them. At the end of the day, if someone wants to take the data from your website, they will find a way.
Statistics: Posted by danieltj — Fri Jun 07, 2024 3:58 pm