The .htaccess guide above will solve your issues and if you really want to stop the bots just go into your Cloudflare or .htaccess and temporary block Facebook'sI look after a website that is getting a lot of bots, everytime i visit the site it has over 200 bots online at any one time.
The site is allocated 100GB of Bandwidth each month and every month it is used up (sometimes making the site go down)
The site has been going for over 10 years and used to be very busy but now only gets a handful of members on each day (less than 10) so i know it's not that.
The site is run through Cloudflare (free version) but with only basic settings as i am not sure how to set things up on it.
It used to be a lot of chinese bots but lately it is more of these:
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
Lots of random IP's so hard to ban.
Any suggestions on how i can reduce the bandwidth usage?
facebookexternalhit/1.1 bot.Is it only the Facebook bot that's eating up your bandwidth? The ones that smash our site are Ahrefs and Semrush which take up almost the same as Google bot at times.
Statistics: Posted by Forex Station — Tue Jul 09, 2024 10:01 am