I have no idea why, in 1 week this particular user has consumed 5TB of data. And by analysis it seems to be spamming from facebook. Any idea what i should do?
I have tried disabling the meta pixel does not seem to change anything.
I ended up blocking the IP range and updating the robots.txt, and that seemed to have stopped it for now.. I saw on reddit that recently theres an uptick of meta crawler for AI. But this is the most aggressive i have seen in sometime, maybe it was broken.
Check my posts here. I had my servers freezing due to several AI crawlers, and them not respecting the robots file. I ended up blocking 10K+ bot IP’s and ranges.
On the last weeks I have been fighting against that issue on online shops. I tried robots.txt and HestiaCP firewall but I just solved it using cloudflare with the folowing firewall rule set to “managed challenge” as action
( (cf.client.bot and not http.user_agent contains “Googlebot”) or http.user_agent contains “facebookexternalhit” or http.user_agent contains “Facebot” or http.user_agent contains “meta-externalagent” or http.user_agent contains “meta-webindexer” or ( http.request.uri.query contains “filter_” or http.request.uri.query contains “query_type_” or http.request.uri.query contains “add-to-cart” or http.request.uri.query contains “add_to_cart” or http.request.uri.query contains “add-to-wishlist” or http.request.uri.query contains “remove_item” or http.request.uri.query contains “_wpnonce” ) and not cf.client.bot and not http.user_agent contains “Googlebot” )