@smallwheels AI bots will always be one step ahead of you no matter what you do, so you can only resign yourself.
You can set up blocks on Cloudflare to slightly limit the consumption of your server resources, but you can never prevent AI bots from scanning your site, so the only thing you can...