AlexBrown84
Member
this is my following robots.txt
User-agent: PetalBot
User-agent: AspiegelBot
User-agent: AhrefsBot
User-agent: SemrushBot
User-agent: SemRush
User-agent: DotBot
User-agent: MauiBot
User-agent: MJ12bot
Disallow: /
User-agent: Amazonbot
Disallow: /threads/*/reply
User-agent: *
Disallow: /whats-new/
Disallow: /account/
Disallow: /members/
Disallow: /attachments/
Disallow: /goto/
Disallow: /help/
Disallow: /posts/
Disallow: /login/
Disallow: /search/
Disallow: /admin.php
Allow: /
Sitemap: https://geomax.me/sitemap.xml
![Screen Shot 2024-03-11 at 10.07.32 AM.webp Screen Shot 2024-03-11 at 10.07.32 AM.webp](https://xenforo.com/community/data/attachments/298/298551-77bbdf80d168e84da8a1e02b41652ff8.jpg)
User-agent: PetalBot
User-agent: AspiegelBot
User-agent: AhrefsBot
User-agent: SemrushBot
User-agent: SemRush
User-agent: DotBot
User-agent: MauiBot
User-agent: MJ12bot
Disallow: /
User-agent: Amazonbot
Disallow: /threads/*/reply
User-agent: *
Disallow: /whats-new/
Disallow: /account/
Disallow: /members/
Disallow: /attachments/
Disallow: /goto/
Disallow: /help/
Disallow: /posts/
Disallow: /login/
Disallow: /search/
Disallow: /admin.php
Allow: /
Sitemap: https://geomax.me/sitemap.xml
![Screen Shot 2024-03-11 at 10.07.32 AM.webp Screen Shot 2024-03-11 at 10.07.32 AM.webp](https://xenforo.com/community/data/attachments/298/298551-77bbdf80d168e84da8a1e02b41652ff8.jpg)