ahhhh thx very much!!!! i've been slowly working more and do plan on dumping a bunch more on it hopefully soon!!! tbh this was supposed to be my temporary site cus i just made it using the on site tutorials in a night and now like 3 months have passed... oopsies
Have just updated my robots.txt! Feel free to copypaste:
https://poesu.neocities.org/robots.txt
The file contains sources I pull bots from.
By the way, recently I discovered that Neocities now has its own line of defense against AI crawlers! Go to Settings β Manage your site β AI bots β check the box. Be sure to still have a robots.txt though!
ahhhh thx very much!!!! i've been slowly working more and do plan on dumping a bunch more on it hopefully soon!!! tbh this was supposed to be my temporary site cus i just made it using the on site tutorials in a night and now like 3 months have passed... oopsies