falsfiction
1 year ago
Public Service Announcement: You can read any site's robots.txt if it has one. Simply add "robots.txt" to the end of the main site URL. Mine was compiled in part by checking the sites I frequent and shows something of my frustration with the current mess of the internet.
