Crawlers on Gemini and best practices

Petite Abeille petite.abeille at gmail.com
Tue Dec 15 10:17:31 GMT 2020

> On Dec 11, 2020, at 21:38, colecmac at protonmail.com wrote:
> 
> I am no big fan of Google, but they are the kings of crawling and it makes sense
> to go with them here.

Interesting read:

Google?s Got A Secret
https://knuckleheads.club

TL;DR: There Should Be A Public Cache Of The Web




Archive home | About this archive