robots.txt for Gemini formalised

Johann Galle johann at qwertqwefsday.eu
Tue Nov 24 17:06:32 GMT 2020


Nick Thomas wrote:> I don't think that opt-in rates would be similar to current opt-out rates
> on the Web.
This can probably be summed up with one question:
Why do we want a robots.txt in the first place? After all, if there were no
reasons against archival et al., we would not need a robots.txt at all. And
IMHO this also is the reason why it should rather be an opt-in system.

-- 
You can verify the digital signature on this email with the public key available
through web key discovery.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: OpenPGP_signature
Type: application/pgp-signature
Size: 840 bytes
Desc: OpenPGP digital signature
URL: <https://lists.orbitalfox.eu/archives/gemini/attachments/20201124/944dd2b6/attachment.sig>


More information about the Gemini mailing list