robots.txt for Gemini formalised
Johann Galle
johann at qwertqwefsday.eu
Tue Nov 24 17:06:32 GMT 2020
Nick Thomas wrote:> I don't think that opt-in rates would be similar to current opt-out rates
> on the Web.
This can probably be summed up with one question:
Why do we want a robots.txt in the first place? After all, if there were no
reasons against archival et al., we would not need a robots.txt at all. And
IMHO this also is the reason why it should rather be an opt-in system.
--
You can verify the digital signature on this email with the public key available
through web key discovery.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: OpenPGP_signature
Type: application/pgp-signature
Size: 840 bytes
Desc: OpenPGP digital signature
URL: <https://lists.orbitalfox.eu/archives/gemini/attachments/20201124/944dd2b6/attachment.sig>
More information about the Gemini
mailing list