Gemini Archiving and WARC

[Sotiris Papatheodorou]

On Wednesday, September 2, 2020, Brian Evans wrote:
> I think if something like `robots.txt` were to be used for this
> purpose I would recommend doing it at the directory level (and thus
> break from how robots.txt works).

On Wednesday, September 2, 2020, Brian Evans wrote:
> To that, I would also put in a vote for
> an opt-in system rather than an opt-out system (like robots.txt).

Agreed on both points! I was thinking of implementing a personal archiving system like the one mentioned by Solderpunk in
gopher://zaibatsu.circumlunar.space:70/0/~solderpunk/phlog/the-individual-archivist-and-ghosts-of-gophers-past.txt