[tech] [psa] robustness (was Re: [ANN] A Gemini crawler, for statistics about the geminispace)

[ew.gemini]

Hello,

Peter Vernigorov writes:

> I don’t think details are boring here. Would you mind listing some of the
> problems and possible solutions/workarounds?

This

gemini://alexschroeder.ch/page/2020-12-22_Website_down%2C_disk_full%2C_logs_crazy
https://alexschroeder.ch/wiki/2020-12-22_Website_down%2c_disk_full%2c_logs_crazy

might have been caused by a crawler.

Cheers,
Erich


-- 
Keep it simple!