[ANN] A Gemini crawler, for statistics about the geminispace
Sean Conner
sean at conman.org
Wed Dec 16 23:16:53 GMT 2020
It was thus said that the Great Stephane Bortzmeyer once stated:
> I'm running a Gemini crawler, which gathers metadata about the
> geminispace. The goal is not to make a search engine but to survey the
> geminispace.
>
> You can find the current results (the crawler did not crawl the entire
> space yet):
>
> gemini://gemini.bortzmeyer.org/software/lupa/stats.gmi
>
> The reference site:
>
> gemini://gemini.bortzmeyer.org/software/lupa/
>
> The source code, with an issue tracker (bug reports and improvment
> requests are very welcome):
>
> https://framagit.org/bortzmeyer/lupa
Very cool! Thanks for the work.
One stat I haven't seen yet (yours or from GUS) is a breakdown of
langauge. How many pages had a lang parameter, then a breakdown by
language, how many multiple languages per parameters (for example,
"lang=en,fr").
-spc
More information about the Gemini
mailing list