[ANN] A Gemini crawler, for statistics about the geminispace

Sean Conner sean at conman.org
Wed Dec 16 23:16:53 GMT 2020


It was thus said that the Great Stephane Bortzmeyer once stated:
> I'm running a Gemini crawler, which gathers metadata about the
> geminispace. The goal is not to make a search engine but to survey the
> geminispace.
> 
> You can find the current results (the crawler did not crawl the entire
> space yet):
> 
> gemini://gemini.bortzmeyer.org/software/lupa/stats.gmi
> 
> The reference site:
> 
> gemini://gemini.bortzmeyer.org/software/lupa/
> 
> The source code, with an issue tracker (bug reports and improvment
> requests are very welcome):
> 
> https://framagit.org/bortzmeyer/lupa

  Very cool!  Thanks for the work.

  One stat I haven't seen yet (yours or from GUS) is a breakdown of
langauge.  How many pages had a lang parameter, then a breakdown by
language, how many multiple languages per parameters (for example,
"lang=en,fr").

  -spc



More information about the Gemini mailing list