[ANN] A Gemini crawler, for statistics about the geminispace

[Luke Emmet]

On 16-Dec-2020 15:05, Stephane Bortzmeyer wrote:
> I'm running a Gemini crawler, which gathers metadata about the
> geminispace. The goal is not to make a search engine but to survey the
> geminispace.
>
> You can find the current results (the crawler did not crawl the entire
> space yet):
>
> gemini://gemini.bortzmeyer.org/software/lupa/stats.gmi
(Due to user error, my reply was supposed to go to the list, but was 
sent privately, so I'm re-posting)

This is very interesting thank you.

Could it be possible to show the distribution of page sizes in 
geminispace? I know you show the average page size, but to get a better 
view of what is typical and the range would be good. For example does it 
follow a power law etc...

Is there any raw data available?

  - Luke