~sircmpwn/gmni-devel

1

kineto: robots.txt

Martin Bays
Details
Message ID
<20210824202554.ot6ikilvl4hdndfw@localhost>
DKIM signature
missing
Download raw message
There are many open kineto proxies, and google is indexing geminispace 
via them. Probably other indexers are too. I'm not sure if that should 
be considered a problem in itself, but what is a problem is that it 
bypasses gemini sites' robots.txt file, since of course the web indexer 
doesn't know to request those files via the proxy.

So I suggest that kineto should by default serve a robots.txt file which 
disallows everything.
Details
Message ID
<CDSDS7T50I8J.3QM5EG7X6KEFV@taiga>
In-Reply-To
<20210824202554.ot6ikilvl4hdndfw@localhost> (view parent)
DKIM signature
fail
Download raw message
DKIM signature: fail
This was recently discussed. The answer was "yes, send a patch".
Reply to thread Export thread (mbox)