Ryabitsev: Creepy crawlies
Date:
Sat, 29 Aug 2026 09:32:34 +0000
Description:
Konstantin Ryabitsev has written a blog post with
hard numbers about the impact of AI crawlers on the Linux kernel
repositories at git.kernel.org : Today, git.kernel.org receives about 6M
daily requests demanding to see
random commits. Of these, 66% are still immediately batted away with the Anubis
challenge, but 33% are now solving the math and getting through to the main site
because apparently what we have to offer is worth spending a ton of cycles to calculate the Anubis challenge. It's impossible to tell with certainty which of these are bots and which are
real humans but chances are, if it's asking for an old commit in a random old fork, it's probably not a real developer trying to do their work. With a
bunch of generous assumptions, legitimate requests are only about 2%
of git.kernel.org traffic everything else are scrapers.
======================================================================
Link to news story:
https://lwn.net/Articles/1091203/
--- Mystic BBS v1.12 A49 (Linux/64)
* Origin: tqwNet UK HUB @ hub.uk.erb.pw (1337:1/100)