• [$] Anubis sends AI scraperbots to a well-deserved fate

    From LWN.net@1337:1/100 to All on Thu Jul 10 16:45:07 2025
    [$] Anubis sends AI scraperbots to a well-deserved fate

    Date:
    Thu, 10 Jul 2025 15:39:22 +0000

    Description:
    Few, if any, web sites or web-based services have gone unscathed by
    the locust-like hordes of AI crawlers looking to consume (and then re-consume ) all of the world's content . The Anubis project is designed to
    provide a first line of defense that blocks mindless botswhile
    granting real users access to sites without too much hassle. Anubis is
    a young project, not even a year old. However, its development is
    moving quickly, and the project seems to be enjoying rapid
    adoption. The most recent release of Anubis, version
    1.20.0 , includes a feature that many users have been interested in
    since the project launched: support for challenging clients without
    requiring users to have JavaScript turned on.

    ======================================================================
    Link to news story:
    https://lwn.net/Articles/1028558/


    --- Mystic BBS v1.12 A47 (Linux/64)
    * Origin: tqwNet UK HUB @ hub.uk.erb.pw (1337:1/100)