web-spider repositories

Trending repositories tagged web-spider, ranked by trending score. Updated daily.

  1. 1
    projectdiscovery/katana

    A next-generation crawling and spidering framework.

    GitHub · Go · 17,880 stars · 1,242 forks · +4 stars in 24 hours · Trending score 1.93

  2. 2
    postmodern/spidr

    A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

    GitHub · Ruby · 835 stars · 105 forks · 0 stars in 24 hours · Trending score 0.00

  3. 3
    Hecate2/Ignareo-ISML-auto-voter

    Ignareo the Carillon, a web crawler/spider template of ultimate high concurrency built for leprechauns. Carillons as the best web spiders; Long live the golden years of leprechauns! (ISML=international saimoe; 2022 ISML is last ISML)

    GitHub · Python · 194 stars · 10 forks · 0 stars in 24 hours · Trending score 0.00