Crawljax

Crawljax is a free and open source web crawler for automatically crawling and analyzing dynamic Ajax-based Web applications. [1]

One major point of difference between Crawljax and other traditional web crawlers is that Crawljax is an event-driven dynamic crawler, capable of exploring JavaScript-based DOM state changes. Crawljax can be used to crawl and create a static mirror of any Ajax web application.[2]

References

  1. ^ Mesbah, Ali; Van Deursen, Arie; Lenselink, Stefan (2012). "Crawling Ajax-Based Web Applications through Dynamic Analysis of User Interface State Changes". ACM Transactions on the Web. 6: 1–30. doi:10.1145/2109205.2109208. S2CID 1351916.
  2. ^ "Understand JavaScript SEO Basics | Google Search Central".

External links

  • Official website
  • v
  • t
  • e
Web crawlers
Internet bots designed for Web crawling and Web indexing
Active
  • 80legs
  • bingbot
  • Crawljax
  • Fetcher
  • Googlebot
  • Heritrix
  • HTTrack
  • PowerMapper
  • Wget
Discontinued
  • FAST Crawler
  • msnbot
  • RBSE
  • TkWWW robot
  • Twiceler
Types


Stub icon

This programming-tool-related article is a stub. You can help Wikipedia by expanding it.

  • v
  • t
  • e