GSiteCrawler is a windows-based spidering program which eases the task of creating Google or Bing sitemap files. The usage is quite easy once you get the hang of the user interface and it gets to work pretty fast following links from a starting point you specify in the program. The crawler/generator also comes with some sample project files which will give you an idea of where to get started. It currently supports Google Webmaster sitemaps and Bing Sitemaps.
Features of GSiteCrawler
- GSiteCrawler acts as a normal website crawl - emulating a Googlebot, looking for all links and pages within your website.
- Import of an existing Google Sitemap file.
- Import of any text file with URLs in it.
- Import of a server log file.
Compatibility and License
GSiteCrawler is provided under a freeware license on Windows from miscellaneous software with no restrictions on usage. Download and installation of this PC software is free and 1.23 is the latest version last time we checked.
Filed under:
