Web Spider

Automatically search web sites for emails. Simply provide a starting web site or starting keywords and let Email Grabber do the rest. Emailgrabber will crawl the web site and collect all email addresses it finds. It will also follow every link. Specify the web sites you want to visit to allow Email Grabber to stay on top of your goal or block web sites you don't want it to visit. Merge email addresses from multiple source files

System for monitoring web sites, allows monitoring the availability of sites and their content by checking whether the given content exists or does not exist on the site. Can be used autonomously or as a module for other scripts. Several methods of user notification when a site changes its status (e-mail, command execution, GET). Search by masks. Multithreaded sites check. Low system requirements: not used MySQL, Perl, PHP, cron. Written in C++.

D's FREE Text and Web Email Extractor - Usefull to extract emails from webpages and text files. As well it has an incorporated webspider.

BrownRecluse is a programmable spider. It lets you pull web pages (or files etc.) and save them to your HD (or display them) in just a few lines of simple code. It lets you scan and manipulate the data in every way possible. Unlike normal spiders, BrownRecluse does not need filters, options and plugins to accomplish a task. You program it to make it do just what you want. It uses a variety of features found in Pascal, VB, C++ and javascript.

Advanced Email Extractor (AEE) is designed to extract e-mail addresses from web-pages on the Internet and from HTML and text files on local disks. AEE has various limiters of scanning range, using which you can extract only the addresses you actually need from web-pages, instead of extracting all the addresses present there. Also you can use 330 popular search engines (including German, French, Japanese, etc) for search by keywords.

Advanced Email Extractor (AEE) is designed to extract e-mail addresses from web-pages on the Internet and from HTML and text files on local disks. AEE has various limiters of scanning range, using which you can extract only the addresses you actually need from web-pages, instead of extracting all the addresses present there. Also you can use 330+ popular search engines (including German, French, Japanese, etc.) for search by keywords.

A powerful internet browsing utility that enables you to keep track of pages you have visited and may wish to visit again. Its patented iCarousels information display system keeps the collections of pages that you create highly visible and easy to access.
includes the following utilities:
Toolbar for Internet Explorer, Annotations, Import and Export bookmarks, Web-Spider, Off-line browsing, Search within collection, Image/Slide Show Viewer.

Build a custom web spider / web crawler using web data extraction / screen scraping technology. Use the web extract for web data mining of contact lists, product catalogs, government databases, real estate listings, or build a custom email extractor.

Creating your own web grabber that can Screen Scrape the data to a database or Excel has never been easier. The website spider / crawlers can even sort and filter the webpages while spidering.

NetTools Spider is a multi-functional Internet spidering utility that supports: website downloading, offline browsing, link checking, and real-time web mining. With NetTools Spider you can download, search and data mine websites, quickly and easily.

look4me is an email extractor, internet web spider, image extractor, fax extractor and email sender built upon industrial strength scanning technologies. It can extract all emails, webpages and images from a site or list of sites. It can also find emails and webpages based on a keyword search, and retrieve emails of companies listed in a particular category of a directory. look4me is very powerful and yet extremely easy to use.

"Powerful Web-based engines" (eWEEK) for publishing & searching Web content. Over a dozen indexed & fielded data search options. Highlights hits in HTML, XML & PDF, while displaying links & images. Converts word processor, database, spreadsheet, ZIP, etc. files to HTML, with highlighted hits. Built-in Spider expands searchable database to other sites; supports dynamically-generated content. Optional API for SQL, Java, .NET.

Use SiteScan to spider entire websites, find broken links, report server errors and analyze page response times. SiteScan will test every page on your website, list the results and highlight troublesome pages. Preview pages using the built-in browser, quickly highlight links (or images) on any page or within the source code; modify and save pages ready for upload to your web server.

Free fully-functional 10-day trial download!

SiteUnseen. The easy to use website content analyzer and download manager parses HTML and JavaScript in web pages, finding, downloading and saving any user specified file type(s), jpg, mp3, mpg, etc. SiteUnseen will spider a site regardless of language following links and finding files for automatic download. Unique accelerators speed your search through Yahoo Groups photo and file archives, Google Groups messages and other popular services.

Djuggler is a light weight, flexible, and effective tool to collect data from multiple sources like Web sites, Text files, Databases, Excel, CSV, XML, etc. Djuggler scripts are easy and intuitive to create with the visual designer. Once you have created your script it can be saved as a stand-alone executable that can run on any other Windows system without Djuggler installed. The Djuggler Personal edition is free for non commercial use.