Software Listing of Author : "Vietspider"

The web crawler is a program that automatically traverses the web by downloading the pages and following the links from page to page. A general purpose of web crawler is to download any web page that can be accessed through the links.

This process is called web crawling or spidering. Many sites, in particular search engines, use spidering as a means of providing up-to-date data. Web crawlers are mainly used to create a copy of all the visited pages for later processing by a search engine that will index the downloaded pages to provide fast searches. Crawlers can also be used for automating maintenance tasks on a website, such as checking links or validating HTML code. Also, crawlers can be used to gather specific types of information from Web pages, such as harvest ing e-mail addresses (usually for spam).

A web crawler is...

  • Platform: Win95, Win98, WinME, WinXP, Windows2000, WindowsVista, Windows7; Linux
New Reviews

Internet Explorer 10

Up to the late 1990s, the web browser used by the bulk of Windows users was invariably Internet Explorer while Netscape played the second fiddle. The scene was relatively identical post 2000 but emergence of Firefox and later Google Chrome changed ...


SoftAmbulance Free Eraser

Windows comes with a set of integrated utilities to let users maintain and cleanup their computers. While you can always delete files and folders from partitions, that is not a fail proof method. The data remains on hard disk in reality and any ...


Video Magic

Editing video or converting from one format to another is no longer restricted to studio setups and editing professionals. Average PC users need to deal with huge amounts of video clips derived from various sources these days. You may need to ...


Focusky

Teachers, professors or even corporate sector professionals often need to capture attention of viewers and present an idea through visual demonstrations. Nothing works better than an immersive audio visual presentation. Of course, you need ...


CyberLink Mediashow

Nowadays, computer users need to deal with various types of audio and video files. Apart from playing back such content, you also need to convert them into specific formats sometimes. Making slideshow with digital images or burning movies with ...


CyberLink AudioDirector 4

There is no shortage of apps for editing videos for Windows users but at times it becomes necessary to edit the audio part in such clips. If you want a feature rich editor, the options are not aplenty exactly, and Adobe’s shift to subscription ...


dMaintenance

As a computer user, you may need to deal with several types of applications. For a lot of Windows users, the integrated tools of the OS may not suffice at times. They may need to use several third party apps for needs such as entertainment, ...


New Downloads

Privacy Eraser Portable

Privacy Eraser is an
all-in-one privacy suite that
protects your privacy by
cleaning up all your Internet
history tracks ...

VintaSoftImaging.NET SDK

VintaSoftImaging.NET SDK is
the impressive imaging library
for .NET, WPF and WEB.
WinForms, WPF and WebForms
controls for ...

Surf Anonymous Free

Surf Anonymous Free, the
ultimate Free online
protection software, protects
users\' online identity via IP
Hiding, which ...

Pixillion Plus Edition for
Mac

Pixillion Image Converter
Software Plus is perfect for
converting your image files
for posting on the web,
emailing to ...

InstallAware Studio Admin
Install Builder

Use automation in InstallAware
Install Builder from an API
with ASP.NET support.
InstallAware is the Fastest
Customize ...

Efficient Diary

Efficient Diary is a
completely free while still
beautiful and powerful
electronic diary software
package. The product ...

PGLobEditor

PGLobEditor: Edit PostgreSQL
LOB (BYTEA (BLOB), TEXT
(CLOB)) data. PGLobEditor is a
database tool that helps DBA
and ...

KooLoader

KooLoader is an all in one
download manager software that
guarantees a worthy Internet
downloading experience through
the ...

Leawo PowerPoint to iPad

Leawo PowerPoint to iPad is
designed for the tablet
computer, iPad. Beyond what
the name suggests, the ...

Free Task Manager Pro

Free Task Manager Pro offers
you a free tool which keep
track of your tasks you set
out to complete.