Software Listing of Author : "Vietspider"

The web crawler is a program that automatically traverses the web by downloading the pages and following the links from page to page. A general purpose of web crawler is to download any web page that can be accessed through the links.

This process is called web crawling or spidering. Many sites, in particular search engines, use spidering as a means of providing up-to-date data. Web crawlers are mainly used to create a copy of all the visited pages for later processing by a search engine that will index the downloaded pages to provide fast searches. Crawlers can also be used for automating maintenance tasks on a website, such as checking links or validating HTML code. Also, crawlers can be used to gather specific types of information from Web pages, such as harvest ing e-mail addresses (usually for spam).

A web crawler is...

  • Platform: Win95, Win98, WinME, WinXP, Windows2000, WindowsVista, Windows7; Linux
New Reviews

iSkysoft Video Converter Ultimate

PC users need to perform a myriad of tasks for media content handling and management. Rather than using different applications for tasks like video conversion, burning and online video download, it is better to use a versatile application that can ...


DiskChart 2013

Nowadays, people just cannot seem to get a hard disk that is large enough to accommodate all their files and media content. With HD movies and gigabytes of music available for download and fast internet becoming cheaper, most PC users keep on ...


PhotoBulk

There are so many image editing applications available nowadays and selecting the right one can be quite tedious. However, the selection becomes easier when you know exactly what you need from such applications. If dealing with digital images and ...


Hanso Player

Using a media player application to play back music files is something nearly every PC user needs to do. There are so many applications that the abundance can leave average users somewhat puzzled. If the bundled WMP does not suit your taste but you ...


VSDC Free Video Converter

When you end up with a myriad of video clips derived from different sources on your PC hard disk, using conversion software becomes prerequisite. Such applications enable you to convert diverse video clips to a format you want. You may also opt for ...


PotPlayer

When it comes to selecting a suitable media player application, the profuse options can leave most PC users baffled. While the bundled WMP has become far more polished than its predecessors in latest releases of Windows, a section of users prefer ...


Portable XYplorer

Windows comes with its own file manager, namely windows Explorer and a majority of PC uses stick to this. However, advanced users can have access to third party alternatives, some of which are not free. One such example is Portable XYplorer. It is a ...


New Downloads

Express Uninstaller

Express Uninstaller is the
fast and easy way to
completely remove unwanted or
unresponsive software along
with all ...

Easy Disc Burner

Soft4Boost Easy Disc Burner a
wizard-styled utility, which
allows you to burn video files
from your personal computer to
...

WinX DVD Ripper for Mac

WinX DVD Ripper for Mac is an
all-in-one Mac DVD ripper
which can rip DVD to iPhone/6/
6 Plus, iPad Air 2/mini 3,
iPod ...

Torrent Monster

Torrent Monster has easily
entered the top of the most
stylish, solid and least
cluttered p2p clients around
as a ...

PhotoBulk

PhotoBulk is easy-to-use bulk
image editor that lets you add
text/image watermark, resize,
optimize, rename and convert
...

WinTools.net Classic

Suite of tools for increasing
operating system performance.
WinTools.net cleanly removes
software from disk drives and
...

PCTuneUp Free Folder
Monitor

PCTuneUp Free Folder Monitor
lets you easily monitor the
file access activities on your
system. It has the ability to
...

Aiseesoft Mac FoneLab

Aiseesoft Mac FoneLab can
recover lost and deleted data
on Mac from iPhone 6/6
Plus/5s/5c, iPad mini 2, iPad
Air and iPod ...

VISCOM Movie Thumbnail
ActiveX SDK

Supports PDF, GIF, ICO, JPEG,
J2K, JP2, JPC, J2C, PCX, PNG,
PSD, TIF, WMF, WBMP, TGA, PGX,
RAS, PNM.Allow user to define
...

FileGee Backup & Sync
Personal Edition

As an excellent file backup
and file synchronization
software, FileGee features
high efficiency, stability and
less ...