Software Downloads for "Robots Txt"

Create your robots.txt files in seconds and maintain them easilly and effortlesly with the unique utility Advanced Robots.txt Generator. Advanced Robots.txt Generator is the most complete and easy to use application that allows you to create, maintain and keep track of your Robots.txt files for all your websites. The following is a list of the features of Advanced Robots.txt Generator. * Support for ~300 Robots and Crawlers * Automatic creation of Robots.txt file * Automatic scanning of local site directories * Comparison and correction with previously saved Robots.

Advanced Robots.txt Generator is the most complete and easy to use application that allows you to manage your Robots.txt files Advanced Robots.txt Generator is the most complete and easy to use application that allows you to create, maintain and keep track of your Robots.txt files for all your websites. Here are some key features of "Advanced Robots txt generator":Advanced Robots.txt generator offers support for ~300 Robots and CrawlersAutomatic creation of Robots.txt fileAutomatic scanning of local site directoriesComparison and correction with previously saved Robots.

  • Platform: WinOther
  • Publisher: basisoft.com
  • Date: 24-08-2009
  • Size: 1576 KB

Make Search Engine Friendly Robots.txt Files Fast and Easy! Pattern matching. Visit Time. Request Rate. Crawl delay, Sitemaps, and more. Add information quickly and easily. Import exiting existing robots. txt file for editing and save it to your hard drive and more. Drag and Drop or Copy/Paste Upload with built in FTP Access. Alternatively, you can use your own favorite FTP program. Easily notify robots which of your files and directories to include and exclude from indexing. Robots.txt Maker will guide you through how to make an Attention Grabbing, Search Engine Friendly robots.

  • Platform: Windows
  • Publisher: Oven Fresh
  • Date: 7-7-2014
  • Size: 3710 KB

This program is a visual editor for Robot Exclusion Files and log analyzer software. It allows the user to quickly and easily create the robots.txt files required to instruct web search engines which parts of a web site are not to be indexed and made searchable by the general web public and then to identify spiders, which do not keep to those instructions. The program does this by providing the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable.

  • Platform: Windows
  • Publisher: Robots-txt.NET
  • Date: 04-10-2009
  • Size: 2867 KB

With Robots.txt Editor you create robot exclusion files by selecting all robots or a specific user-agent and adding documents and/or directories by entering the path names manually or by selecting them using FTP.With Log Analyzer you can get the full statistics of robots visiting the pages of your website.. Web site promotion | search engine optimization | web site statistics - NetPromoter..

  • Platform: Windows
  • Publisher: NetPromoter Lab
  • Date: 14-10-2009
  • Size: 2775 KB

Easily Make Your Robots.txt File in Minutes. Help prevent unauthorized indexing of your private directories that if indexed by themselves could frustrate a viewer's search experience and possibly alienate them. For instance, a viewer could become discouraged after clicking on a link that only shows your photos without any way to reach your Website. Just fill in a simple form and the code is generated for you.. Jupiter Web Design | Palm Beach Gardens | North Palm Beach | Palm Beach | Web Design Jupiter Florida Web Design.

This script lets you browse through your serverins directory structure. If a robots.txt is found, it is read and the appropriate allowed/disallowed folders are checked/unchecked. Just change the checkers and hit the inupdate?button to update the robots.txt. You may also delete the file or edit the comment. Changes are always made to inUser-agent: *? Additionally the script warns, if no index-files or htaccess files were found. Updated: Now PHP 4.2 security conform..

  • Platform: PHP, Scripts
  • Publisher: bodden.de
  • Date: 04-08-2011

Tools to automatically creat and validate robot.txt file and a tool to create a .htaccess file to ban bad robots. Also includes a general robots.txt tutorial..

The robots.txt file is the first thing search engine 'spiders' look for when indexing a website. The robots.txt file tells search engine spiders (robots) which files and/or directories they are NOT allowed to index. This helps to prevent incomplete site indexing as well as prevent exposing the files and directories that you don't want 'all over the world wide web'. It's fast, easy and FREE..

  • Platform: JavaScript, Scripts
  • Publisher: John Kline
  • Date: 06-03-2011

Reads and parses /robots.txt files..

  • Platform: PHP, Scripts
  • Publisher: Mustafa Ulu
  • Date: 17-01-2013
  • Size: 10 KB

"Linking The Web" is a free utility that regularly monitors all backlinks to your sites. If some of the links don't exist, contain wrong anchor, are covered by a "nofollow" flag or hidden by robots.txt then you will be immediately notified by email. Also the program can keep track of your purchased links and notify you about their expiration dates. The software is free of charge and works under all versions of Microsoft Windows..

  • Platform: Windows
  • Publisher: S5 Development
  • Date: 27-06-2008
  • Size: 780 KB

Creates and manages Robot Exclusion iles, ROBOTS.TXT or your websiteRoboGen is a program, or Windows 2000, XP, and Vista, to help you more easily manage the robots.txt iles or your websites. Instead o the time consuming manual management process, described in the tutorial, you can either edit your robot exclusion iles on your local computer or on a remote FTP site. RoboGen is a visual editor or Robot Exclusion Files. The user is allowed to quickly and easily create the ROBOTS.TXT iles that are required to instruct web search engines which parts o a your web site are not to be indexed or made searchable by the public browsing the web.

  • Platform: WinOther
  • Publisher: rietta.com
  • Date: 24-9-2009
  • Size: 1484 KB

This simple robots.txt file will help deter some of the unwanted bots that spider your site for email addresses and things of that nature that result in spam. This works for all websites and it is not just limited to phpBB. This has also been configured to allow Google AdSense bots to spider your site if you use the program..

  • Platform: PHP, Scripts
  • Publisher: funender.com
  • Date: 16-03-2011

PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more..

  • Platform: Linux, Mac, Windows
  • Publisher: phpcrawl.cuab.de
  • Date: 11-07-2012
  • Size: 327 KB

Visual SEO Studio is a desktop SEO Audit Tool, a Visual approach to make SEO tasks quick and easy. The program lets you Crawl one or more sites in parallel with its Interactive Web Spider, Spot on-site issues at a glance, Save Page Screenshot miniatures and see where the fold lays, visually edit robots.txt and XML Sitemaps files, Export to native Excel format... With in depth SEO / HTML / URL reports no other SEO product offers (e.g. Truncated page titles, titles longer than 12 words,...), Visual SEO Studio assists you through all the SEO steps to Optimize Ranking, Click-Through Rate, Bounce Rate, and Conversion Rate.

  • Platform: Windows
  • Publisher: aStonish Studio
  • Date: 08-01-2017
  • Size: 10069 KB

Visual SEO Studio is a desktop SEO Audit Tool, a Visual approach to make SEO tasks quick and easy. The program lets you Crawl one or more sites in parallel with its Interactive Web Spider, Spot on-site issues at a glance, Save Page Screenshot miniatures and see where the fold lays, visually edit robots.txt and XML Sitemaps files, Export to native Excel format... With in depth SEO / HTML / URL reports no other SEO product offers (e.g. Truncated page titles, titles longer than 12 words,...), Visual SEO Studio assists you through all the SEO steps to Optimize Ranking, Click-Through Rate, Bounce Rate, and Conversion Rate.

  • Platform: Mac OS X
  • Publisher: aStonish Studio
  • Date: 19-03-2019
  • Size: 48727 KB

Offers free search engine optimization tools and tutorials in a web based community environment. Basic membership is free and includes free meta tag tester, link checker, search engine submission, robots.txt generator, tutorials, testing wizard and more..

  • Platform: Misc Scripts
  • Publisher: sitesubmit.ca
  • Date: 02-04-2011

This script will block email harvester robots and file download tools from accessing your site. Includes detailed email notification on search engine visits. No need for SSI or converted email addresses. Includes an advanced admin to deny, allow or block robots and users..

Indexing of the title, description, keywords and full content of all HTML, ASP and TXT documents using a recursive call to all pages in a web site and sub folders excluding those folders listed in the robots.txt file. Simple search of the index for your web pages or advanced search for the provided search page. ASP or HTML code to insert into you current web pages to provide the search facility..

  • Platform: WinOther
  • Publisher: Educe Software
  • Date: 10-03-2001
  • Size: 97 KB

Page Promoter is an ultimate URL registration, search engine optimization and promotion tool for submitting Web sites to thousands search engines and directories as well as preliminary site optimization and effectiveness check. The software allows you to enhance sites` exposure on the Internet and draw maximum number of targeted traffic. It contains a large and up-to-date submission database, which is updated on a regular basis. Features include Keyword Tracking and Ranking utilities, Page analyzer, Robots.

  • Platform: Windows
  • Publisher: NetPromoter
  • Date: 07-02-2003
  • Size: 7077 KB
New Reviews


Print Inspector

Whether you are using a printer connected to your local desktop computer or a print server sometimes you need to see whats going on in your printer by having a close look at the print jobs sent by the users. Print Inspector is such type software ...


Disk Genius

Disk Genius was formerly known as Partition Guru which is an all-in-one solution for disk partition management, data recovery and disk repairing. It can recover lost files from partition, backup and restore partition table, clone partition or clone ...


Safe In Cloud

It is quite difficult to find any computer users nowadays who do not need to use the web, for any purpose. Whether it is for education or entertainment, the web is your best resource. You also need to use various online services for banking, ...


PictBear

Nowadays, a majority of PC users resort to digital image editing once in a while. It may be required for retouching image captured in smart phones or for creating an album in Facebook. For some people, tinkering with digital images is a pastime too. ...


Panda Cloud Cleaner

PC security has become a tricky and complicated subject both for home users and network supervisors, with complexity and risk factors multiplying over the years. Using a single antivirus app may not be enough anymore. That explains why many users ...


SnapCrab

Nearly every PC users need to take screenshots from time to time, whether it is for personal or professional needs. While using the basic Windows screenshot capture method is available, it is not adequate for everyone. When you want to capture ...


BitKiller

Dealing with various types of data efficiently holds the key to success in any computing task. Apart from generating new data and modifying existing files, it becomes necessary to delete existing files at times. While most users resort to using ...


SeaMonkey, Portable Edition

Using the Internet has become a necessity for a majority of people, including those who do not use a PC regularly. To browse web, stream video or download online content, people often resort to using various third party apps. For example, using ...


TuckAway Intelligent Email Organizer Pro

Using an email software allow you to do a number of things including managing your address lists, emails and even ending memos, documents and even virtual letters. You can also use it to manage your tasks easily. The email software comes in ...


WebAcappella

Web design sector has witnessed several trends and technological innovations affect website development in big ways. With time, designing websites has become easier. Nowadays, you can find web design software that nearly eliminates the need to ...


New Downloads

WinTools.net Classic

Suite of tools for increasing
operating system performance.
WinTools.net cleanly removes
software from disk drives and
...

Voxal Voice Changer Free
for Mac

Voxal is free voice changer
software for Mac designed to
enhance any game or
application that uses a
microphone. Change ...

Project Timer

Project Timer, a project timer
for the Windows taskbar
notification area. Project
Timer is a simple but powerful
windows ...

ExtraMAME

A small MS Windows compatible
game GUI wrapper for MAME, the
Multiple Arcade Machine
Emulator authored by Nicola
Salmoria ...

Easy Card Creator Express

The ideal choice for small to
medium sized organizations and
individuals looking for an
affordable photo ID card ...

Devart ODBC Driver for
SQLite

Devart ODBC Driver for SQLite
is a high-performance
connectivity solution with
enterprise-level features for
accessing ...

Sheet Lightning Pro

Sheet Lightning is a
specialised engineering 2D/3D
CAD System for creating and
unfolding sheet metal designs
for ...

Devart ODBC Driver for
MongoDB

Devart ODBC Driver for MongoDB
is a high-performance
connectivity tool with
enterprise-level features for
accessing ...

Windows 10 Manager

An all-in-one utility for
windows 10 specially, it
includes over forty utilities
to optimize, tweak, clean up
and fix ...

RationalPlan Project Viewer

RationalPlan Project Viewer is
a free project planning
software viewer, the perfect
solution for anyone (from
project ...