Software Listing: Robots Txt

Create your robots.txt files in seconds and maintain them easilly and effortlesly with the unique utility Advanced Robots.txt Generator. Advanced Robots.txt Generator is the most complete and easy to use application that allows you to create, maintain and keep track of your Robots.txt files for all your websites. The following is a list of the features of Advanced Robots.txt Generator. * Support for ~300 Robots and Crawlers * Automatic creation of Robots.txt file * Automatic scanning of local site directories * Comparison and correction with previously saved Robots.txt projects * Unlimited number of projects and websites * Automatic uploading to the web server * WYSIWYG selection of Robots and file/directory exclusions * Unlimited combinations for the Robot controls * Online and offline...

  • Platform: Win2000, Windows Server, WinOther

Advanced Robots.txt Generator is the most complete and easy to use application that allows you to manage your Robots.txt files Advanced Robots.txt Generator is the most complete and easy to use application that allows you to create, maintain and keep track of your Robots.txt files for all your websites. Here are some key features of "Advanced Robots txt generator":Advanced Robots.txt generator offers support for ~300 Robots and CrawlersAutomatic creation of Robots.txt fileAutomatic scanning of local site directoriesComparison and correction with previously saved Robots.txt projectsUnlimited number of projects and websitesAutomatic uploading to the web serverWYSIWYG selection of Robots and file/directory exclusionsUnlimited combinations for the Robot controlsOnline and offline documentationManual in PDF formatUnlimited and...

  • Platform: WinOther

Make Search Engine Friendly Robots.txt Files Fast and Easy! Pattern matching. Visit Time. Request Rate. Crawl delay, Sitemaps, and more. Add information quickly and easily. Import exiting existing robots. txt file for editing and save it to your hard drive and more. Drag and Drop or Copy/Paste Upload with built in FTP Access. Alternatively, you can use your own favorite FTP program. Easily notify robots which of your files and directories to include and exclude from indexing. Robots.txt Maker will guide you through how to make an Attention Grabbing, Search Engine Friendly robots.txt file in no time at all !.

  • Publisher: Oven Fresh
  • Date: 7-7-2014
  • Size: 3710 KB
  • Platform: Windows 7, Windows 8, WinOther, WinVista

This program is a visual editor for Robot Exclusion Files and log analyzer software. It allows the user to quickly and easily create the robots.txt files required to instruct web search engines which parts of a web site are not to be indexed and made searchable by the general web public and then to identify spiders, which do not keep to those instructions. The program does this by providing the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable.. Web site promotion | search engine optimization | web site statistics - NetPromoter.

  • Platform: Win2000, WinOther

With Robots.txt Editor you create robot exclusion files by selecting all robots or a specific user-agent and adding documents and/or directories by entering the path names manually or by selecting them using FTP.With Log Analyzer you can get the full statistics of robots visiting the pages of your website.. Web site promotion | search engine optimization | web site statistics - NetPromoter..

  • Platform: Win2000, WinOther

Easily Make Your Robots.txt File in Minutes. Help prevent unauthorized indexing of your private directories that if indexed by themselves could frustrate a viewer's search experience and possibly alienate them. For instance, a viewer could become discouraged after clicking on a link that only shows your photos without any way to reach your Website. Just fill in a simple form and the code is generated for you.. Jupiter Web Design | Palm Beach Gardens | North Palm Beach | Palm Beach | Web Design Jupiter Florida Web Design. Professional web site design, web gadgets, and web tools for webmasters and web site owners.

  • Platform: Win2000, WinOther

This script lets you browse through your serverins directory structure. If a robots.txt is found, it is read and the appropriate allowed/disallowed folders are checked/unchecked. Just change the checkers and hit the inupdate?button to update the robots.txt. You may also delete the file or edit the comment. Changes are always made to inUser-agent: *? Additionally the script warns, if no index-files or htaccess files were found. Updated: Now PHP 4.2 security conform..

  • Platform: PHP, Scripts

Tools to automatically creat and validate robot.txt file and a tool to create a .htaccess file to ban bad robots. Also includes a general robots.txt tutorial..

  • Platform: Misc Scripts

The robots.txt file is the first thing search engine 'spiders' look for when indexing a website. The robots.txt file tells search engine spiders (robots) which files and/or directories they are NOT allowed to index. This helps to prevent incomplete site indexing as well as prevent exposing the files and directories that you don't want 'all over the world wide web'. It's fast, easy and FREE..

  • Platform: JavaScript, Scripts

Reads and parses /robots.txt files..

  • Platform: PHP, Scripts

"Linking The Web" is a free utility that regularly monitors all backlinks to your sites. If some of the links don't exist, contain wrong anchor, are covered by a "nofollow" flag or hidden by robots.txt then you will be immediately notified by email. Also the program can keep track of your purchased links and notify you about their expiration dates. The software is free of charge and works under all versions of Microsoft Windows..

  • Platform: Win2000, Windows Server, Windows Vista, WinOther

Creates and manages Robot Exclusion iles, ROBOTS.TXT or your websiteRoboGen is a program, or Windows 2000, XP, and Vista, to help you more easily manage the robots.txt iles or your websites. Instead o the time consuming manual management process, described in the tutorial, you can either edit your robot exclusion iles on your local computer or on a remote FTP site. RoboGen is a visual editor or Robot Exclusion Files. The user is allowed to quickly and easily create the ROBOTS.TXT iles that are required to instruct web search engines which parts o a your web site are not to be indexed or made searchable by the public browsing the web.

  • Publisher: rietta.com
  • Date: 24-9-2009
  • Size: 1484 KB
  • Platform: WinOther

This simple robots.txt file will help deter some of the unwanted bots that spider your site for email addresses and things of that nature that result in spam. This works for all websites and it is not just limited to phpBB. This has also been configured to allow Google AdSense bots to spider your site if you use the program..

  • Platform: PHP, Scripts
  • PHPCrawl
  • License: Freeware
  • Price: 0.00
  • Rating

PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more..

  • Platform: Linux, Mac OS X, WinOther

Visual SEO Studio is a desktop SEO Audit Tool, a Visual approach to make SEO tasks quick and easy. The program lets you Crawl one or more sites in parallel with its Interactive Web Spider, Spot on-site issues at a glance, Save Page Screenshot miniatures and see where the fold lays, visually edit robots.txt and XML Sitemaps files, Export to native Excel format... With in depth SEO / HTML / URL reports no other SEO product offers (e.g. Truncated page titles, titles longer than 12 words,...), Visual SEO Studio assists you through all the SEO steps to Optimize Ranking, Click-Through Rate, Bounce Rate, and Conversion Rate.

  • Platform: Win10, Win10 x32, Win10 x64, Win8, Win8 x32, Win8 x64, Win7 x32, Win7 x64, WinServer, WinVista, WinVista x64, WinXP

Offers free search engine optimization tools and tutorials in a web based community environment. Basic membership is free and includes free meta tag tester, link checker, search engine submission, robots.txt generator, tutorials, testing wizard and more..

  • Platform: Misc Scripts

This script will block email harvester robots and file download tools from accessing your site. Includes detailed email notification on search engine visits. No need for SSI or converted email addresses. Includes an advanced admin to deny, allow or block robots and users..

  • Platform: CGI and Perl, Scripts

Indexing of the title, description, keywords and full content of all HTML, ASP and TXT documents using a recursive call to all pages in a web site and sub folders excluding those folders listed in the robots.txt file. Simple search of the index for your web pages or advanced search for the provided search page. ASP or HTML code to insert into you current web pages to provide the search facility..

  • Platform: WinOther

Page Promoter is an ultimate URL registration, search engine optimization and promotion tool for submitting Web sites to thousands search engines and directories as well as preliminary site optimization and effectiveness check. The software allows you to enhance sites` exposure on the Internet and draw maximum number of targeted traffic. It contains a large and up-to-date submission database, which is updated on a regular basis. Features include Keyword Tracking and Ranking utilities, Page analyzer, Robots.txt and Meta tag Editors, Link Popularity and Popularity Analyzer modules, Emailed Reports and more.

  • Publisher: NetPromoter
  • Date: 07-02-2003
  • Size: 7077 KB
  • Platform: Win2000, Windows Server, WinOther

NetPromoter is an ultimate Search Engine Optimization, Web site promotion and site statistics software package, which copes with an entire spectrum of tasks, necessary to improve your search engine visibility, boost your site traffic and on-line sales. NetPromoter software package includes the following 8 programs. Page Promoter - An ultimate URL registration, Search Engine Optimization and promotion tool, that helps to increase your exposure on the Internet and draw more targeted traffic to your Web site. Site Statistics - a professional Web analytics solution, which comprises both - a counter and a log analyzer features and provides a set of additional tools for Web site optimization.

  • Publisher: NetPromoter
  • Date: 07-02-2003
  • Size: 38988 KB
  • Platform: Win2000, Windows Server, WinOther

Page: 1 | 2 | 3 | 4 | 5 | Freeware

New Reviews


IE Internet Security

IE Internet Security isn't the program that I thought it’d be. After a bit of Googling, I discovered that IE Internet Security is in fact embedded into one larger application called 1st Security Agent, which is an all in one tweaking ...


Smart Defrag 2

From right back in the early days of Windows, there has always been a disk defragmenter included as standard, called (funnily enough) Disk Defragmenter. Its changed a lot as times have moved on and Microsoft upgraded Windows. There are many ...


Joomla

Nowadays, most people use Joomla, Wordpress or Drupal to make their websites. Creating websites by the use of CMSs is an easy yet effective way as one does not require to code heavily. We’ll be talking about Joomla, a powerful Content ...


Advanced System Optimizer

Keeping your Computer fast, clean and error free is of utmost importance if you want to get most out of it. Over the passage of time, many personal computers get clogged with errors, unnecessary or duplicate files and shortcuts leading to fragmented ...


Arctic Quest Game

Arctic  quest game (referred to in game as simply arctic quest) is a free ware downloadable game by free ride games, a game development website with a variety of games also downloadable from this site. Arctic quest is a very interesting puzzle ...


Chicken Invaders

Chicken invaders is a free ware arcade shooter game that hasheavy influence from classic titles like space invaders, or arcanoid. What chicken invaders does to the concept, however is add its own level of humour and gameplay to the mix. For ...


WinXP Manager

WinXP Manager is the tool letting you easily change and personalize your Windows XP based system. Its the edition of the tool released by Yamicsoft for Windows XP only, and is similar to Vista Manager and Windows 7 Manager, designed for later ...


Bank Robber

Bank robber (the bank robber) is essentially a trial game or a demo for the full version of the bank robber, which costs $4.99, and is a third person stealth and strategy game. In the bank robber you play as a criminal having recently being released ...


Natural Voice Text to Speech Reader

NaturalReader is a piece of software which reads aloud written text on screen is a more natural sounding voice than most computerized voices. Free NaturalReader is a free version, where you can type or copy and paste text into the window, to be read ...



New Downloads

SoftPerfect Connection
Emulator

A utility for developers that
imitates network connections
with low bandwidth limits,
latency and losses. With this
...

Alvas.Audio

Alvas.Audio for .Net is an
audio library written in C#.
The collection allows C# and
VB.Net developers to create
...

ODBC Driver for xBase

Devart ODBC Driver for xBase
provides high-performance and
feature-rich connectivity
solution for ODBC-based
applications ...

Eassos Recovery Free

Eassos Recovery Free is
user-friendly and free data
recovery software. It supports
partition recovery and file
recovery ...

Easy Time Control
Enterprise

Easy Time Control Enterprise
Edition is the solution that
offers unparalleled
performance with the
flexibility and ...

Tipard PDF Converter
Platinum

Tipard PDF Converter Platinum,
as a professional PDF
Converter which can help you
convert PDF files to Word,
ePub, TXT, ...

SuperHexEdit

SuperHexEdit is a professional
hex and structure editor for
editing binary files. Being a
flexible and fast hex editor,
...

Tipard Screen Capture Pro

Tipard Screen Capture Pro is
the best all-in-one video tool
for you to record on-screen
activities, convert video, ...

T-shirt Design Software

Brush Your ideas, T-shirt
design tool is very powerful
HTML5 T shirt designer
extension integrated with
Magento eCommerce ...



Related Searches

Robots Txt File Creator
Robots Txt File Maker
Mdi Txt Convert
Pdf Txt Convert
Txt Convert
Txt Hlp Convert
Txt In Convert
Txt Ppt Convert
Txt Shp Convert
Txt To Convert
Xml Txt Convert
Txt Files Cool