Search

 

  

Fifobot Web Architects / Designers Guidelines

Coding Standards

Fifobot will attempt to crawl every website it comes across.  However, it may fail to index any information if you do not use the correct HTML v4.01 specifications.  Please visit W3C's HTML 4.01 Specifications website for more information on correct coding standards.

This may sound obvious, but make sure you have a good description of your website in your TITLE tags!  Keep your title tag on one line of code only.

Ensure that you are using correct META tags in your HTML code.  Fifobot makes use of this information (among other tags) to gather information about your website.

Example from OmegaSoft.co.uk

<meta NAME="KEYWORDS" CONTENT="OmegaSoft; TechPreview; PathSearch; iForum; HomeSearch; LiveSearch; Downloads; news; Web site; solutions; services; software; contests; corporate">
<meta NAME="DESCRIPTION" CONTENT="Welcome to OmegaSoft, developing internet and web services for everyone.">

Fifobot is not case-sensitive.  So you do not have to worry too much about capitalisation in your keywords.  In fact, when Fifobot analyses your code, it will make it all lowercase anyway.
 

Stopping Fifobot Indexing Your Site

Fifobot respects the W3C's specification exclusion tags.  To prevent OmegaSoft Fifobot from accessing your website, you can;

Use the META exclusion tags:

<META NAME="robots" CONTENT="noindex">

Fifobot will retrieve the document, but it will not index the document.

<META NAME="robots" CONTENT="nofollow">

Fifobot will not follow any links that are present on the page to other documents, but will still index the document.

<META NAME="fifobot" CONTENT="noarchive">

<META NAME="fifobot" CONTENT="noindex">

Restrict Fifobot from performing any crawling operation the document.  Change the content to either; noindex or nofollow.

While Fifobot will initially enter your website, once it finds any of the following META-tags in the HEAD of the document the respective actions will be performed.

You can specify the NAME as either 'robots' or 'fifobot'.  Specifying 'robots' will stop all complying web-bots on the internet from performing certain actions on your website.  If you just want to specifically block Fifobot, but allow other web-bots access to your site, then specify 'fifobot' in the NAME.
 

Further Reading

Also see The World Wide Web Consortium (W3C)'s notes on helping search engines index your Web site.

If you have any further questions, please contact the Fifobot team: fifobot@omegasoft.co.uk

PathSearch Website | PathSearch Website

 


© Copyright 2005, OmegaSoft