Fifobot FAQ

• Why has Fifobot has crawled my website, and I have not submitted it to your engine?
  Fifobot may have not been able to find any information on your website, that could be indexed.  Please see the section Web Architects / Designers Guidelines.
   

• Fifobot has crawled my website several times a week, is this normal?
  Yes, Fifobot is designed to keep crawling the net.  It will keep revisiting your website for new information that has been recently added, or just to make sure it still exists!
   

• What kind of information is Fifobot getting from my website?
  Fifobot will primarily look for the keyword and description data contained in meta tags.  It will also look for other information on your website that it would deem as a keyword (a keyword is a 'word' describing your site), such as information in strong or bold tags.
   

• I am a web designer, what can I do to ensure my website is included in PathSearch's database?
  Ensure that you are complying to the W3C HTML standards.  Ensure that you have made full use of the meta tags.  If you are not using well written HTML, Fifobot may be unable to understand your website.  W3C offers validation tools that you can run on your website, to check the validity of your code.
   

• How can I tell if and when Fifobot has indexed my website?
  If you are running any statistics programs on your server, which analyse or count visitor hits, Fifobot will display there.  Fifobot's User-Agent string is "PathSearch Fifobot 2.1 BETA (http://pathsearch.omegasoft.co.uk/fifobot)"
   

• I have manually submitted my website, yet it has not been indexed?
  It can take several days, after your manual submission, for Fifobot to get around to your site.  Fifobot has a waiting queue of several thousand websites, which it has to crawl.  Manual submissions will be placed on this queue and indexed in turn.  Moreover, if you are not using correct HTML standards, Fifobot may have already looked at your site, but struggled to find any useful information.  Please see the section Web Architects / Designers Guidelines.
   

• What happens if I move my website to another domain name?
  You have several options; You can submit the new domain name manually.  Or you can place a 'holding page' at your old domain saying something like "We have moved, click here to view our new website".  When Fifobot re-crawls your old site, it will see the new link and jump to the new site.
   

• Can I stop Fifobot from crawling my website?
  Sure, Fifobot respects the ROBOTS exclusion tags.  Please see the section Web Architects / Designers Guidelines for more information.
   

If you have any further questions, please contact the Fifobot team: fifobot@omegasoft.co.uk

PathSearch Website | PathSearch Website

© Copyright 2005, OmegaSoft