|
|
|
|
Welcome to the Fifobot information page. Fifobot, an entirely automated computer program, has been designed to crawl the internet, looking for links, information and websites which can be indexed in the PathSearch directories. Fifobot Technical Information & Specifications
Fifobot has been designed so that it could effectively crawl the internet (without being suspended) for 24 hours a day, 7 days a week. Fifobot supports exclusion tags which can disable access to your website through our technology. Fifobot looks for four pieces of key information in-order to index your website. These include the site title, meta keywords, meta description (located between the HEAD tags), and a listing of all links (parsed to the base URL). The information extracted between the HEAD tags are for indexing purposes only, and in most cases this information will be visibly available to our users when they search. The links which are cached
are used for future indexing of other websites. Contact If you wish to contact the Fifobot development team, please email fifobot@omegasoft.co.uk.
|
