Web Crawler/Search Engine

We are a manufacturer looking to build an automated web crawler/spider and search engine to index our online catalog and the catalogs of our associate firms into a single database. We want to have thousands of product descriptions and graphics indexed and made keyword searchable. We have given thoughts of using the search engines that can be purchased from Google, Alta Vista’s search engine, or Thunderstone’s Webinator, but we may want to go the route of open source code such as Harvest. Please provide bids on the work. ## Deliverables 1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Installation package that will install the software (in ready-to-run condition) on the platform(s) specified in this bid request. 3) Complete ownership and distribution copyrights to all work purchased. We are a manufacturer looking to build an automated web crawler/spider and search engine to index our online catalog and the catalogs of our associate firms into a single database. We want to have thousands of product descriptions and graphics indexed and made keyword searchable. We have given thoughts of using the search engines that can be purchased from Google, Alta Vista’s search engine, or Thunderstone’s Webinator, but we may want to go the route of open source code such as Harvest. Please provide bids on the work. ## Platform Linux machine, written in any database. Currently we utilize Pearl, MySql and PHP with our web sites.