Local Search Engine Crawler - Design Proposal

Lezárva Kiadva: Nov 12, 2006 Kiszállításkor fizetve
Lezárva Kiszállításkor fizetve

We are seeking a proposal to bulid a crawler on local search engines. The goal is to crawl a number of these engines (listed below) using any search terms and locations (e.g. "restaurants, new york," or "stores, san francisco"). The *required* results will be a database with listings for the inputed search terms and their search rankings. Search Engines (should be configurable to crawl one or several): * [url removed, login to view] * [url removed, login to view] * [url removed, login to view] * [url removed, login to view] These results should be organized based on businesses. For example, for "Joe's Sushi Restaurant" in New York we'll have a data record for it (along w/ the standard set of fields like address, phone number, etc.). We should be able to look up "Joe's" and find out its ranking on google, yahoo, etc. The winning proposal will very likely be invited to work on the project as well. The proposal should be a guiding "spec" for building this crawler. Tech requirements are flexible, though these are preferred: a) language: python best; Java possible. b) database: postgres best; mysql ok. c) platform: unix/linux The best proposal will also consider: a) scalability of the crawler (e.g. multithreaded design, etc.) b) difference among search engine data and how to consolidate them. c) good API for any other program to call this database easily (standard web services best). d) point out pitfalls and other things for consideration. e) timeline and resources for deliverying the crawler. f) budget that's broken down based on key pieces and tradeoffs.

## Deliverables

1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done.

2) Deliverables must be in ready-to-run condition, as follows? (depending on the nature? of the deliverables):

a)? For web sites or? other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment.

b) For all others including desktop software or software the buyer intends to distribute: A software? installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request.

3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement).

## Platform

See above

Amazon Web Services Mérnöki munka MySQL PHP Projektmenedzsment Szoftverarchitektúra Szoftvertesztelés Webhosting Weboldal menedzsment Weboldal tesztelés

Projektazonosító: #3914427

A projektről

1 ajánlat Távolról teljesíthető projekt Utoljára aktív: Dec 3, 2006

1 szabadúszó tett átlagosan $85 árajánlatot erre a munkára

ayuer

See private message.

$85 USD 14 napon belül
(0 vélemény)
0.0