Extract long list of Books ISBNs (ASINs) from amazon website

We are trying to develop a list of all books on Amazon (or other similar sites) that meet the below criteria. Our overall goal is to build (add to) a database of books that meet certain criteria regarding List Price, Sales Rank, and a few other items. If you have significant experience pulling information from Amazon and other similar sites and with using Amazon APIs for mass downloads of large amounts of ASINs, then this could be a great project for you. We want to build a relationship with someone that is highly experienced in scraping data (from multiple IP addresses, while working around capcha issues) from Amazon. Critical skills include: - Using multiple IP addresses to efficiently scrape from [login to view URL] - Advanced skills to ensure you can work around Amazon's Capcha - Possibly using Amazon APIs to get the data (though this is not essential) - Knowledge of SQL databases so that you can eventually store all of our data in a database, and send us filtered results as needed. - Knowledge of how to split Amazon results in order to find all or most search results After providing this initial set of data, the project will likely have ongoing work for maintaining and updating the list every 90 days. Please respond providing (a) examples of your existing experience in pulling data from Amazon, and using Amazon APIs. (b) a description of how you would approach pulling the ASINs requested (c) an estimate of how long you would expect for this to take and an estimate of expense for Task 1 and Task 2 and Task 3. If you already have a full database of [login to view URL]'s ASINs, that would be very helpful. We are also in doing a similar pull for many other categories, after we complete the books category. The following criteria are what we are looking for: All ASINs on [login to view URL] published after 1/1/2015 Task 1. There is an advanced search option on amazon, and it allows to search by Publication Date (See screenshot). I would want to start with a search for all books published after 1/1/2015, and then later on we can tackle getting all books published after 1/1/2004 later on. The URL for the search is at: https://www.amazon.com/Advanced-Search-Books/b/ref=sv_b_0?ie=UTF8&node=241582011 The categories that we could focus on would be the following: Arts & Photography (262,584) Business & Money (304,159) Computers & Technology (63,616) Cookbooks, Food & Wine (58,982) Education & Teaching (153,434) Engineering & Transportation(96,295) Law (87,189) Medical Books (135,409) Politics & Social Sciences(277,256) Reference (264,834) Science & Math (246,724) Test Preparation (27,935) Task 2 - Our plan is to use the ASINs you provide to pull the following data attributes via Amazon APIs and scrappping using my API account, but if you have a faster/cheaper way to do it, then that would be even better. I will use this criteria to filter down the list to books that I actually will add to my database. Again, we may pull this ourselves, but we want to know how much it would cost to have your team pull it for us. 1. List Price 2. Sales Rank 3. Count of Reviews 4. Count of New Items 5. Publication Date 6. Lowest New Price Also, note that I can send you with a long list of thousands of individual keywords that you can enter in the keyword/Title boxes to help with splitting. The Split can also be done by month, and the sort by results can also be altered to capture more books. Task 3: Pull the full list of Sales Ranks for 3 million ASINs (twice per year). This will not be needed until August, but let me know if you already have a method in place of pulling a lot of data in a short time frame (probably would require multiple IP addresses and maybe multiple API accounts). I currently do this myself using the very slow process of a single account, so it take several weeks for me to do. ----------- FYI, we will also want to look back at all books published in the past 90 days over and over again in the future.