We have a list of URLs in excel
We need a Crawler (that will crawl the whole list ) on a fixed schedule
We will set the frequency from back end
We need :
ID number to each file
ALL the files of those URL's stored in a new DB ,we will set manually what file types we will choose (file type (PDF,DOC,HTML,IMGAES,OFFICE FILES,- all the versions )
ALL links to the file
The file links on the main site.
I can complete the application you want according to your specifications. I can build the scraper for you as a full application with a handy GUI you can use, or as a DLL you can then incorporate into future solutions, including all the features you demanded. Can start immediately.
$100 USD 5 napon belül
5,0 (7 értékelés)
3,1
3,1
17 szabadúszó adott átlagosan $119 USD összegű árajánlatot erre a munkára
Dear Hiring Manager
I'm a expert in scraper. I have created many scraper projects (please see my past works) and have experiences of your problem. I guarantee to complete your job well.
Can i start?
Best Regards,
do-nhuan
Hi, I have experience to do such project. In my current company, I developed a program which will download videos from remote server and convert the video from flv to avi, after that, it will insert some datas to database.
Can implement this program no problem.
Let me know what kind of interface you would like for the crawler. Would you like a graphical interface or would you prefer a command line interface that can be run automatically from a server?
If you choose my bid can have this implemented in no time.
Jack
I have relevant c# experience in making windows forms and console applications, extracting the data from the web, and writing this information to a database.
Hi,
I've written a great deal of web scrapers and am very familiar with parsing HTML DOM model, going through all links and saving files from URLs. This would be developed as a service that runs periodically every defined number of hours, access all of the URLs specified, and save all the info to the database.