Find Jobs
Hire Freelancers

web crawler, C#

$100-1000 USD

Lezárt
Kiadva ekkor: körülbelül 5 évvel ezelőtt

$100-1000 USD

Teljesítéskor fizetve
Hi, I need a crawler (written in C#) for a specific real estate website. It should be a console application which can crawl data (every 12 hours) and store it in MS SQL database (image files can be stored locally in a folder). It should check all available listings (~100 000 listings). To get listings you need to apply filters - offer type (buy or rent) - offer category (house, apartment, business, parking space, land/plot, apartment building - postal code (list with postal codes will be provided) Spec: 1. Data to store (if available) for a single offer: - whole html - offer type (buy or rent) - offer category (house, apartment, business, parking space, land/plot, apartment building) - title - price - construction year - rooms - living area - city - street - postal code - property type - floor - Floors in the house - cubic area - plot area - offer Id (Immocode) - Floors in the house - Availability - Renovated in - Condition - Features - Description - pictures (store image urls and images in the db or locally) - Advertiser details: Name, address, phone number 2. The crawler should not make any damage on the website (prevent from DoS) 3. The crawler should not be detectable 4. The crawler should crawl the website every 12 hours without being blocked. 5. All data should be updated in case of any changes. 6. Price change for listings should be stored separately to have visibility if it grows or drops. 7. The crawler should send alerts (email or slack notification) if it's blocked. Long-term cooperation possible.
Projektazonosító: 18542040

A projektről

37 ajánlat
Távolról teljesíthető projekt
Aktiválva: 5 évvel ezelőtt

Szeretne pénzt keresni?

A Freelancer oldalán történő árajánlatadás előnyei

Határozzon meg költségvetést és időkeretet
Kapja meg fizetését a munkáért
Vázolja ajánlatát
Ingyen regisztrálhat és adhat árajánlatot munkákra
37 szabadúszó adott átlagosan $793 USD összegű árajánlatot erre a munkára
Felhasználó avatár
Hi. I should test site and define, if it blocks crawlers. Can you send site url? Then I can prepare for 1-2 days sample script to be sure, that this site can be daily scraped. Thanks anyway.
$800 USD 15 napon belül
5,0 (50 értékelés)
8,7
8,7
Felhasználó avatár
Dear Employer, Please message me for your job. I have scraped more than a dozen Real Estate sites and I can share samples of those as well. I understand your job quite well and will adhere to eaxh and point. Do try me once!! :) Thanks and Regards, Ash
$1 000 USD 15 napon belül
5,0 (252 értékelés)
8,2
8,2
Felhasználó avatár
Hi, my name is Selim. I read your `web crawler, C#` project descriptions carefully before bidding. I checked your requirements as well... I got what you need and ready to go ahead as soon as we can clarify further project details. I am 5-star web scraping & automation expert here at freelancer.com. Pls check my profile and feedbacks first to have some idea about the quality of my previous businesses. I had many similar web scraping tasks, including extraction of large product databases from various ecommerce websites, all achieved with 5/5 rating. Kindly get back to me if you wish to proceed with a top-rated and reliable partner here...pls note that I only deliver best quality at a reasonable price, and I am open for longterm partnerships, if you wish too... I bid my best for you to start business, and I am ready to prepare a sample task for you to check & validate, once you give me a reply...regards.
$900 USD 10 napon belül
5,0 (307 értékelés)
8,4
8,4
Felhasználó avatár
Hi there, I have checked the details I have rich experienced with .NET, C# Programming, Web Scraping. Please initiate chat so we can discuss this job.
$1 000 USD 10 napon belül
4,8 (57 értékelés)
8,3
8,3
Felhasználó avatár
Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the agreed deadline. Check out my profile, portfolio and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan
$611 USD 5 napon belül
4,9 (172 értékelés)
8,0
8,0
Felhasználó avatár
Hi I did all my projects in C# and using mult-threading and proxies to enhance the performance. Thanks
$400 USD 3 napon belül
5,0 (166 értékelés)
7,9
7,9
Felhasználó avatár
Hello! I can create the crowler using c#. the task is pretty much clear. Is 4-5 days delivery time ok for you? Can you send me the website? You will not be dissapointed, I have a big 33%rehire rate. thank you!
$777 USD 5 napon belül
5,0 (317 értékelés)
7,9
7,9
Felhasználó avatár
Hi there, I am interested in the project. Can you please provide the link to the web site from where,data to be crawled? Thank you.
$611 USD 10 napon belül
4,9 (103 értékelés)
7,0
7,0
Felhasználó avatár
what is the real estate site? a proxy subscription will be required to rotate IPs to prevent it being blocked.
$250 USD 7 napon belül
4,9 (77 értékelés)
6,8
6,8
Felhasználó avatár
Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep
$900 USD 10 napon belül
4,9 (80 értékelés)
6,9
6,9
Felhasználó avatár
Hi, I have my own script for scrapping. I can modify the existing script to suit your need and give you the require data in excel sheet. My expertise are in the area of scrapping using C#, My SQL, PHP. Looking forward to hear from you.
$611 USD 10 napon belül
5,0 (41 értékelés)
6,4
6,4
Felhasználó avatár
Hello, Hope you are doing well! We at Flojics are most preferred agency for our client due to 100% recommendation and “5 STAR” rating from our clients which we achieve through an excellent client support as well as timely & qualitative delivery 24 X 7 almost during our tenure of 10 years of business. We are in all 15+ professionals working under a single roof to deliver an excellent experience to our clientele. We have great skills which is required in your peoject .NET, C# Programming, Web Scraping. I am enlightened to inform you that we have worked with many enterprises which are in to Real Estate, FMCG, Manufacturing, Education, Utilities, Transportation, Accounting, Appointment scheduling and many more which included their Mobile Applications too. We wish to have long term business relationship with our clients. Feel free to contact us for any query you may have. We are happy to assist you all time. Awaiting your reply to deliver you an excellent experience. Thanks, Mmadi Hi, I need a crawler (written in C#) for a specific real estate website. It should be a console application which can crawl data (every 12 hours) and store it in MS SQL database (image files can be stored locally in a folder). It should check all available listings (~100 000 listings). To get listings you need to apply filters - offer type (buy or rent) - offer category (house, apartment, business, parking space,
$500 USD 12 napon belül
5,0 (10 értékelés)
6,1
6,1
Felhasználó avatár
Hi There, We can create a console app for scrapping. I can show you a sample of a scrapping tool I implemented. If you want not being detected the we can hop IP address for every request. Does the website you want to scrape has captcha implemented? Let me know when we can connect over chat to discuss more on project. Regards, Shobhit Pundir
$300 USD 5 napon belül
4,9 (44 értékelés)
6,0
6,0
Felhasználó avatár
Greetings, My name is Constantine and I specialize in C# and web scraping and data processing applications. Would be happy to do this project for you and future ones as well. I have good portfolio of many similar tasks done , can send portfolio also my profile shows good. I could add good looking UI with no additional cost if needed. My scraping framework allows me to develop bots fast. Looking forward. Time frame - up to 3 days.
$600 USD 3 napon belül
5,0 (52 értékelés)
6,1
6,1
Felhasználó avatár
With respect to this project I would like to present myself as a candidate for your consideration. I have more than 8 years of IT experience. I have successfully completed few projects which involved Programming, scripting, web scraping. Key features of my work are as follows: 1) Always within schedule 2) Always within scope Looking forward to hear from you. Regards
$555 USD 5 napon belül
4,9 (57 értékelés)
6,0
6,0
Felhasználó avatár
Hi. I’m experienced developer with 5+ years in C#. I just read your description carefully. I have experience in all aspect of web and application based on C# using Asp.net MVC, Asp.net core and C# programming. I have some experiences in Nuget crawler and scrapysharp. I will do my best to come true your need. Please let me know when you are interested in my offer. Thank you.
$800 USD 10 napon belül
5,0 (8 értékelés)
5,2
5,2
Felhasználó avatár
Dear client. I read your description carefully and fully understand what you want. I am a Senior Software Engineer who has 8+ year's rich experience and very strong skills in C/C++, C#, .NET, Java and x86/x64 Assembler. If you desire the best qualified result in your project, you should choose me. I'm always ready to serve for you and I will do my best to make you happy with my professional skill. Waiting for your reply. Thanks.
$611 USD 10 napon belül
5,0 (5 értékelés)
4,8
4,8
Felhasználó avatár
Hi, We are a team of qualified and expert Web developers. We can demonstrate other projects on C# which have similar functionality. We have expertise in proxying requests through different servers, so that we don't get blocked. Thanks, Aditya
$1 500 USD 15 napon belül
4,9 (6 értékelés)
4,3
4,3
Felhasználó avatár
Higher-quality and faster-delivery is promised. Your job seems to be posted only for me not for the others, because you are looking for only an expert just like me. I have lived with P H P for +6 years so I know it as I do know myself. I can help you complete this job as you want. I have done this kind of work so many times so I know how to complete this job and make you fully happy with my quality works. I can start working right now. I hope to work with you. Thanks.
$666 USD 5 napon belül
5,0 (6 értékelés)
4,4
4,4
Felhasználó avatár
Hi there, I've read your project description and it sounds really interesting for me. I've a couple of years experience in programming and can make this project for you. Feel free to contact me so we can discuss the details. I could start directly. Kindly Regards, Markus Weitzer
$1 000 USD 10 napon belül
5,0 (8 értékelés)
4,1
4,1

Az ügyfélről

POLAND zászlója
Lugano, Poland
5,0
1
Fizetési mód hitelesítve
Tagság kezdete: máj. 7, 2018

Ügyfél-hitelesítés

Köszönjük! E-mailben elküldtük a linket, melyen átveheti ajándék egyenlegét.
E-mailje elküldése során valami hiba történt. Kérjük, próbálja újra.
Regisztrált Felhasználók Összes Közzétett Munka
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Előnézet betöltése
Hozzáférést adott a helymeghatározáshoz.
Belépési munkamenete lejárt, és kijelentkeztettük. Kérjük, lépjen be újra.