I am currently in the process of gauging the feasability and scale of a web scraping project. The gist of this project is to build a database of all degrees offered by all universities in NSW, Australia (collecting key fields such as University, degree name, faculty, skills, related industries, description). This data needs to be scraped from University Handbooks, with the typical degree page looking like this: ([login to view URL]).
This is a large scale project. There are 43 universities in NSW, with each of these offering anywhere up to a few hundred different degrees (considering undergraduate and postgraduate).
I plan to manage this project myself, and will be available throughout to assist you in your work.
The method for me to receive the data would be me setting up a database on a cloud platform like Azure, then giving your IP temporary access (as well as giving you the required credentials) to read from and write to the database, in order to push the data. As the project begins, we can discuss database structure or other possible delivery methods.
I am putting down a price estimate only because this is a requirement for posting a job on this platform - please ignore it when deciding on your price estimation.
What I am looking for now is a justification for your belief in your ability to complete this project, and a rough time and cost estimate. If I go ahead with this, I would be looking to begin this project in about a month.
Hi, my name is Selim.
I read your `Web Scraping on a Large Scale` project descriptions carefully before bidding. I checked your requirements as well... I got what you need and ready to go ahead as soon as we can clarify further project details.
I am 5-star web search and database building expert here at freelancer.com. Pls check my profile and feedbacks first to have some idea about the quality of my previous businesses. I had many similar tasks, all achieved with 5/5 rating.
Kindly get back to me if you wish to proceed with a top-rated and reliable partner here...pls note that I only deliver best quality at a reasonable price, and I am open for longterm partnerships, if you wish too...
I bid my best for you to start business, and I am ready to prepare a sample task for you to check & validate, once you give me a reply...regards.
Hi there,
I can build a database of all degrees offered by all universities in NSW, Australia.
If you have questions or doubts about anything, please feel free to ask me.
Sincerely,
Mir
Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe.
I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within the agreed deadline.
Check out my profile, portfolio and former clients feedback - that'll let you know everything about me.
Please feel free to contact me so that we can discuss further details.
Thank you for taking the time to read my proposal.I am looking forward to hearing from you.
Best regards, Miljan
Hi, I need your assistance to show me what to gather exactly, so I can estimate the price and the delay. thanks ***************************************************
Hi,
This project seems familiar to the project we recently worked on for UK Colleges. We would like to discuss directly regarding the scope of this project. We understood your requirement and would definitely do our best.
We are into web research and contact database building.
Please message at your convenience.
Thanks and regards,
Kalpanasekhar
I'm still interested, if you consider. Let's discuss!
Hello there, hope you're doing well. I have gone through your details and am happy to mention that I am interested in your project. And it would be best if you could tell me what particulars to grab from the programs pages. I am looking forward to hear from you and I believe I can offer you the best price with a reasonably shortest turnaround time!
Experienced web/data scraping FREELANCER HERE to work for your project.
Let's discuss more and finalize the project and cost. Feel free to ask me questions, if any. I look forward to work with you.
Have a good day and stay fine :-)
Sincere regards,
Jubair
Hi,
there i have done scrapping almost on Half of Worldwide web including eCommerce giants(Amazon,eBay,craigslist) News Feed, Social media websites, API's.
I develop my own tools based on client requirements with Multi-threading, a Bot with human behavior and Scrapping Applications with documents parsing. I Can do PDF Parsing and Capctha ByPass code as well. Contact me for further details.
I have developed over 100+ Bots and Tools for my clients and made sure they got their data.
I normally work with Python or C#
Not convinced yet let me have your questions.
Thanks
I understand your requirements and what you wanted scrapped, and this is a large scale project that needs full time and dedication.
I have a couple of questions. Please get back to me via chat and let's discuss details.
I would like to give you sample collected data for some universities and programs so I can give you a close to accurate estimate of time this will take and a quote.
Thank you for considering my bid,
Hello,
I have gone through your project details and understand the requirement properly as it needs data for the universities and details.
We are a team here and complete more than 200 similar projects. And complete exact similar jobs.
Let's have a chat about confirming the project scope.
Waiting for your reply.
Thanks
Dg
Hello There
I have read the full job description carefully and understand. It will be great that you will assist in the work. so there will be no mistake. I am interested to work with you in this project.
Thanks
Sinthia
Dear EthanDev
I have gone through your project Web Scraping on a Large Scale
Can we do quick chat right now so that we can discuss the project briefly?
I do have similar experience doing something similar to yours therefore I am looking forward to discuss and move ahead.
Relevant Skills and Experience
I have 10+ years of experience in Web Scraping
I can do this within your budget too $1500 - $3000 AUD
I assure you quality work complete attention and proper communication.
Iam waiting for your responce,
Regards
Mmadi
I am currently in the process of gauging the feasability and scale of a web scraping project. The gist of this project is to build a database of all degrees offered by all universities in NSW, Australia (collecting key fields such as University, degree name, faculty,
Hello.
I'm a Python developer with a lot of experience in web scraping.
Although I think this project probably need manual scraping but I can use automated scraping tool if possible and needed. My price and time is declared in my bid, Please contact me over chat to discuss more,
Best regards.
Hello, I'm an expert of web scraping.
I've worked with so many startups/companies in big data processing and web scraping.
I have lots of experience and skills;
I've already extracted so many different kinds of detailed information from websites.
If you hire me, I'll deliver my results(perfect result) asap.
Hi EthanDev,
I find myself eligible for this job since I am having 7 years of extensive experience
I am Good at Web Scraping
EthanDev, Please Send a message so that we can discuss more about this project
Hello Sir!
I have checked your requirements carefully and think I can do your jobs.
I have good experience in web scraping areas.
Please check out my skills and past projects.
If you discuss details with me to assign job, I can start project.
Thanks.
I am a professional Web scraping Specialist
I can complete your web scraping requirement on time with good quality results using Python scripting
I start script right away and deliver within your timeline
Python BeautifulSoup and Scrapy libraries
I am confident that i can deliver best service for you if i am awarded
Thanks in advance!
Hi there,
I have strong expertise in web crawling, web scraping, website monitoring bots and web automation.
I have made lots of web scraping and bot tools to automate and scrape data in large scale and export them in specific format. I have a VPS to let my tool run for 24/7.
I have already completed similar jobs for Facebook, Google Map, Twitter, Instagram, Rightmove, Amazon products and more with 100% accuracy.
I have checked the site, this is an easy job for me.
Message me, we can discuss further over chat.
I can make a demo test for you in advance to give you some sample data.
Hi,
You won’t make the right candidate selection without knowing what your project on scraping all key fields like University, degree name, faculty, skills, related industries and descriptions of all Universities in NSW Australia will look like. Fortunately, I can show you how your job will look like before you award the project.
Before you award this project, I can complete a part of this project as a sample. This is so that you can be confident of the hands you will entrust this task. If you are satisfied with the result, you can go ahead and award the project. Please refer to my reviews to see why all my clients love my job.
Do you want me to start working on the sample?
Hi. Thank you for giving my words a read. I understand it has been a tough journey for you, to go through all the bids and finding for a perfect match who can come up to your expectations in terms of fulfillment of your expectations. I can guarantee you that I will fulfill to your expectations given that you provide me with all the details for this project. You can have a look at my profile and can see the pool of satisfied clients and commitment shown over the course of 1.5 years. I can make your dreams come into reality.
Having said all of this, I have some questions to ask & portfolio to present which I am looking forward to post on chat-- so i can understand the full essence of the work needed to be done and hence to define the scope of this project. This phase (Requirements elicitation) is the critical phase which will either define the success or failure of a given project. I know how to make this journey a successful one. And all i need from you is your availability for q&a. I am looking forward to that. Thank you.
