Build and use a web crawler

Hi, I've read the project description and definitely can develop web crawler. I'll provide you with the highly skilled & professional UI/UX, HTML/CSS, PHP, Angular, JavaScript, MySQL, front & back-end web development services and complete the site in time. My skill set perfectly matches your requirements to build & maintain the web-based platform. We've got a big team of developers and designers and we always interested in good and stable projects to be done, so we can build relations on top of it to work for long. We're already working with many enterprise-level clients and delivering things in same technology in the US, UK, UAE, China & Australia and we can give you our client’s reference and you can talk to them. We’ve built many web platforms and sites also IOS & Android mobile apps. Let's discuss in details, explore your system & then come up with the precise time and cost. We offer technologies like HTML/CSS, UI/UX, Bootstrap, MySQL, Git, React.js, Angular.js, CRM, JavaScript, Vue.js, JQuery, JSON, AJAX, Node.js, PHP, CI, Laravel, Objective C, C#, Java, Rest API, ASP.Net, MVC, AWS, Agile, Software Architecture, WordPress, Swift, React Native & Ionic. Please message us to discuss further. Also, we can show you our past work, strength & skills of our company to give you the confidence & believe in us for working together. Surely, we can revise the bid after a brief discussion. We provide lifetime free support for our work and always believe in long-term relations. Cheers.

Hi sir, I'm Umer, a professional SEO friendly website developer and designer. I can develop your website professionally. Our developed websites are fully responsive for all screens, fully secure. I've 10+ year of experience in website development and more than 600+ successful projects. Please come to private chat for discussion about your website. I'm waiting for your positive response. thanks

Sure, can crawl websites and capture different attributes , but need to clarify few points. So can you please send me a message whenever you have some time to discuss about the project. For Now I am submitting a placeholder bid amount as the bid amount field is mandatory to submit this bid. Best Regards Hire Tech Experts

With Freelancer Preferred badge bound to give 100% Quality (Let's Chat) Hello, A great team is here for your service!! I read the project description properly, and I agreed to fulfill 100% of all your requirements. I can start your important project right away. I am 24x7 available on chat, so i can serve you whenever you want. Please check the PMB. Let's I'm interested in your project. Please send me a message so that we can discuss more. I prefer to submit my detailed proposal after our discussion. Note: + We are flexible with changes & we make them instantly. + We provide Service Guarantee for all projects delivered by us. We also provide post-implementation application support &maintenance + Please check https://www.freelancer.com/u/latatestTech Regards Dsv Infosolutions Pvt. Ltd.

Hi, I specialize in website design and development and am excited for this opportunity to work with you in accomplishing your goals. We have developed thousands of websites in many programming languages for clients all over the world. William B. could you please inbox me more detail about this project. Regards, Barry

Greetings. I have extensive expertise in Web Scrapping/Crawling. Regarding your questions yes we can scrape certain attributes from the website. I have some other questions to ask. Would you please message me so that we can have extensive discussion? You are requested to check my previous reviews and my portfolio regarding scrapping as well. It seems like an interesting project. I am very excited to discuss all the requirements with you, so I can mark the scope of this project. Please click the chat button right next to this bid proposal so we can talk through all the provided specification one by one. Also note that the final estimation will be provided once all the requirements will be revealed from your end. Hence, my cost of development & deadline solely depends on what you reveal (in detail). Looking forward to conduct an extensive chat with you. Thank you & waiting for your response.

How are you doing? After carefully reading your job description, I can see that you'd like to build an app for iOS and Android. I am extremely experienced in iOS and Android app development with 10+ years and I am also very strong at server back-end programming, as well as synchronizing app and MySQL database by developing and integrating JSON-RESTful server API modules. Please check my freelancer profile. https://www.freelancer.com/u/jinthreek89 My Working Style. ● Full-time developer (40+ hours per week) ● I can work in your time zone. So we will have good communication. ● Update the result every week ● Keep in deadline ● 100% ongoing satisfaction with your project. ● Provide the result with high quality ● Test the result fully with my QA team ● Lifetime Free Bug-Fix support after completion Best Regards

Hey. Nice to meet you. I have some skills with the crawling and search system using solr, hbase and nutch based hadoop for web search engine. I have good experiences with hadoop management and ambari operation. Let's discuss more detail. Best Regards.

Hi! I have tons of experience in web scraping/web automation, especially where normal methods fail. I can achieve the fastest scraping speed using several techniques including multi-threading. I have experience in Python/Php/JSP/C#/.NET and javascript projects. There can be negotiations about the price according to your requirements. Please send me your detail requirements. We can discuss it. I will do my best. Regards.

Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep

Hi, Yes, We can do this work for you that you are wondering about. You can completely count on us for this. Kindly initiate the chat to proceed further. Thank you

Dear sir, I have completed projects similar to your requirement in the past. If you could share your project detail requirements, I will try to share relevant past work demo. I already developed 100+ apps and websites for Android, IOS & Web sites as per the Google Store and iTunes, domain standards. Thank you and I look forward an opportunity to work with you. Current bid amount is a random quote, the final amount to be discussed after our quick productive conversations I highly value professionalism and hold myself strictly accountable to represent my client’s brand. I aim to form a long-term working relationship. If you are interested in a larger volume of work each month, I can offer a competitive rate. Please, let me know what is needed to secure this bid! Thank you for your consideration. Shilpa

Hello, After reading your project details I believe I'm suitable for this project. As I'm expert on it with more than 7 years experience. Please feel free to contact me. I am looking forward to hear from you. Best regards Feroz

Hi there! My name is Orestes and I am a Software Engineer with specialty in Java (Spring Framework) and PHP (Laravel Framework). I represent a whole team of software engineers (so our language stack is actually quite big: Java, PHP, C#, Javascript, Python among others) that have undertaken too many projects in the past (including Web / Desktop Applications, Web Services, RESTful APIs, Game Development etc) so I can guarantee that you (and your project) are in safe hands with us! :) I would like to state that even though your description has given us a basic idea for the project, I still have some questions and need to discuss with you in order to clarify some of the details. That is why the price of my bid is yet to be discussed and we can decide on a fair price for you and for us! Feel free to get in touch! Orestes

Sure, we can use custom crawlers or use some third party apis, we can measure these parameters with multiple approaches using nodejs/python cheerio library etc., I have done similar site for my product called "Clofus Office suite" to determine such metrics We can deploy this to AWS batch to run this efficiently for any 1000s of urls without any performance bottleneck I have great experience with both crawlers and highly scalable backend servers Please let me know Thanks

Hi. How are you? I read your description carefully and am very interesting in your project. I can start right now and can help you. If you hire me,i will do my best for your job and you can get the best results. Looking forward to hearing from you. Thanks.

Dear client. I have over 5 years experience with C++ programming and Python. High-quality & Fast-delivery is promised! As a highly skilled full stack developer and I can help you perfectly. I am very confident with my skills and I'd like to help your work by doing my best. My clients have never been frustrated with my work and I hope to make you one of them. I am able to work full time on your timezone and start working right away. Please confirm that I am one of the best fits for you and drop me a message for further discussion. Hope win-win with client. Thanks and Best Regards.

Hi I have developed ball detection and speed calculation, Object detection from image and face detection, etc. I am have rich experience in AI, ML and DL. I can deliver good result that you want. Please send me message. Let's discuss detail in chat. Hope to work with you. Best Regards.

Greetings, my name is Ahmad. I am Head of Client Relations and a web-developer myself. I would love to have an opportunity to discuss your project with you. With over 5 years of experience in mobile/web design and development we are certain we will not only execute this job but exceed your expectations. Our Development Standards & Practices:- Our Portfolio is verified with excellent client feedback. We develop Retina Ready and responsive designs across all platforms (Mobile, Tablets & Desktop) + We make sure that we follow the latest coding standards. We do not want to bore you with a copy-paste proposal and because we believe in the saying "Actions speak louder than words", we will let our work do the talking, so feel free to look at our portfolio and if you like our projects, feel free to reach out to us. We have 5+ years of experience in Web and mobile development. Reasons to select us: - 100% Job Success rate. - Verified Portfolio. - 5 Star feedback - 100% client recommendation. - We have our own server and you will be able to check the progress on daily basis. We believe communication is key to any successful project, our dedicated client relations officers will make sure that you get updates on time and develop. This will enable us to make sure we communicate well and that both parties are completely comfortable with the scope of the project. Please let us know a time that works best for you and we'll make sure that we make ourselves available.

Hello, I have gone through the attached files and understood your requirements that you need us to build a web crawler that will capture various attributes such as no of pages, videos, picture, eCommerce capabilities and more and measure how complex sites are. >>>>> On this note, I would like to ask a few things including: - In which format you need the crawler to store the collected data such as excel, database, or other? - Will you require automated crawler or you want to control when and which websites to process? - Do you want schedule based or real time crawler to crawl the data? - What would you like to collect from ads & ads tracking? - In how much time you need the crawler to scrape data from tens of thousands of sites? - What others data you need to collect? There are a few more thus I would like you to please share features or complete project details or get in touch to discuss so that we could assist you in a better way. ### We have huge experience in developing bot application, crawling and scraping applications and scrapped various data giants such as Facebook, LinkedIn, Google, MSN, Bing, Yahoo, G+, Twitter, Yellow Pages, Yelp, Yellow pages, White pages, YouTube, Flipkart, Flicker, Amazon, Weather Websites, NOMAD website for Weather reports and various other E-Commerce, Affiliation websites etc. ### So, ping me anytime for further discussions. Thank You. Look Forward. Regards, Tapan A.