Automate many Firefoxes, each with different proxy, for web scraping.

Hello. I'm a web scraping expert and i've worked on many Selenium automation projects like this. I'm really good with selenium web browser and i can use it for any kind of scraping or automation. Proxies rotation is not a big deal to me, i can write some code to do that perfectly in no time. But i'm wondering if we use the same proxy to solve many RECAPTCHAs it will show us the real RECAPTCHA and the bot have to solve them. Anyways it depends on how you want the bot to automate Firefox. Let's discuss this project more in chat, i'm sure that you will be impressed by how well the bot will run. I look forward to do business with you. Best regards.

Hi, I am interested in your project related to build an automated script to get data from webdriver firefox browser and using miltiprocessing and proxies . Please send me a message so that we can discuss all the details. Thanks, Ramzi

Hello, I can help with you in your project Automate many Firefoxes, each with different proxy, for web scraping. I have more than 5 years of experience in Javascript, PHP, Python, Software Architecture, Web Scraping. We have worked on several similar projects before! We have worked on 300+ Projects. Please check the profile reviews. I can deliver your job with in your deadline. Please ping me for more discussion. I can assure the 100% job satisfaction. Thanks,

Can do your job. Can provide you python script for running it. Can handle captcha with captcha solving API. which we will need it These are my skills set related to Web Scraping and Web crawling Have done scraping in Nodejs, CasperJS Phantomjs, python Scrapy Framework. Have done testing and automation with selenium also. Know to deal with database like mongo, mysql, Elasticsearch. Also know to handle proxy and captcha while scrapping.

Hi, I will build a Java application to scrape data from provided links. The application can be run on UNIX/Linux OS and using proxy. I will make use of shell scripts to automate this task. Each link will be routed through a proxy. The extracted data is saved into a database or any file format. I have few questions regarding the CAPTCHA. Please contact me to discuss more about my proposal. Can you please provide a sample URL? Thank you.

Hi there, This is Smithangshu. I am extremely sure about it that I can develop the Web Scraper Application with Firefox for you. I am very interested to develop your project if you kindly allow me. I am working for more than half of the decade using .Net Technologies like C#, VB, C++ to develop both Desktop, Web application, DLL Library also proficient in JavaScript, JQuery and databases like any version of MSSQL, MySQL, SQLite etc. I have already succeeded almost same kind of project that you have explained. You can see on my portfolio in my freelancer profile that I have already developed similar kind of project named as "Google Automation Software" which does automation on Google page also it can be used with proxies like you can see on the screenshots and it is all developed on the top of Firefox, also I have scraped complex website like AirAsia Flight Details, Bet365 ODD & INPlay feeds etc. **Also, I am providing a privilege to my client that I will show your work completely for FREE then if you would think that I am the person that you are looking for then you can proceed else if you feel that I am not that efficient as you are expecting then you can move on freely.** Certainly, I am the most eligible person to get involved in your project. So please feel free to contact me for further discussion. ***Looking forward to working with you and add your success story to my profile along with my valuable happy clients.*** Regards, Smith

Hey there! I have read your description and would like to have a chat with you. Ill use python and selenium for this task. I use a third party extension to solve captcha( all versions of captcha including reCaptcha v2 and invisible captcha), which has to be rented. (it's pretty much cheap, 1$ for 1000 captchas solved). My skills & experience: -- 2.7 years of experience in building automation tools using python. -- Seasoned professional in web scraping. -- Worked for Infosys ( a multinational company ) as Automation engineer. -- Worked on ATP world tour 2017 project as Data analyst. -- Can scrape content of sites protected with captchas and have dynamic content generated using ajax and JS. -- Built more than 53 web scraping projects till date ( 13 on freelancer.com, please check reviews ) -- Websites i have built scraping tools for include Linkedin, Facebook, Gmail, Tinder, Okcupid, Outlook and many more. -- *** Can bypass captcha ( reCaptcha V2 and invisible Captcha as well) using a third party browser extension. *** Looking forward for a message from you. Thank you, have a nice day!

Hello , I am an automation engineer with 7 yrs of exp. I can automate many firefox browser using proxy for web scraping. Kindly let me know more details of your project. Waiting for your reply Thanks ankur

The solution I propose for this project is to implement a small script made with Node.js that would use a headless browser for your scrapping needs. You will be able to run multiple instances of this at the same time setting a different proxy for each one if desired. A question, why would you chose firefox over chrome? The headless browser I use is based on chromium (core of chrome) and from my experience it's pretty light and fast and I have installed it in the tightest of servers.. just saying. Regarding the invisible recaptcha, we will avoid it behaving like a "human would" which involves in part going easy on the server along with other strategies. I don't have an issue with showing you a proof of concept using teamviewer. Please let me know if you have any questions! Technical background: I have implemented similar solutions for the companies I worked for, so I'm pretty familiar with the tools and the workflow for this.

Hello Ive worked on many projects like this: -Youtube views bot -Google recaptcha token farming for multiple websites. So i know how to handle multiple instances of (firefox or chrome) with a different tested & working proxie even with hes own firefox profile. I will code this using python 3.6+ using selenium. I can code it Multythreaded and with proxie support & scrapper. I can give you a high quality software that will fit your needs. also i can give you a FREE DEMO because am 100% sure i can done this project without any problem. please contact me if you dont want to lose the time on your project.

Dear Sir/Madam, You're looking for a data scraper who can automate firefox with proxies to launch multiple firefox. We would love to have this opportunity. Your project reminds us our previous projects where we scrape Linkedin with Java/Selenium by launching Multiple Firefox with proxies. We were using Digital Ocean Server of 4 core with 8GB of run and we was able to run 5 firefox at a time. As you have Big server it can run more 50+ Browsers simultaneously. We will create script in Java/Selenium which will also click on Recapcha and will scrape data too. We can provide you demo on teamviewer or other tool. Our strategy to scrape this website will be as following. 1. We will create our own scrapers in Java/Selenium. 2. Will run Scripts on your server to permanent run until desired data is scraped. 3. Will use Proxies if needed to get rid of IP ban. 4. Will click on Re-Captcha and scrape data. 5. Will provide you output in the format you want. We believe communication is key to any successful project, and we'd like to start things off on the right foot but suggesting we schedule a call to discuss the project further. This will enable us to make sure we communicate well and that both parties are completely comfortable with the scope of the project. Please let us know the time works best for you. Thanks for your time and consideration. With Regards, Sohail Ahmed

I just finish an web scrapping project. I think I can also do it for you. If you provide proxy link:port username:password, I can start right now. I use JAVA.

Hi, Based on the SOW i have a couple of questions : 1. Do you need the code for the scraping of data after the link click as well? 2. How many websites are involved? 3. What the timeline that you are looking at? 4. How many proxies do you have with you? Based on the input from you on the above mentioned pointers i can provide an even solid timeline commitment to you. Since creating firefox profiles wont be a problem i can finish it off in just one day. However if you need the scraping codes for all the websites then i would need some time to go through all of them and based on the complexity of the process i can create the milestones. Thanks, Saptarshi