G'day
To solve this project, I would recommend using a web scraping tool such as Scrapy that allows for automated data extraction from the web. This tool supports all standard web crawling techniques, including but not limited to following redirects, populating input forms, handling cookies, etc. Additionally, the results are stored in a CSV file, making it easy to analyze and visualize the collected data.
To begin, I would first set up the crawling structure using Scrapy. This involves writing a script that identifies the elements you need to extract from the web. After the elements are extracted, I would store the results in a CSV file.
Moreover, I would also recommend using an automated testing library such as Selenium to validate the accuracy of the web scraping. This would ensure that the scraped results are complete and that no errors are present in the CSV file.
Finally, the scraped results can be analyzed and visualized using popular software applications such as Tableau or Qlikview.
Overall, I believe using the aforementioned tools would ensure a complete and accurate real estate web scraping project.
Best regards,
Giáp Văn Hưng