Finalizing Scrapy Webcrawler to download images

Lezárva Kiadva: 5 évvel ezelőtt Kiszállításkor fizetve
Lezárva Kiszállításkor fizetve

I trying to scrape the information from an online shop. I already collect the relevant information from the different web pages and the web crawler goes through all the pages. The last missing bit is to download all product images to each item. I have the XPATH to identify the images but at the moment I don't get the routine integrated to simultaneously collect the information and store the images - especially with a manipulation of the filename.

ToDo:

* download the product images (together with the product information), so I can match it later easily.

* The number of product images per article varies. Each time all images to one product have to be included. This also means the Name of the locally saved image is included in the created product information sheet.

* give each image a unique name consisting of product_number and the name it possess in the shop it is downloaded from

* Some documentation in the spider what is done in the newly added code

Attached you find the current state of the spider

The XPATH expression to filter the wanted Images is:

>>> [login to view URL]("//div[@class='image-slider--slide']//@data-img-original").extract()

['[login to view URL]', '[login to view URL]', '[login to view URL]', '[login to view URL]']

Data Scraping Python Scrapy Webes adatgyűjtés

Projektazonosító: #18659055

A projektről

9 ajánlat Távolról teljesíthető projekt Utoljára aktív: 5 évvel ezelőtt

9 szabadúszó tett átlagosan 28€ összegű árajánlatot erre a munkára

adeelpirzada

hi, i am an expert developer been able to crack and crawl data from complex websites and portals. i develop tools and bots that provides you with your data needs. thanks

€23 EUR 1 napon belül
(35 vélemény)
6.5
Nidhijain123

Hello, I have read and understood what has to be done in this task. I have sound experience in performing such kind of work as I have done lot of project of similar kind in the past. I think I can assist you in ge Továbbiak

€30 EUR 1 napon belül
(23 vélemény)
5.6
Stephenrajs

Hi there, I Have Scraped Amazon, Aliexpress, Yellow Pages, Yelp, Zomoto Etc. I Have 500 GB Internet With 20 Mbps Speed. I Have 6 Systems. I can do it. I have done many related projects like this. If you are p Továbbiak

€25 EUR 1 napon belül
(99 vélemény)
5.3
roshanasim

I did such job crawling popular e-commerce shops sites for getting web pages and parsing their content into word, excel, access and text files. I have a set of great tools, which can automatically scan pages, parse an Továbbiak

€25 EUR 1 napon belül
(33 vélemény)
5.1
ferozstk

Hello, After reading your project details I believe I'm suitable for this project. As I'm expert on this with more than 7 years experience. Please feel free to contact me. I am looking forward to hear from yo Továbbiak

€20 EUR 2 napon belül
(24 vélemény)
5.0
Rina247

Hello! I’ve read your job description & I am very much interested in working on your project. I have a good experience of the works. I am the right candidates for this task. I am a quick, reliable and efficient work Továbbiak

€23 EUR 1 napon belül
(28 vélemény)
4.5
amitbanerjee2812

Dear Hiring Manager, I read your job description and I am confident that I can exceed your expectations. I am a professional programmer on PHP+MySQL+WordPress. I have advanced skills in Data Scraping, Python, S Továbbiak

€23 EUR 1 napon belül
(0 vélemény)
0.0