Data scraping librarymunkák

I need an AWS Pro/Python developer to: * Review + Edit Python code of 3 existing Lambda functions * Prepare the zip package of a library for a Lambda layer (for one of these functions) I will provide the code I currently have that we need to update so the output is more accurate. It's not the goal to rewrite the code from scratch or self-invent what you think the functions need to have. These are all AWS Lambda functions (under 100 lines each) with a straightforward approach. They work, it's mostly about refining them. I have highly specific instructions for what the code must achieve from here, I've been testing them thoroughly. For one Lambda function, I need the zip package as well, so I can use it as a Lambda layer. * Previous developers caused a massive bac...

...are seeking a proficient and meticulous data scraper to extract product details, pricing information, and photos from a large-scale ecommerce site, with over 500 unique products. The extracted data will form the bedrock of our market analysis and strategic planning. Key tasks will include: - Scrape and organize product details - Extract and catalogue pricing information - Successfully download high-quality product photos Ideally, the successful freelancer will have: - Proven experience in large-scale data scraping projects - An adept understanding of ecommerce platforms - Exceptional attention to detail - Respect for given timelines - Effective communication skills Please note, our project involves a site with no stated restrictions on data sc...

I require the expertise of a seasoned data scraper. My business needs extracting contact info from US businesses website addresses that end in (businessname).business.site. This is a lead generation task. We don't limit ourselves to a specific sector or industry, all touched by the . domain will do. Your task will include the following: - Scraping for business names, email info, phone numbers, and web addresses from these sites. - Ensuring the final list contains more than 10,000 businesses. Ideal Skills: - Proven experience in data scraping - Proficiency in necessary software and coding languages - Keen attention to detail - Commitment to hitting a large target number Please bid if you're up for this large-scale data extraction project.

I'm seeking a proficient data miner to locate and compile various pieces of information from company URLs I provide. I more interested in the "method" to extract, not just the extracted data. You will specifically: • Extract contact information • Unearth 'About Us' details • Compile product related data • Determine total company revenue • Ascertain the number of full-time employees All this information should be compiled into a well structured, easy-to-analyze table format. Ideal candidates for this project posses solid experience in data extraction, web scraping, and data organization. An understanding of corporate structures and significant attention to detail is also highly beneficial to e...

I require the expertise of a seasoned data scraper. My business needs extracting contact info from US businesses website addresses that end in (businessname).business.site. This is a lead generation task. We don't limit ourselves to a specific sector or industry, all touched by the . domain will do. Your task will include the following: - Scraping for business names, email info, phone numbers, and web addresses from these sites. - Ensuring the final list contains more than 10,000 businesses. Ideal Skills: - Proven experience in data scraping - Proficiency in necessary software and coding languages - Keen attention to detail - Commitment to hitting a large target number Please bid if you're up for this large-scale data extraction...

Looking for a skilled programmer to scroll/scrape HTML pages. Client didn't specify the total number of pages to be scrolled, hence you should be able to handle varying amounts. Ideal Skills: - Proficiency in any of these programming languages: Python, JavaScript, PHP - Experience with web scraping Application Requirements: Please include in your application: - Your relevant work experience - Your past work related to HTML scraping - Detailed proposal for this project. Looking forward to work with a dedicated, adept, and swift professional.

...project involves: - basic updating HTML templates to align with a new UX design while maintaining the existing Angular 15 structure - porting some interface from Angular 8 to Angular 16 - advance angular programming of component and connection of API REST WEB SERVICE Below are the key requirements for the project: Technical Specifications: - Angular Version: 16 - Bootstrap Version: 5.2 - Primeng Library: 15.2 - Working with our internal Identity System for Role and Permission Management (after login there are services that send information about user/group/profile/skills ecc) - Access to the code with Private VPN (Wireguard) to GITLAB repository - Docker image to deploy the "development enviroments" on your local PC Keep attention on: 1) Existing Components: Generi...

...embarking on a research project that requires detailed data from several Stoic-centric subreddits. Specifically, I'm interested in collecting: - Post titles - Dates of posts - Original post text - Comment text The target subreddits for this project are: - r/Stoic - r/Stoicism I'm only looking to scrape data from posts within a specific date range, which will be shared with the selected freelancer. **Ideal Skills and Experience:** - Proficiency in Python, specifically with libraries like BeautifulSoup, Scrapy, or PRAW for Reddit data scraping. - Experience with data manipulation and storage, potentially using pandas and SQL. - Ability to work with APIs, if necessary. - Familiarity with Reddit's structure and rules relating to dat...

I'm launching an ambitious project aimed at entrepreneurs and creators who are passionate about reselling digital products. This venture is not just a business opportunity; it's a chance to gain lifetime access to a comprehensive library of over 1,000,000 digital products, spanning various categories, for a one-time fee of $40. Here are the key details: - **Digital Product Categories:** - *Ebooks*: A rich collection in genres including Self-help and Motivation, and a unique Digital Marketing Course. - *Software*: Tools and applications that cater to a wide range of needs. - *Music and Audio*: Diverse tracks and sounds for personal or commercial use. - **PLUS**, an exclusive Journal Template packed with Master Resell Rights (MRR), along with 15 million additional d...

More details: What specific Python tasks and projects do you need assistance with? Web scraping, Data analysis, Machine learning What is the primary goal of your Python project? Developing predictive models How soon do you need your project completed? Within a month

I'm looking for a skilled developer to create a fully functional bot specifically designed for the Uyap portal. This project requires someone with a detailed understanding of both web scraping and automated systems to help streamline my bidding process on Uyap. **Core Requirements:** - **Automatic Bidding:** The bot must be able to automatically place bids on listings within specific parameters that I will define. It means the bot needs to be smart enough to recognize the current price from the given auction and place a bid with defined parameters. -Options to set more than one auction at same time -Bid in last milli seconds (fast bid methode) Some words translated from the Uyap bid platform: Ihaleye verilen en yüksek teklif: Current given highest price Artirma basla...

I'm looking for a developer who can extract text content and images from every page of a specific Android app and populate this scraped data into a Google Sheet. While the display layout details will be defined later, I expect the freelancer to have prior experience in similar projects. Thanks Andy

I need a skilled web crawler expert to extract specific information daily from a designated grocery website and deliver the collected data in a spreadsheet format. My primary focus is on the following details: - Product names - Prices - Images - Descriptions (including size and other relevant information) Ideal Skills and Experience: - Proficiency in web crawling tools and technologies - Experience in extracting and parsing large datasets - Ability to schedule and automate crawling tasks on a daily basis - Expertise in data formatting and spreadsheet management The extracted data should be neatly organized and presented in a spreadsheet, with clear and distinct columns for product names, prices, images, and descriptions. This job requires a high level of attention t...

...development. Frontend: React.js or Angular for building interactive user interfaces. Database: PostgreSQL or MySQL for data storage. Hosting: AWS, Azure, or Google Cloud Platform for cloud hosting and infrastructure. Additional Tools: Git for version control, Docker for containerization, and CI/CD pipelines for automated deployment. 3. Key Features and Functionality: Job Posting Aggregation: Integrate with external APIs or implement web scraping to collect job postings from various sources, including job boards, company websites, and recruitment agencies. Resume Builder with AI Assistance: Develop an intuitive resume builder tool that utilizes AI technology to analyze user-provided data and generate customized resume templates optimized for ATS. Personalized Job A...

...of a Python developer with specialized skills in web scraping, particularly for datasets that present a higher level of complexity, including the need to navigate login requirements. Here is a brief overview of what I'm looking for: - **Task at Hand:** The primary task involves web scraping, but not your run-of-the-mill scraping. The data I'm interested in is hidden behind login screens, which adds an extra layer of complexity to the project. - **Data Complexity:** The complexity doesn't stop at login screens. The content to be scraped is nuanced, requiring a sophisticated approach to capture all necessary details accurately and efficiently. - **Experience Required:** - Proficiency in Python, with a strong emphasis on web scrap...

...from crt.sh. The problems are detailed as follows: - **Port Scanning Inefficiency**: The application isn't efficiently scanning ports, leading to missed opportunities and data gaps. - **Subdomain Extraction Trouble**: Extracting subdomains from isn't as seamless as it needs to be, interrupting workflow and data collection. I am in urgent need of a skilled Python developer who can dive into the existing codebase, identify the root causes of these issues, and implement fixes to both port scanning and subdomain extraction processes. **Ideal Skills and Experience**: - Proficient in Python, especially with web scraping and networking tasks. - Familiarity with web enumerator tools and strategies for port scanning and subdomain extraction. - Experience in opt...

I'm looking for an experienced web scraper to extract specific data from the Zomato website. The aim is to collect atleast 500 restaurant details for a deeper qualitative analysis. Here are the specifics: - Data Extraction: The key data points required are product descriptions, customer reviews, contact information, restaurant id, restaurant name, restaurant link, and location. The ideal candidate should have: - Proven experience in web scraping, specifically from sites similar to Zomato. - Knowledge of data manipulation and analysis - Excellent attention to detail Please ensure you can deliver the dataset in a structured, clean and understandable format.

...media platforms: Facebook, Twitter, and Instagram. - Integration of APIs from the above platforms is essential for real-time data analysis and tracking. - The platform should be able to scrape relevant data from the surface web to provide comprehensive insights. - Capabilities to filter, analyze, and present the data in an intuitive interface are crucial. **Ideal Skills & Experience:** - Proficiency in API integration and managing data from social media platforms. - Strong experience in web scraping and data mining. - Knowledge in data analysis and visual representation of complex datasets. - Ability to implement robust security features to protect sensitive data. - Previous work on OSINT platforms or similar proje...

Integrate a rapid Quora scraping API to fetch data for features like Trending Question Alerts, Keyword Discovery, and Competitor Keyword Insights. Develop the back-end infrastructure using to manage data processing, storage, and API integration. Design and implement a front-end user interface using and the Shad CN UI framework, ensuring the application is responsive and accessible across all devices. Implement data visualization components for displaying complex data (e.g., graphs, charts) in a user-friendly manner. Build a recommendation engine for question recommendations based on user's expertise and engagement history.

...have the capability to: - Allocate tasks to different team members and vice versa - Assign priority to these tasks - Keep track of each individuals’ tasks progress - have a scraper that will scrape specific data to update the tasks status It is vital that the program has an intuitive interface suitable for 1-2 teams handling a variety of assignments. The ideal candidate for this project would undoubtedly be someone who has previous experience designing task management software. Expertise in the following areas would also be advantageous: - Web application development - Web scraping - Task tracking systems In summary, I'm looking for a seamless blend of task delegation, prioritization, and tracking functions in one innovative package. If you possess the sk...

I am looking for a skilled web developer to migrate our existing web pages, currently built with a different framework, to NextJS combined with Typescript and Tailwind CSS. **Requirements:** - Proficiency in NextJS, Typescript, and Tailwind CSS. - Experience with the framework/library we are currently using. (Will specify upon discussion) - A deep understanding of React, as our current setup is built around a different specified framework/library. - Proficient in both frontend and SEO practices to ensure a seamless transition with improved outcomes. - Excellent communication skills to stay on the same page throughout the project timeline. Given the urgency of the project, I am looking for someone who can start immediately and dedicate their time to ensure a swift and effi...

I seek a skilled individual to execute a one-time, detailed scraping of all available reviews for the ‘Komoot’ app from both iOS and Android platforms. This task will focus on collecting exhaustive information, specifically ratings and textual content of the reviews. **Essential Requirements:** - Proficiency in web scraping and data mining techniques. - Experience with both iOS and Android platforms. - Ability to handle large dataset extraction and organization. - Knowledge of Python or any relevant programming language capable of scraping app stores. - Familiarity with data storage solutions to deliver the extracted information in a structured format. **Expectations:** - Complete extraction of all existing reviews for the Komoot app from s...

I seek a skilled individual to execute a one-time, detailed scraping of all available reviews for the ‘Komoot’ app from both iOS and Android platforms. This task will focus on collecting exhaustive information, specifically ratings and textual content of the reviews. **Essential Requirements:** - Proficiency in web scraping and data mining techniques. - Experience with both iOS and Android platforms. - Ability to handle large dataset extraction and organization. - Knowledge of Python or any relevant programming language capable of scraping app stores. - Familiarity with data storage solutions to deliver the extracted information in a structured format. **Expectations:** - Complete extraction of all existing reviews for the Komoot app from s...

...include both written articles and edited video segments **Core Responsibilities:** - Scrape content relevant to current events. - Build and manage API data feeds for efficient content gathering. - Plan and execute a content calendar, ensuring daily uploads. - Write short, engaging news articles suitable for each platform. - Edit videos to accompany articles, optimized for platform specifics. - Report on content performance, with a keen eye on growth and engagement metrics. **Skills and Experience Needed:** - Strong background in content creation and journalism, with a focus on current events. - Proficiency in scraping content and managing API data feeds. - Excellent writing and editing skills, with the ability to adapt tone and style for different platforms. - Ski...

you can put the search term in tiktok filter. The search term can be "Dropship products". From the search results, we only need to get sponsored posting ads. So we need to identify which url is “sponsored“ ad. The sponsored posting ad seems to have label like “sponsored“. data = { "ad": { "tiktokPageId": "coachoutlet", "tiktokPostId": "7231275010000702721", "adFormat": "video", "landingPageLink": "

I'm in need of a professional with a focus on data scraping to extract user data from an undisclosed site. Ideal applicants should possess: - A solid background in data scraping - Proof of past work involving similar tasks Your responsibility will involve extracting specific user data from a website, which will be disclosed upon project commencement. For confidentiality reasons, the exact website cannot be disclosed in this listing. I look forward to viewing your past work and experience so we can embark on this project.

I currently have a websocket that is built in JavaScript (node.js) I want to convert the script to PHP (Ratchet). Since the JavaScript code is completed it should not be hard to convert to PHP as all the calls are already implemented. The websocket makes API calls to the example code below: if ($server->remote_ip() != '') { This code ...(VPS) where the websocket WAS and use that to authenticate. Since we are moving the websocket to our webserver this code needs to be adjusted as well, to accept an URL instead of IP. The purpose of this websocket is to detect when a user leaves the website and send a request to the API, half the script is JavaScript and other half is PHP. The JavaScript needs to be converted to PHP. The Ratchet library is already installed on the ...

...Cleaning category 2) Scraping of web data for contact information. This project is critical for expanding my business's reach and ensuring we have access to valuable B2C and B2B contacts. **Key Responsibilities:** - **Classified Posting:** - Post daily ads on Kijiji under "House Cleaning." - Ensure each ad is engaging and accurately represents our services. - Update ads to keep them fresh and visible. - **Data Scraping:** - Scrape the web for contact information relevant to our business. - Focus on accuracy and data relevancy. - Compile data in an accessible format for marketing purposes. **Ideal Skills and Experience:** - Proficiency in web scraping tools and techniques. - Experience with Kijiji ad pos...

I am seeking a skilled programmer to develop a lightweight SNMP library specifically tailored for IoT devices. This library is to be built using MicroPython, focusing primarily on SNMP version 1. **Key Requirements:** - Develop in MicroPython only. - Support SNMP v1 for compatibility. - The library should enable sending SNMP get requests to an OID. - Must handle response data as either integer32 or octet string. - IOT device is Pycom fipy/gpy, and SNMP device is a SPLnet M100 sound sensor. **Ideal Skills and Experience:** - Proficient in MicroPython programming. - Previous experience with SNMP protocols (specifically SNMP v1). - Understanding of IoT device communication and constraints. - Ability to optimize code for limited-resource environments found in IoT ...

The requierements are in the attached file. / El proyecto se encuentra especificado en el archivo adjunto Skills / Conocimientos: - Javascript - PHP - Wordpress - library

I'm seeking a talented WordPress developer who specializes in creating intuitive and dynamic archives, specifically tailored for hosting an extensive collection of blog posts. My vision for this project is to enhance the user experience on my website, making it easier for visitors to navigate, search, and interact with our rich content library. Here are the core aspects and requirements for this project: - **Primary Focus**: The archive must be optimized for blog posts, ensuring that visitors can easily find the content they're interested in. - **Must-Haves**: While the initial question on specific functionalities was skipped, I'm open to the developer's innovative ideas for features that could include a search bar, category filters, and efficient pagination to ...

I'm looking for an expert in Data Scrapping and JSON. I'm studying these topics and need guidance to understand: - How to extract data from websites using scraping techniques - Creation of a JSON database. Your responsibility will be to guide me by solving my technical doubts. The ideal freelancer shouldn't have a strong background in data scrapping and JSON and experience using Selenium. Enthusiasm about teaching these skills is a bonus!

I am seeking the expertise of a python developer skilled in web scraping and automation. The selected candidate is expected to: - Have extensive experience with Python - Be skilled in circumventing bot protection mechanisms on websites. - Have a track record of working with websites protected by Cloudflare The primary responsibilities will be to automate various web tasks and bypass bot protection infrastructure on Website 1. Efficacy in handling Cloudflare and similar protections will be considered a significant plus. Please provide relevant examples of your work while placing your bid. Thank you.

...**Ideal Skills and Experience:** - Proficiency in web scraping and data mining techniques. - Experience in developing real-time data processing systems. - Strong background in Python, JavaScript, or any other programming language relevant to web scraping and API integration. - Familiarity with database management and storage solutions suitable for large datasets. - Knowledge in implementing machine learning models for text categorization is a plus. **Expectations:** - Work closely with me to understand the project scope and refine the requirements as needed. - Provide advice on the best technologies and methodologies to use for efficient and effective news aggregation. - Implement a scalable solution that can handle the demands of real-time data pro...

...experienced Web Scraping Specialist to join our team. The ideal candidate will be responsible for developing and implementing web scraping scripts and tools to extract data from various online sources efficiently and accurately. This role involves analyzing and collecting data that is crucial for our business intelligence, market research, and strategic planning efforts. The Web Scraping Specialist will work closely with our data analysis and IT teams to ensure the quality and reliability of data collected. Responsibilities: Design, develop, and maintain web scraping scripts and tools to extract data from targeted websites. Ensure the integrity and accuracy of scraped data through rigorous testing and validation proc...

...competent Python developer to design and implement a web scraping and automation program focused on Google search results. I have a python file () which is used to scrap the google search results, as the aim is to get the first google-scholar account from the google search and the search parameters are defined within 'testing ' However, the code executes the error (: 429 Client Error: Too Many Requests for url:) error due to non-existence of proxy IP addresses. For this reason, I have made another python routine () and have loaded the proxy IP addresses. I need a freelancer to adjust this code (or write another code from scratch) so that I should successfully scrap the google data from thousands of searches from a single PC. Note: I have

...interaction. - **Main Goals**: The website should be structured around our core objectives: 1. Attracting new members through an engaging homepage and compelling calls-to-action. 2. Offering comprehensive information on various meditation techniques, possibly through articles, blogs, or dedicated pages. 3. Hosting a community members space under password protection. This will have a library or archive of video recordings and documents from past lectures that visitors can easily browse and view. Will host community meeting minutes and a member directory. - **User Experience**: Optimization for both mobile and desktop users is essential. The final product should deliver a seamless, responsive experience across all devices. The user interface must be intuitive, with easy...

I'm in need of proficient data mining services to gather specific types of information from a targeted online pharmacy. This task requires both precision and the ability to navigate a niche-market website efficiently, ensuring the capture of relevant data without compromising the integrity or security of the site in question. **Key Requirements:** - **Target Website:** The focus is on extracting data from https://buysleepingpills.com. - **Data Type:** The primary goal is to collect email addresses that can be found on the site. These could be related to customer service, inquiries, or any contact email listed within its pages. - **Compliance and Ethics:** It's crucial that the scraping process adheres to legal and ethical standards, respecting ...

...is to automate the extraction of critical data from two specified stock information websites. The data to be collected includes stock prices, company names, and ticker symbols. This project requires someone with a strong background in web scraping, with a preference for those who have experience dealing with financial or stock market data. Responsibilities: Develop and implement a robust web scraping solution using PHP to extract specified data from targeted stock information websites. Ensure the accuracy and reliability of scraped data, focusing on stock prices, company names, and ticker symbols. Schedule automatic data extraction processes to ensure up-to-date information is always available. Work closely with our team to integr...

...Microsoft Power Automate: --- **Project Title: Website Scraping Automation using Microsoft Power Automate** **Project Description:** I am looking for a skilled freelancer who can develop an automated solution using Microsoft Power Automate to extract specific information from a target website. The goal is to create a workflow that retrieves data from the website and stores it in a structured format for further analysis. **Key Requirements:** 1. **Website Selection:** Identify the target website from which data needs to be scraped. 2. **Data Extraction:** Develop a Power Automate flow to extract desired information from the website. This could include text, images, tables, etc. 3. **Data Transformation:** Clean and transform the extracted data...

I would like to copy an html site and download to my pc or to send me the all html files via we transfer in order to upload the site in another sub domain. Suggested software / program "Cyotek Webcopy" or other alternative option via scraping for example. All links must be functional After the end of the task we need full written instructions how to set up Cyotek Webcopy to my pc to download a full functional html site

More details:Python developer with knowledge of Web scraping (scrapy). The site I scrape data from is updated and I need a capable developer to fix my scraper. The right person must have proven record/experience of completed projects (even though that might not be necessary as long as he/she can get the job done). I am using only apple mac computers. Price is not negotiable. What specific tasks do you need the Python developer to perform? Web scraping What is the primary goal of the web scraping project? Collecting data for my own database. What websites do you need data to be scraped from? A particular website

I am initiating the development of a Library Management System and are in search of a skilled student freelancer to lead the project. The system will be built using Flask for robust API development, VueJS for an intuitive user interface (potentially utilizing VueJS Advanced with CLI), Jinja2 templates for dynamic content, Bootstrap for styling (if required), SQLite for database management, and Redis with Celery for caching and batch job operations. The successful candidate will be responsible for creating a seamless, efficient, and user-friendly system that meets the specified requirements. If you have a passion for web development and possess the necessary skills, we invite you to be part of this exciting project.

...processes. - **Database Management:** A robust system to manage user data securely and efficiently. - **Price Comparison:** Development of a feature that allows users to compare prices of products/services. This requires implementing algorithms that can pull and compare data effectively. **Ideal Skills and Experience:** - **Python Web Frameworks:** Experience with Flask or Django for web development. - **Front-End Development:** Knowledge of HTML, CSS, and JavaScript to create an intuitive user interface. - **Database Skills:** Proficiency in database management systems, preferably with experience in MySQL or PostgreSQL, to handle back-end data storage and management. - **Data Scraping and Analysis:** Ability to gather data from differen...

Kérjük, regisztráljon vagy jelentkezzen be a részletek megtekintéséhez!

Need graphs similar to screenshots I tried to develop stack bar chart using below library. But I am facing below error. I am trying multi colored are and multi colored line too. My code is in StackOrderModified and can fix fix in stackblitz I am getting below error Cannot read properties of undefined (reading 'some') ,pages%,components%,components%,components%,pages%,pages%

This Job Post has been significantly descoped from the previous posting. I am looking for an experienced data scrapper who can execute a comprehensive task for me. Here's what's required: - This project demands an online search on Google using the "site: USA" filter. The primary task is to scrape every URL from the list correlated with businesses located in United States of America (USA). - You must retrieve the following data: url, business contact information (business name, address (street, city, zip code), phone number. Also retrieve business hours, reviews, links where possible. - I require the data delivered neatly in an Excel spreadsheet in a zipped file. Steps to Bid: 0) Only interested in automated scrapping process; no manual process 1) S...

Hi, I tried to develop stack bar chart using below library. But I am facing below error. I am trying multi colored are and multi colored line too. My code is in StackOrderModified and can fix fix in stackblitz I am getting below error Cannot read properties of undefined (reading 'some') ,pages%,components%,components%,components%,pages%,pages%

Kérjük, regisztráljon vagy jelentkezzen be a részletek megtekintéséhez!

I’m looking for an experienced Python developer to embark on a unique and exciting project tailored specifically for NataliaDev. This endeavor includes but is not limited to the development of Python-based solutions, with a flexible scope that could encompass data analysis, web scraping, automation, or even machine learning and AI capabilities depending on the project's direction. **Requirements:** - Profound knowledge in Python programming. - Experience in one or more of the following areas: data analysis, web scraping, automation, machine learning, and AI. - Ability to work independently and creatively to overcome challenges and implement solutions. **Ideal Skills and Experience:** - Strong analytical and problem-solving skills. - Experience with ...