Webscraper
$30-250 AUD
货到付款
We are looking for a skilled web scraper to gather text data from multiple specific websites. The scraped data should be organized in csv, json, and sqlite file formats.
Ideal Skills and Experience:
- Proficiency in web scraping tools and techniques
- Familiarity with Python or other programming languages commonly used for web scraping
- Experience in gathering text data from websites
- Ability to organize and export data in csv, json, and sqlite formats
Here is all the information required to decide if this is a job for you and to submit a proper quote.
Here are the details of what I require
I would like a GUI based webscaper/crawler using python, scrapy and playwright. But if there is a big difference in price with implementing a GUI I am comfortable using command line tools as well.
I need to search these websites.
1. [login to view URL] (US)
2. [login to view URL] (Australia)
3. [login to view URL] (Canada)
4. [login to view URL] (New Zealand)
5. [login to view URL] (UK)
6. [login to view URL]
I need to be able to search for businesses, I then need to be able to open the business website and get some more data.
I need to be able to select output name and file format i.e. csv, json, sqlite etc.
My search criteria would be industry, location, and how many pages. I need the option to change the sort feature on each of the websites. I also need to know whether the data scraped is an advertisement or feature placement within the page of the search websites above with some kind of indicator.
I would only be searching one of the above websites at a time, so would need a way to select the website I want to search.
The data fields I require for each business is;
1. Business name
2. URL
3. Physical address
4. Phone Number
5. All Email addresses (this is the data I require as the most important)
Currently I am doing this manually and believe it can be automated.
Please make sure you understand my requirements. This is how I do this process manually
1. I type my search criteria into one of the above websites with the location (usually a city, a state or province/county).
2. On the results page I change the sort order to what is best for the industry I am searching.
3. I open all the results from the search results in a new tab for each result.
4. I open each tab and get as much information from that tab which is never enough of the information I require.
5. I then open the website for that business and get the rest of the information that was not in the search tab for one of the search sites.
This is where the automation stop, the rest of the work I do manually.
Start your response with a '$' sign so I know you have actually read the criteria and understand what I am looking for. Please be accurate with your pricing as I want a realistic price to start with.
This is how I do it now.
Throughout this process I manually cut and paste the data I need into a csv file so the company I do work for can check the information. The 3 parts they check is the email addresses, the phone number and the physical address to ensure they are correct and exist.
They send me back the checked data so I know who is worth my time contacting.
My goal is to automate that entire process so I have the completed file to send to the company I do work for and I then can just work on contacting the businesses that check out.
I then take that csv file and convert it into a json file or an sqlite file and do my work from that.
This is why I require different file formats.
项目ID： #37371947
关于项目
授予：
'$' Hello, I'm an experienced web scraper and I have carefully reviewed your project requirements for a web scraper and automation tool that gathers data from specific websites, organizes it in various file formats 更多
有68名威客正在参与此工作的竞标，均价$203/小时
Top 1% in Freelancer.com Hi, Greetings! ✅checked your project details: ✅Completed Time: In project deadline We have worked on 900 + Projects. I have 6 + years of the experience in same kind of projects. If you are look 更多
Hello there, I have the yelllowpage and yellowpage australia software. I am experienced in web scraping and to build script or a windows desktop application by using python. I am also experienced in large data scrapi 更多
'$' Hi, I am Senior Python script developer with 10 years of experience. I can build a script/bot by python with your instructions very short time. Can we discuss please? Thanks
Dear Employer, I'm expert in web scraping, web automation and data mining tasks. I'm ready to start right away. I can scrape data from the sites above and create a csv,json and sqlite file. I scraped data from those si 更多
Hello! I am an experienced web scraper with a strong track record of extracting text data from diverse websites. I'll create a custom solution to collect and organize the data efficiently, delivering it in CSV, JSON, a 更多
Hi I'm an expert in web scraping I have read your project description i can gather text data from multiple specific websites I worked on projects like yours I think I can finish more quickly than others.i will take les 更多
Hi There! I have understood the requirements for the task. I have 6+ years of experience in performing Data Analytics, Automation and various other calculations and analysis using VBA, Macro, Power Queries, Pivot table 更多
Hi there, I am thrilled to express my interest in your Webscraper project. Leveraging a rich background spanning 4-5 years in Data Mining, Web Scraping, Python, Scrapy and Data Processing, I am well-equipped to bring 更多
$ Hello there As I read your job description, I see you are looking for a python developer who can build an App to scrap the data from multiple websites. As you can see my profile, I have an excellent background as a 更多
Hi, i have read your project. I'm interested in your project and would love to discuss it further with you. Please message me to get started. Thank you.
Hi I am web scraper expert Please start chat me I will show you one of website demo first Thanks Jaffer I.
I understand exactly what you are looking for in a webscraper and believe I am the best fit for this project. With over 15 years of experience in project management, strategic planning, marketing, data analysis, web sc 更多
Hi there! My name is Narendra and I'm a professional with extensive experience in web scraping, Python, web development and mobile development. I understand your project requirement of needing a skilled web scraper to 更多
Hello, I have almost 15+ years of hands-on programming experience, with almost 8+ years of experience in python explicitly. Also, I had quite some handsome experience working with the database(s) too. I had done simila 更多
