已关闭

Write script or code to harvest data from websites

### SIMPLE DESCRIPTION ###

I would like someone to write a semi automated script/code or software that will search [login to view URL] using a custom search criteria. It will then collect all the addresses of all the properties that appear in the search and save them.

Then I need a second script/code or software to search all the saved addresses on another website and collect additional data which will be saved in a Microsoft Access Database (.mdb) file for a mail merge.

### DETAILED STEP BY STEP EXAMPLE ###

1) Search [login to view URL] for rental properties in Toowong, QLD 4066 using the following search criteria:

- All property types

- Beds (min): any

- Beds (max): any

- Price pw (min): $350

- Price pw (max): any

- Available date: Any date

- Surrounding suburbs: no

[login to view URL],+qld+4066/list-1

PLEASE NOTE THAT THE SEARCHES WILL ALWAYS BE FOR "RENT" SECTION OF THE WEBSITE, BUT I WILL NEED THE ABILITY TO MODIFY ALL THE OTHER SEARCH CRITERIA

2) The script will then collect all the addresses for all the properties that appear in this search. Please note that several pages appear in the search. eg:

- [login to view URL],+qld+4066/list-1

- [login to view URL],+qld+4066/list-2

- [login to view URL],+qld+4066/list-3

- [login to view URL],+qld+4066/list-4

and all the addresses must be saved, eg:

- 1/39 Brisbane Street, Toowong, Qld 4066

- 2/21 Glen Road, Toowong, Qld 4066

- 601/2-6 Land Street, Toowong, Qld 4066

- 204/573 Coronation Drive, Toowong, Qld 4066

- etc etc

3) all the saved addresses will then be used to search on https://rpp.rpdata.com.... Please note that this website requires a paid account and login which will be supplied by myself.

4) The script will search all these addresses one by one. Please see image 1 for an example of the first address search. PLEASE NOTE THAT ENTERING THE ADDRESS AND PRESSING 'ENTER' DID NOT FIND THE PROPERTY. I had to click the correct address from the drop down box first. Please also note that some properties will not be found and the script needs to be able to filter out as many as possible.

5) Please see image 2 for search results for first property

6) Please see image 3 and 4 for the data shown for that property

7) The script will then collect the address shown in the 'ownership' section. PLEASE NOTE THAT I HAVE HIDDEN THE EXACT ADDRESS FOR PRIVACY REASONS.

eg:

46 XXXXGTON TCE

ROBINA QLD 4226

8) Data collected will then be saved in an .MDB file. Please see image 5 for the format to be used. Please note that the addresses need to be split into columns as shown in image 5.

- 'Owner Address Line1' is the first part of the address that was found in step 7

- 'Owner Address Line2' is the second part of the address that was found in step 7

- 'Field1' is the address collected in step 2

- 'Rental Suburb' is the suburb taken from 'Field1'

#########

I am open to suggestions. If any of this script is too difficult/expensive to write then please recommend a better option. Some parts can be manual if needed.

Please message me if you are interested. I will be ignoring automated bids so please show that you understand the job and explain how you will do it :)

技能: Javascript, MySQL, PHP, 软件构架, 网页搜罗

查看更多: write code transfer data sql server excel, collecting data websites php script, create script harvest data, extract data from webpage, scrape data from website python, extract data from website to excel, web scraping tutorial, html scraping, web scraping, how to download data from website using python, script to pull data from website, script read data websites, script scrape data websites, write java script code odd numbers, write script macro copy data website excel, write script copies data excel clipboard, showing data count field pivot script code, data scraping php script code, php script request data websites, script bot gather data websites

关于此雇主:
( 41个评论 ) Hawthorne, Australia

项目ID: #17977086

45 威客就此工作平均出价 $1180

tarunmehan

Hello, Greetings for the day! I am ready to help you on an immediate basis to develop script that will search [login to view URL] using a custom search criteria. I have 5+ years of experience in PHP, Wordpress, 更多

$1200 AUD 在24天内
(81条评论)
7.6
pointlogic

Hello, I always provide fastest results with quality. I have an experience of more than 10 years in web development and maintenance. I have in-depth knowledge of php, mysql, javascript , jquery, payment system integrat 更多

$750 AUD 在20天内
(311条评论)
8.1
seaanddream

Hi, my name is Selim. I will write a java based bot with a sipmle UI for you to enter your search criteria and run it easily... I read your `[login to view URL]` project descriptions carefully before bidding. I checked 更多

$900 AUD 在7天内
(253条评论)
7.7
mhmhz

Hi I checked your requirements and i can build fully automated scrapers that can do the search then utilize the addresses. and finally export data to Access DB. PS. the scraper will be a desktop application that 更多

$3000 AUD 在5天内
(202条评论)
7.7
raindropsin

#Scrapping It seems like I need to create SCRIPT which scrapes data from that [login to view URL] real estate website and after gathering that data, need to store it and then also search that address with 更多

$2000 AUD 在20天内
(106条评论)
7.7
AndreiMk

Hi, I visited [login to view URL] to see how it works and reviewed your screenshots. I would suggest to make it as a standalone Windows application for the following reasons: - if it is for your personal use, why ma 更多

$1250 AUD 在14天内
(111条评论)
7.4
phpdeveloper100

I am expert in scrapping data from other website with all criterias as needed genraly , sometimes using proxies also , Please open Message box so that we discuss it in detail Expertise ================== - PHP 更多

$1186 AUD 在20天内
(73条评论)
7.2
ineedWorkJob

Greetings sir, how are you today sir? hope fine. Sir, I have read your project details and i will develop a windows software that will scrap the data from your 1st website based on your set parameters on the sof 更多

$1000 AUD 在5天内
(188条评论)
7.1
junkyfunky

Hello, I've read your project description and I want to tell you that I can write a semi automated script for you that will search [login to view URL] using a custom search criteria exactly as per your requirements. 更多

$750 AUD 在8天内
(135条评论)
6.9
kyrbatow

Hi. I think, all steps are possible to implement. I can use phantomjs to use the same actions as real user. Also I can use http requests. For example, step on screeenshot 1. When you fill in address text, site retu 更多

$1000 AUD 在20天内
(67条评论)
6.8
superman1987417

Greeting. Thanks for your job posting. I've read your job posting carefully and I am very interested in it. As a high skilled Scraping expert, I can do your job perfectly. I believe I possess the all required ski 更多

$1500 AUD 在20天内
(74条评论)
6.9
bestit4u

hi Nice to meet you. I read your job posting and I am very interested. first, Thanks for your detailed description. I think you want to make a automation bot. Yes. I have a good experience in building automation 更多

$1250 AUD 在20天内
(116条评论)
7.2
WebColorIn

All you need is a Chrome extension. Easy to use and customize, add features as well. I will build extension UI so its friendly to use. Will need API ( I will do this) that will post data to sql database if required. 更多

$1500 AUD 在25天内
(54条评论)
6.7
luiswilliam

Hi, how are you? I'm talented web developer. I have completed lots of professional web projects successfully before. And I am continuously supporting all projects which I have done for clients.,.,,///;' However, I' 更多

$1250 AUD 在20天内
(65条评论)
6.6
zekovicm

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with scraping [login to view URL] ! I can start immediately a 更多

$1111 AUD 在10天内
(68条评论)
6.8
polarjin2017

Hello? How are you? I have good skills in So I can complete your job in time. Hope to work with you. Thank you.

$800 AUD 在3天内
(99条评论)
6.7
devi222

Hi Sir, I have scraped the [login to view URL] site before for buy, rent, sold and agents data. I can create a python 3.6.5 script(GUI) will allow you to keep the addresses in the text file or excel file as a list and h 更多

$1000 AUD 在5天内
(110条评论)
6.5
schoudhary1553

I am expert who understands the value of time. I pride myself in my attention to detail. I am very hard working and aim to deliver in less time than quoted. I want to make you, my employer happy without changing my bid 更多

$1500 AUD 在20天内
(61条评论)
6.4
Batista111

Hello, Similar website [login to view URL] Please have a look at my freelancer profile. https://www.freelancer.com/u/Batista111 As you can see I have worked on more than 100 projects includin 更多

$1250 AUD 在20天内
(111条评论)
6.6
novepi

Hi there, I've checked each and every step individually, the requirements are quite clear. To be honest, I'm truly surprised to see that there's no serious measure for bot mitigation on [login to view URL] so this par 更多

$1000 AUD 在5天内
(47条评论)
6.1