已关闭

Develop a web scrapper -- 2.

Hi,

This is a project to scrap websites and to load results in a MySQL database.

This database will then be used by our content managers to write short descriptions of results and route users to the original website.

The data consists in interesting activities to be performed in a given city (restaurants, bars, visits, highlights...with addresses, descriptions, pictures...).

The developer will have to:

- Develop a web scraper scrapping 3 different web sites (these sites will be provided once the freelancer selected)

- Load HTML pages into a collection [url removed, login to view] class (Object Oriented programming, class to be developed)

- Load the Activity objects into a MySQL database via an [url removed, login to view] object

- When loading the content in the database, the code will have to check if a similar activity name already exists in the database for this city.

If the activitiy already exists, from the same website, the existing entry is updated

If the activity already exists, from another website, a new entry is created by it is linked to the existing one

If no matching name is found, a new entry is created.

- IMPORTANT note: the scraper MUST respect the [url removed, login to view] policy of the website. If the [url removed, login to view] of the provide websites prevent from doing this project, we will provide you alternative websites

- Pictures will be downloaded into a local folder (the URL to this folder will be loaded in the database)

- Build a simple HTML page to test the crawler. The HTML page will allow the tester to do the following things:

1. Select on of the 3 web sites

2. Manually enter the name of a city

3. The page will build the corresponding URL and start scarping it and loading in the database

- The source code will have to be commented

Technologies:

- Programming language: PHP 5.5.3

No PHP framework is authorized on this project, only standard PHP function and packages have to be used.

Programming must be object oriented.

PDO must be used for data access layer.

- Database : MySQL 5.5

- The deliverables will be tested using a MAMP apache and mysql installation on a Mac OS X environment

The developer will be provided with:

- a graphical datamodel

- an SQL file to create the corresponding data structure

- the URL of the 3 web sites to scrap

The project will consist in 3 steps, which will divide the payment:

- Delivery of the scraper + loading in the database for the 1st website : 50%

- Delivery of the scraper + loading in the database for the 2nd website: 25%

- Delivery of the scraper + loading in the database for the 3rd website: 25%

Good luck!

技能: 数据输入, Excel, 网页搜罗

查看更多: scrap, web scrap, we develop websites, websites develop, websites created by freelancer, website for page managers, web scrapper freelancer, web scarping, web programming using php, web programming technologies, web programming by php, web page scrapping, web object oriented programming, web develop freelancer, web developer os, web developer local, web developer freelancer sites, web developer for mac, web developer collection, web crawler developer, web build freelancer, web 2.0 programming language, tester it freelancer, steps to develop website, sql programming language

About the Employer:
( 0 reviews ) Malaysia

项目ID: #5938544

9名威客为此工作的平均竞标价是$296

SigmaVisual

Dear Client, I can help in your project. We have already experience of working on similar projects. Please see below to get idea of our experience: Amazon/Ebay Bots: [url removed, login to view] 更多

$210 USD 在5天内
(53条评论)
6.6
uumairkhalid

Hi.. Expert Web Scraper & Data Minor here. I have done too many similar project in past. Having best scraping tools and experience i assure you 100% accurate and good quality work. I have too too scraping experience. 更多

$263 USD 在3天内
(108条评论)
6.4
mhmhz

Hi I know you asked for PHP solution. But i like to give you alternative solution in C# as a desktop application if you are interested. Thanks

$631 USD 在6天内
(38条评论)
6.1
Ameba871117

i have much experience about php, web scrape. pls tell me your site url that u want, then i will work for u immediately. thx.

$147 USD 在3天内
(8条评论)
3.5
VnBestSolutions

Dear Sir, We claim to get it done perfectly for you EXACTLY in the way you want it - Kindly give we a chance and we will prove myself - Ready to prove our words, let's get it done right away and I mean RIGHT AWAY !! 更多

$568 USD 在10天内
(5条评论)
3.2
SuiGenSolutions

Hi, We are a team of developers proficient in web development and web scraping. We have completed similar projects of web scraping before with 100% client satisfaction. Our scraping portfolio includes [url removed, login to view], Ye 更多

$200 USD 在5天内
(2条评论)
1.8
rubenrizzi

Thanks for the opportunity to bid for this interesting project. I have been programming professionally for the last five years as a freelancer, and have also completed a three year full-time experience as a programm 更多

$198 USD 在3天内
(1条评论)
0.0
PaulAdams1993

I have been actively involve in making some awsome and cool websites and app for windows... well you can see some of the sites that i have made till now :....Some of them are: [url removed, login to view] 更多

$333 USD 在7天内
(0条评论)
0.0
ashrafulislam635

dear sir i have lot of experience on Data Entry, Excel, Web Scraping .after finishing when you will get your job then understood how kind worker your faithful worker

$111 USD 在3天内
(0条评论)
0.0