EXPERT WEB SCRAPING - ONLY SCRAPING SPECIALIST

已关闭 已发布的 5 年前 货到付款
已关闭 货到付款

We need an application hosted in windows server, that can scrap web pages and recollect data, the detail of the project are on the word document attached, please only need EXPERT ON WEB SCRAPING tasks.

Technology Stack

1. Web driver or html class

2. Language programming: C#

3. .Net Framework : 4.5.2 or netcore 2.0

4. Project type: Console Application

Goal: Change our current .net console application, that reads Vehicles"e-commerce" web pages, where each web page has a list of cars ( with web pagination ), and try to get the url detail page for each car.

Milestones

1. FreeLancer create the demo scrapping application using an example scrapping feed file provided by us, this demo contains and "GENERIC ALGORITHM" to get one field form the web pages, this field is called "Vehicle detail page url". The entire universe are more than 150 000 web pages to scrap, and all have different structure.

2. FreeLancer test the application using the 1 scrapping file and will be success if the result has more than 75% url found match

3. David review the Scrapping result file and the FreeLancer explain in generic mode to David the GENERIC ALGORITHM" implemented

4. David send 3 scrapping feed files more to test the application

5. David Approve or rejected the project according with the result on step 4

6. David pay to FreeLancer for the source code depend on the step 5

Description: See attached image on the last page

1. The VDP Scrapping console read the “scrapping feed file” text, this file contains 6 columns , with PIPE delimiter:

- Vin (required) : is the vin number of the car

- StockNumber (required) : is the stock number of the car

- IsNew: is an indicator that say if we have to use the USED url or NEW url field

- Used url (required) : Is the main url of the dealer for used cars

- New url (required) : Is the main url of the dealer for new cars

** Vdp url: is the vehicle detail page url, where show all information of one vehicle.

.NET ASP.NET C# 编程 软件构架 网页搜罗

项目ID: #18618112

关于项目

6个方案 远程项目 活跃的5 年前

有6名威客正在参与此工作的竞标,均价$318/小时

aaankur81

Hi, i have 7+ years of experience with C#, python, ROR and scrapping, i have scrapped more then 1000 websites, apps till now. i have worked on variety of projects including, per sec data update even.. i have wr 更多

$800 AUD 在3天内
(22条评论)
5.9
Nidhijain123

Hello, I am a expert in C# I have read and understood what has to be done in this task. I have sound experience in performing such kind of work as I have done lot of project of similar kind in the past. I think 更多

$250 AUD 在3天内
(18条评论)
5.2
lalitkaushik

We are a web developing and designing company with various other facilities such as web content and digital marketing related to all types of specializations. Additional considerations and implementations are assisted 更多

$277 AUD 在7天内
(1条评论)
0.0