发布项目

Authenticated website listings scraper & file downloaders

已关闭已发布的 5 年前货到付款

$30-250 USD

货到付款

已关闭货到付款

Looking for a Go developer to create a scraper for 3 websites:

1: login & download excel -> extract rows and send to DB

2: login & download csv -> send to DB

3: login & scrape listings (3 pages):

a) paginated listing page

b) listing admin page

c) listing public page

d) send to DB

Scraper should be 3 Go packages, one for each website. Each package should have:

a) an interface to start/stop

b) detect failure (connection & html format change)

c) configurable retry on connection fail (retry max X times, every Y seconds)

d) delay of X seconds between page requests

e) concurrent listing data export interface

The projects must be developed in the Go programming language.

Golang 网页搜罗

项目ID： #17319885

关于项目

6个方案远程项目活跃的5 年前

想要赚钱吗？

在Freelancer上竞标的好处

设置你的预算和时间表

通过工作获取报酬

大致描述您的提案

免费注册并竞标工作

有6名威客正在参与此工作的竞标，均价$213/小时

mhmhz

Hi I propose to implement the 3 scrapers in C# (to make it multi-threading) Thanks

$300 USD 在2天内

(98条评论)

7.6

bestit4u

Hi I am very,very interested in your project My name is Shan Bin and I'm a Chinese developer. I have 6 years of development experience such this projects. I am a highly skilled developer in C, C++, C#, Python, Java, 更多

$155 USD 在3天内

(70条评论)

6.8

kenavpatel

1) I am confident to extract the row in Excel and send to the DB 2) also can do CSV and send to DB. 3) 3 pages which you have mentioned will also get scrapped. it is easy for me And Scrapping will be done as you have 更多

$200 USD 在2天内

(0条评论)

0.0

akhileshgandhi

Hello There, I can develop a scraper for scraping data from different websites. Can also show some samples of your given task. I have extreme experience in Web Scraping. Have done a lot of work of Scrapping. I use 更多

$248 USD 在3天内