create tool / script to scrape similarweb estimated visits of 1,000s of websites a month. Avoiding the API costs

已关闭

Hello

I currently use SimilarWebs chrome plugin to tell me manually how many visitors websites get each month. I need to scale and automate this process. I could use the similarweb API but they're expensive so I am looking at other options.

I need a tool or script to be able to enter 100s/1000s websites at a time and for it to fetch/find SimilarWebs data on them:

1- Estimated Visits - 100% needed

but if possible I would also like the following values from the chrome plug in

2- the past 6 months of estimated visits - this will enable me to average the data for a better estimate.

3 - The rank of the website within its county

4 - the sector its in, and the rank within its sector - something Similar Web does very well.

NOTES

Need to be careful of high volume of traffic coming from one location, but I am sure this is something that can be done. We could either have a script that visits the [url removed, login to view] website and enters each site, then finds and copies the relevant data into a excel/csv file. Or do the same process from the website direct, using the similarweb plug in. Go to site, click plug in, see and copy data. Both would in theory work.

I would likely do this for 3,000 websites a month to start.

I am interested in hearing about your experihence and how you could build me a tool to do this.

Thanks

Scott

技能: 数据挖掘, Excel, PHP, 网页搜罗

查看更多: bing api search engine php script, usps api shipping label generation script, api based search site script, websites twitter api, usps api php tracking code script, sample websites paypal api integration, month payment deducted automatically paypal account php script, freelance websites affiliate api, ebay api add item php script, betfair api costs, keyword tool api costs, weather api costs, google maps api costs, foreca api costs, comparison websites work api, highscore flash api costs

项目ID: #12019220

已悬赏给:

Michael91B

Hi, I have reviewed similarweb.com website. I test it with my script and I could easily extract estimated visits, rank within its country, sector and sector rank. And I could probably figure out how to get the past 更多

$280 USD 在7天内
(8条评论)
3.7

8名威客为此工作的平均竞标价是$381

PigtailXL

Hello Sr. I'm Jorge from Argentina, a responsible person who have wide experience working building solutions to automate lot of processes and tasks. I've experience working with WinAutomation since last 2/3 years. L 更多

$380 USD 在5天内
(134条评论)
6.7
SBITServices

Hello Scott, I have read your description and can complete in 4 days and agree that I can complete tasks with high quality and consistency.We are the best team(8 people) within your budget to complete this project quic 更多

$250 USD 在4天内
(110条评论)
6.4
dpune

Hi, I have more than 14 years of Excel/VBA exp and I can build similar tool in excel which can scrpe data from the website as required. I have completed more than 290 projects. Please look at the feedback le 更多

$500 USD 在10天内
(136条评论)
6.3
mwarrenschultz

Hello! I am a professional programmer with many years of experience using Python. I have read your project description, and I can create the SimilarWeb Automation program you require. To do so, I will use the libraries 更多

$333 USD 在10天内
(41条评论)
6.2
RubyOnRail

Hi,I have gone through your project description. I could be confident if we can proceed towards more discussion. I am an individual developer and you will be working directly with me if we proceed work on this project 更多

$777 USD 在15天内
(5条评论)
5.5
narsim3128

With respect to this project I would like to present myself as a candidate for your consideration. I have more than 6 years of experience. I have successfully completed few projects for US clients which involved web sc 更多

$250 USD 在7天内
(16条评论)
3.6
$277 USD 在10天内
(2条评论)
2.4