Find Jobs
Hire Freelancers

Serach Engine URL Scraper

$30-100 USD

已取消
已发布超过 18 年前

$30-100 USD

货到付款
I need a tool that will scrape the urls from google search results pages, and write these urls to a text file. I am envisaging a php, server based solution, however I am open to other options if you belive they are more feasable. The starting page should have space to enter the search term and to specify how many results (or results pages) to collect. Any search terms can be entered into this box and submitted. These search terms determine which urls the script will collect from google. For example, if the following is entered into the text box: "Send an Email to the Forum Administrator Contact Us" The script should collect the url, complete with http:// from the page below, as well all subsequent pages until X number of urls have been collected. [login to view URL] When this process is completed, there should be a list of around 59,000 urls. Note the num=100 in the url gets google to display 100 results per page. Note how the url changes as subsequent pages of results are viewed. Google will place a temp block on a ip if too many requests are made in a certain time period. So there must be support for proxy servers built into the script. The urls should be written to a txt file with one per line. If you feel this may be a performace issue when the list gets big, I welcome suggestions e.g. 1000 per file, or even using mysql. Other Points ============= 1. Code should be commented. 2. Installation instructions should be given. Any questions let me know. ## Deliverables 1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables): a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment. b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request. 3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement). ## Platform Any. I prefer a php server based solution. But will consider other scripting languages.
项目 ID: 3164359

关于此项目

9提案
远程项目
活跃18 年前

想赚点钱吗?

在Freelancer上竞价的好处

设定您的预算和时间范围
为您的工作获得报酬
简要概述您的提案
免费注册和竞标工作
9威客以平均价$61 USD来参与此工作竞价
用户头像
See private message.
$85 USD 在7天之内
4.9 (105条评论)
7.3
7.3
用户头像
See private message.
$85 USD 在7天之内
5.0 (226条评论)
7.2
7.2
用户头像
See private message.
$51 USD 在7天之内
5.0 (69条评论)
5.5
5.5
用户头像
See private message.
$42.50 USD 在7天之内
5.0 (32条评论)
4.5
4.5
用户头像
See private message.
$85 USD 在7天之内
4.2 (19条评论)
4.5
4.5
用户头像
See private message.
$76.50 USD 在7天之内
5.0 (4条评论)
3.9
3.9
用户头像
See private message.
$22.10 USD 在7天之内
4.8 (9条评论)
3.0
3.0
用户头像
See private message.
$85 USD 在7天之内
0.0 (1条评论)
0.0
0.0
用户头像
See private message.
$12.75 USD 在7天之内
0.0 (0条评论)
0.0
0.0

关于客户

的国旗
5.0
2
会员自12月 7, 2006起

客户认证

谢谢!我们已通过电子邮件向您发送了索取免费积分的链接。
发送电子邮件时出现问题。请再试一次。
已注册用户 发布工作总数
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
加载预览
授予地理位置权限。
您的登录会话已过期而且您已经登出,请再次登录。