Find Jobs
Hire Freelancers

Develop website scraping code

$750-1500 USD

已取消
已发布超过 10 年前

$750-1500 USD

货到付款
I need to develop code that can be placed on a server to scrape information from a website. The website is a public site which posts energy prices. Specifically, it is www.newyorkpowertochoose.com. I all providers and other fields to be scrapped from the website in regular intervals (e.g. every 6 hours, every day) and placed into a MS SQL Server database. The website requests specific zip codes to provide information on pricing. I will provide approximately 16 target zipcodes. Each scrub would take all information for all specified zip codes at the interval specified. The data sought form the site includes: - Service Type (Electricity or Gas)* - Zip Code* - Utility Name* - Supplier Name - Rate Type (Fixed or Variable) - Rate (Numeric Only) - Green Offer (Yes/No) - Minimum Term (Months Only) - Cancellation Fee (Numeric Only) - Cancellation Fee Text (used only when qualifying text is present) - Comments (Text) - Date/Time Stamp of Scrub Lastly, I would also like to have an image of the page scrubbed saved in an image file. I will provide the Microsoft SQL Server database IP address and login credentials, a directory to save the page images, and the zip codes to be used for each scrub (you can use 10003 as a test zip code). I need a way to adjust the scrub increment (e.g. days / every 6 hours) and the zip codes in the future if necessary. This adjusting mechanism doesn’t need to be sophisticated it only needs to be able to be done quickly and efficiently. To be specific, I am reasonably tech savvy and could go into the code and adjust it if it’s only located in one or two places though a database driven interval and zip code table might work best. To help ensure we remain aligned throughout the development process, I propose the following gates, but I am open to your input: Phase 1: Developer Review Target Site & Verify Feasibility of Scrubs (each service type, each zip code, at specified intervals) Phase 2: Agree on Target Database Structure Phase 3: Test Single Scrub (1 zip code) with input sent to target Microsoft SQL Server database & page image sent to specified directory Phase 4: Full Scrub Code Finalized The budget is moderately flexible. I am willing to pay a reasonable price to get it done right, in a timely manner, and by a reliable coder with whom I could do business with in the future but without overpaying. I am estimating this project to be in the "Very Small" to "Small" category ($250-$1500 USD) but please indicate if you feel reasonable compensation should be higher or lower. I will consider all reasonable bids.
项目 ID: 4940532

关于此项目

7提案
远程项目
活跃11 年前

想赚点钱吗?

在Freelancer上竞价的好处

设定您的预算和时间范围
为您的工作获得报酬
简要概述您的提案
免费注册和竞标工作
7威客以平均价$980 USD来参与此工作竞价
用户头像
Hi.. Expert web scraper/Data Minor here. Interested in your project. I assure you 100% accurate and good quality work. Ready to start. have a look at PM. Regards
$947 USD 在3天之内
4.9 (40条评论)
5.6
5.6
用户头像
Hi, I already finished few such projects.
$750 USD 在3天之内
4.5 (4条评论)
3.7
3.7
用户头像
Let me discuss on the project , please do consider us.
$1,100 USD 在15天之内
5.0 (1条评论)
3.0
3.0
用户头像
Hi, Please check PM. Thanks
$1,250 USD 在30天之内
0.0 (0条评论)
0.0
0.0
用户头像
php/mysql/ajax team
$789 USD 在5天之内
0.0 (0条评论)
0.0
0.0
用户头像
Client is always right as we believe. Expert in PHP, Wordpress Script Install, Software Development, Web Scraping, Website Design, web scraping with more than 10+years experience and day by day updated ourselves with latest Technology. we are ISO 9001-2008 esteemed company. we have done similar work if you choose me I can start instantly. kindly ,Regards,
$777 USD 在10天之内
0.0 (0条评论)
0.0
0.0

关于客户

UNITED STATES的国旗
New York, United States
5.0
1
付款方式已验证
会员自9月 18, 2013起

客户认证

谢谢!我们已通过电子邮件向您发送了索取免费积分的链接。
发送电子邮件时出现问题。请再试一次。
已注册用户 发布工作总数
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
加载预览
授予地理位置权限。
您的登录会话已过期而且您已经登出,请再次登录。