IT DEVELOPER/ WEB BOT
$250-750 USD
货到付款
We are a web design company in the U.S. We are interested in targeting companies in the U.S. that could benefit from our web design services. We intend to target these companies and contact them via email using our own dedicated servers. We currently have a database which contains raw data of 50,000 companies with email addresses, telephone numbers and websites. Fifty percent (50%) of the companies in this database DO NOT have active websites. Essentially, we wish to target ONLY those companies in our database that have ACTIVE websites, and which have been recently the subject of SEO promotional efforts. Accordingly, we are looking for a consultant who can create a program (or tool/WEB BOT) to essentially crawl through our database comprised of thousands of early companies with registered domain names.
We need this tool to (i) identify which companies (in the database) have active websites, and (ii) which websites are being promoted using SEO techniques. One way to determine which sites are being SEO promoted would be to identify those sites that contain inbound backlinks---a common technique used by SEO companies to drive traffic to a client site.
Our database currently contains 50,000 records and growing (i.e. company websites, emails, telephone numbers, street addresses).
项目ID: #16556784
关于项目
有13名威客正在参与此工作的竞标,均价$527/小时
Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database 更多
oki i can do your work don't worry about anything i will start now and will complete soon i need more Description
Hi. My name is Oleg and I am senior .NET software developer from Ukraine. Please contact to discuss details regarding the project. Need to see your database. As far as I get it you already have domain names in databa 更多
Hello mate, I have over 5 year experience in Microsoft technologies, after reading your instruction, it looks an interesting idea, we I already develop a similar web bot from which I can extract the content of any part 更多
Using your database, I will use scrappy to check if the website exists first and then crawl through the websites to collect the data needed.