Data scrape, Auto Input into Database

已关闭 已发布的 7 年前 货到付款
已关闭 货到付款

I have data that I want to place in an online database. The data is a numerical figure associated with each country in the world and a date (ie. 20161026 Canada 3.2345). I have the historical data from 2013 to present for all countries.

I need to pull the daily figures from another database through a query each day. I do not have direct access to query the database but after doing the query (usually 1-6 hours after submitting the query) I will receive an email with a link (unique/generated url) to download the file. I need to conduct 5 daily searches. It is a very simply query search. Unfortunately, the service will only allow you to conduct one query at a time (per email address).

This project has 3 main components.

1) I need a way to automatically query the database 5 times. The query form has the following entry fields;

-Email Address [location where the download link will be sent]

-Date Range [Start Date & End Date with 08/26/2016 format]

-Include ALL OF [Keyword Search Criteria: this will be a single word]

-Include AT LEAST ONE OF [Keyword Search Criteria: this will be a large set of terms]

-Intensity Weighting [radio button that is defaulted to the correct selection]

2) Once the queries are submitted I need to have that data added (appended) to our database online. The csv files will all have three columns with no headers.

COLUMN 1: Date. The date field in the database is sent as "20161026."

COLUMN 2: Country. The country field contains the name of each country

COLUMN 3: Numerical Score: This is the calculated score that we plot each day for each country

EXAMPLE

20161025 Algeria 7.354184277

20161025 Albania 1.138519924

3) I need a graphical interface/plugin that can show realtime data from the database as simple single line graphs to coplex comparison graphs.

So, as you can see, I am looking for a way to "automate" the process of dumping the daily data into a database and having that data shown on our site.

NOTE: We are using a godaddy shared server

Let me know if this is something you can do. The budget for the entire project is $50-$75 MAX

Big Data Sales 数据挖掘 数据库编程

项目ID: #11922153

关于项目

9个方案 远程项目 活跃的7 年前

有9名威客正在参与此工作的竞标,均价$61/小时

mantislin

Dear sir, I am scraping expert, I have did too many scraping projects, please check my reviews then you will know. Can you tell me more details? then I will provide example data/script for you. Thanks, 更多

$63 USD 在2天内
(160条评论)
7.2
bestfreelancer52

Hello Web scraping and data mining expert is here .I have done many similar scraping projects similar as website which you mentioned on description.I am able to complete your project at lower rate and quality result t 更多

$55 USD 在10天内
(41条评论)
6.3
rrgindore

Dear sir please initiate the conversation for better understanding regards amit

$83 USD 在3天内
(1条评论)
2.4
samiub09

A proposal has not yet been provided

$30 USD 在10天内
(0条评论)
0.0
MANOJGEEK

Hello, Its me.. Manoj, Thank you for considering us for this exciting project. Having 3+ year Experience in SQL databases, MSBI and .NET(C#). Currently I'm working with bangalore-based company and handling centralized 更多

$75 USD 在10天内
(0条评论)
0.0
vl16vaidya

Please give me a chance to work on this project as I've relevant knowledge and experience abt this work. You can text me via chat. Thank you. Awaiting your reply.

$50 USD 在3天内
(0条评论)
0.8