Hi,
My name is Eduardo, I'm from Brail, I don't speak English, that's why I'm using Google Translator.
I am looking for a professional who can build a web crawler to monitor more than 50 thousand news sites (portals and blogs in Brazil) daily and store on my server only news that have certain keywords, I need to store the news title, news date and the news text.
I currently have servers on Amazon (AWS), I would like to keep all infrastructure on AWS.
I would like an idea of how many servers I would need on AWS to support this demand.
I also need to know if for each of the monitored sites, I need to manually "map" so that I can extract the date, title and text of the news, or if that would be automatic.
And finally, an idea of the value of this JOB for you to build and, if necessary, keep a support with me.
Thanks
Dear Sir,
I am an electrical engineer with 20 years of experience in this area .
I have made few crawlers starting in year 1999 that even worked on a 56kbps internet connection.
I know how to do this very efficiently.
I am interested in your project : Web Crawler
Please send me a private chat message.
Hi Eduardo,
I hope you are doing great.
we will develop web crawler to monitor more than 50 thousand news sites (portals and blogs in Brazil) daily and store on your server only news that has certain keywords.
Ping us via freelancer chat box and provide us lists of the website and all the details so that we can discuss all the details of the project with you in a brief along with our queries, development process, development time and take this project to the development stage.
Regards
Sam
Hello Eduardo,
I am glad to share that we have expertise in creating a web crawler. Please connect me over chat so that we can discuss it in detail. After that, I'd be able to provide you my professional assistance to have an idea of how many servers you need to support this demand, and complete support to add more value to this project.
Let's get started. I am a senior full-stack developer, ready to look into it right away
Many thanks
Amat