Hello!
Your project has piqued my interest particularity because of its web-crawling nature. Many of my most recent projects have been involved in scraping and parsing data from various websites and I have taken a particular liking to the work. For your specific project, I have envisioned a design that I hope will meet your specifications through the utilization of (a fair share of common sense) and the following libraries:
- Requests (For requesting the content of a webpage (i.e Google's search page)
- LXML (For the crawling and scraping of search results and content)
- Multiprocessing (For running multiple scraping requests in parallel)
Additionally, although presently I do not have any stars or ratings, please don't let that diminish your consideration. Despite being new to the site, over the past five years I have worked on building my experience in software programming and on numerous projects, primarily specializing in the languages of Python, C, C++.
Thank you for your time and consideration,
Cheers!