Scrape a URL (http request) a specific website searches (need in javascript - nodejs)
R$30-90 BRL
货到付款
Well, I had a working version to scrape the URL I am looking for with phantomJS (using async, await), but the website changed the backend and I got stuck...
Here is the story:
When I access a specific website address, it makes an HTTPS Request to another website using a specific key. Each time the first website is accessed it changes the key randomly, and thus the HTTPS Request.
I need to grab this HTTPS Request URL with NodeJS.
I can get easily get the desired URL via Chrome DevTools (Network/XHR).
Summary:
. I will need a printscreen of the website (to make sure you got the new version, that I got stuck with);
. I will need a simple [login to view URL] that I can run and outputs me ([login to view URL]) this specific URL.
项目ID： #16475595
关于项目
授予：
I have experience with both nodejs and web scraping so I can surely help you with this project. I have solved a similar problem before where a site was trying to prevent automation.
有4名威客正在参与此工作的竞标，均价R$72/小时
Hi, I have very good experience in web scraping using Python and Node.js. I have gone through your requirements and can quickly create a script in node.js to return that https url. Looking forward to hear from 更多
Hello, I can analyse the website and all it's requests and follow each request till i get the source of the random key .
