Write some Software

php web scraping expert needed.

Scrap a website bypassing interstitial first ad page.

Curl is not longer working with cookies.

The real target URL will be provided later. Here is an example.

$target_url = '[login to view URL]';

$user_agent = 'Mozilla/5.0 (Windows NT 5.1; rv:28.0) Gecko/20100101 Firefox/28.0';

$ch = curl_init();

curl_setopt($ch, CURLOPT_USERAGENT, $userAgent);

curl_setopt($ch, CURLOPT_URL,$target_url);

curl_setopt($ch, CURLOPT_FAILONERROR, true);

curl_setopt($ch, CURLOPT_AUTOREFERER, true);

curl_setopt($ch, CURLOPT_RETURNTRANSFER,true);

curl_setopt($ch, CURLOPT_TIMEOUT, 3);

$ckfile = tempnam ("/tmp", "CURLCOOKIE");

curl_setopt ($ch, CURLOPT_COOKIEJAR, $ckfile);

$output = curl_exec ($ch);

echo $output;

The current server settings will not allow to use CURLOPT_FOLLOWLOCATION

curl_setopt($ch, CURLOPT_FOLLOWLOCATION, true);

PHP 软件构架

项目ID： #5728680

关于项目