cURL - works in browser, not in cURL

Question

I have been struggling for almost three days now on this task, and I guess I am missing on some basic cURL skills. I start with: In the F12 of IE I see 2 POSTs on the first page: (I notice the first one is getting a 302 which is supposed to be a redirect, and with cURL I only get 200) Filling up the captcha: on the second page (after captcha): traffic: This is my code (and I cannot move on with it because it doesn't work for the early stages): I Built a special form that submits to my own page with `GET` (with the cURL) which in turn is accessing the website: ``` $id=$_GET['id']; // getting the biznumber $humanCode=$_GET['nobot']; $curl = curl_init(); curl_setopt ($curl, CURLOPT_URL, "https://www.*******.******.***"); // setting some https to be able to access the website from my local computer. curl_setopt($curl, CURLOPT_SSL_VERIFYPEER, true); curl_setopt($curl, CURLOPT_SSL_VERIFYHOST, 2); curl_setopt($curl, CURLOPT_CAINFO, "c:/xampp/htdocs/CAcerts/curl-ca-bundle.crt"); // I know the…

Accepted Answer

Problem solved. It was a matter of using the correct headers. Following the reports from the browser, I went through all steps and the result showed up.

I went through each step by using:

```
curl_init
curl_setopt()
..
curl_setopt()
curl_exec()
curl_close()
```

This way I had to manually set each request and go through the settings. It made the code longer, but much easier to understand.

I had thoughts about the site using some javascript special code to make the site work, so I was troubled a lot by all the extra, javascript code, which turned out unnecessary.

It was all about being alot more organized and following the correct header settings.

Moreover, since this was an `ASPX` site, I had to read and memorize the `VIEWSTATE` and `VALIDATION` of the last page in each iteration. That is the first and very reason for the 500 internal error server message I used to get all the time.

I used Firebug and LiveHttpHeaders to concolude each step.

cURL - works in browser, not in cURL

Solution

Problem