How to skip selected url while mirroring site with wget

Question

I have the following problem. I need to mirror password protected site. Sounds like simple task: ``` wget -m -k -K -E --cookies=on --keep-session-cookies --load-cookies=myCookies.txt http://mysite.com ``` in myCookies.txt I am keeping proper session cookie. This works until wget come accross logout page - then session is invalidated and, effectively, further mirroring is usless. W tried to add `--reject` option, but it works only with file types - I can block only html file download or swf file download, I can't say ``` --reject http://mysite.com/*.php?type=Logout* ``` Any ideas how to skip certain URLs in wget? Maybe there is other tool that can do the job (must work on MS Windows).

Accepted Answer

What if you first download (or even just `touch`) the logout page, and then

```
wget --no-clobber --your-original-arguments
```

This should skip the logout page, as it has already been downloaded

(Disclaimer: I didn't try this myself)

How to skip selected url while mirroring site with wget

Solution

Problem