This is Version 2 of wsp.pl. Usage: wsp.pl [-a] [-p proxy] [-c client-certif] [port] port defaults to 5364 - preferably run in an initially empty directory - preferably direct stdout to a file - it might be useful to run "tail -f" on this file in another window during your browsing session In your Web browser: Empty caches Clear cookies Set proxy to host:5364 Set secure proxy to host:5364 Browse the site that you want to scrape The output of wsp.pl will be a transcript of the pages visited, with Perl code emitted for GET and POST. It also tells about cookies and saves copies of Web pages that look interesting. Optional argument -a causes it to save all pages. When browsing HTTPS sites, the browser will complain about having a certificate from the Proxy instead of the destination site. You must accept this certificate. For wsp.pl to use a proxy for its requests, use the -p flag. Specify the proxy as hostname:port. Do NOT prepend http://. For wsp.pl to use a client certificate, use the -c flag. Wsp.pl should be used by a single user at a time. If wsp.pl complains that the port is in use, pick some other port number and try again. Bugs: Wsp.pl does not recover from aborted browser requests. Do not press stop. Do not load another page until the current page loads completely. If you are browsing HTTPS sites, do not use a symbolic link to wsp.pl. Either give the full pathname for wsp.pl or make sure that its directory is in your shell search path. Installation: Openssl (www.openssl.org) must be installed for the HTTPS proxy to work. The following Perl libraries must be installed: URI libnet MIME-Base64 Net-FTP-Commo libwww-perl Net_SSLeay.pm Crypt-SSLeay (version 0.19 for HTTPS proxy and certificates)