command line questions

Post Reply New Topic

If I use the "Run..." command and type in

I can have Google bring up search results on autism. Now here's the question: What's the code for saving pages? I'd like to know because I want Task Scheduler to save webpages for me at night.

Two things that you might be interested in...

1. You should be able to run a command line to web page directly.

ie: Start, Run,
http://www.google.com/search?source=ig& ... =&q=autism

2. More importantly, you can get google to do your searches for you and email you a daily list of topics using Google Alert. This seems like what you want to do.

Go to ...

http://www.google.com/alerts?hl=en

and set it up there.

That's a good idea, but what do I do about the other websites I want to save?

Do you mean other searches you want to do or do you mean that you want a method of copying websites offline?

There's some tools that do this some free and others not.
This one isn't free but seems good.
http://www.internet-soft.com/extractor.htm

Personally, I use Adobe Acrobat because it copies the whole site down into a PDF. Of course it doesn't preserve everything perfectly

there is a linux/unix/mac program called wget that does web downloading and supports "mirroring" a whole website. (and probably has been ported to windows)

See http://www.jim.roberts.net/articles/wget.html

Thank you so much. I've downloaded the newest Windows version from http://xoomer.alice.it/hherold/ and I've put the files in C:\Program Files\wget. In the Run command I type in

and it works really well. However, there's one webpage, http://americasmusiccharts.com/index.cgi?fmt=A2, that I'd like to save. The problem is, it doesn't recognize the format, so it always uses the text "cgi@fmt=A2" (the last piece of the URL) as the extension. After it's done saving, I am able to change the extension to htm or html to solve the problem, but I don't know whether it's recommended to do it that way. Is there a command line option to specify the file type as it's saving? Also, is there a command line option to have it keep the images with the page?

DownThemAll has some nice features

Changing the file ending to .htm or .html will "work" in some sense, but isn't really the best way to do it.

Try adding "-E" to the command line (without quotes), here's the wget manual describing the options:

http://www.delorie.com/gnu/docs/wget/wget_9.html

Thank you. I have just one final question: If you're using dial-up and you're not connected to the Internet, is there a way you can command Wget (or any other program, like Internet Explorer) to log on and dial for you?

I know there's the "rasdial" command that's part of windows, but really, I don't know anything about how to use it.

http://www.microsoft.com/resources/docu ... x?mfr=true

Wow, that looks excellent!
Thanks for posting that.

Ok, I've only just tried it out. It's pretty good.

I didn't expect to have to save each page of a website one by one though.
Is there a way round this - some other command?

Or simply a quicker way of doing it ...
Like, is there a way you can list all the sub-addresses of a particular website, stick the list in a text file, and then type one command that reads the list in the text file, mirroring each page one by one?

I don't know a way to do it based on a list of webpages to download (except to write a script to reinvoke wget over and over again) but wget has a lot of built in options to automatically walk through a site and download all the pages at once. See:

http://www.gnu.org/software/wget/manual/wget.html#Recursive-Download

For that, use:

--input-file=filename