[ale] Grabbing a dynamic website automatically?
Geoffrey
esoteric at 3times25.net
Thu Aug 22 09:43:10 EDT 2002
You can fire up your browser from a cron script. There are remote
commands for Netscape, although I don't know what browser youre using or
if other browsers permit such remote executions. I used to load pages
for some sights for my wife in the middle of the night and print them
out using the Netscape remote commands. Saved me getting up early to do
it before she went to work.
johncole at mindspring.com wrote:
> Howdy all!
>
> What would be the best way to grab the data off of a website that is dynamic,
> HTTPS, and has cookies enabled.? I'm trying to capture a single page everyday
> from a particular website automatically.
>
> (in particular I'm using Redhat 7.2)
>
> I need the page back in text format preferably (or I can convert it to text
> later as needed for insertion into a database.)
>
> Thanks,
> John
>
> ---
> This message has been sent through the ALE general discussion list.
> See http://www.ale.org/mailing-lists.shtml for more info. Problems should be
> sent to listmaster at ale dot org.
>
>
--
Until later: Geoffrey esoteric at 3times25.net
I didn't have to buy my radio from a specific company to listen
to FM, why doesn't that apply to the Internet (anymore...)?
---
This message has been sent through the ALE general discussion list.
See http://www.ale.org/mailing-lists.shtml for more info. Problems should be
sent to listmaster at ale dot org.
More information about the Ale
mailing list