I don’t know much about lynx. I didn’t even know it was still alive or ran on mac. You could just use curl to do http.
I’ll look into spider monkey and rhino. Thanks again.
If you’re just looking to scrape HTML, you might say a bit more about what you’re actually trying to obtain. The AppleScript language itself isn’t well suited to parsing HTML due to its poor native text processing facilities and lack of libraries, but many other scripting languages provide powerful tools for this kind of work.
For example, BeautifulSoup for Python is very good at dealing with messy real-world markup. You could write that portion of your script in Python and then call it from AppleScript, either via ‘do shell script’ or by packaging it as a scriptable FBA (see the aemreceive/sfba package included in Appscript Installer).
If you really want to stick with AppleScript only, you could pipe your source HTML through HTMLTidy to convert it to XHTML, then load the result into System Events’ XML Suite where you can crawl through it using AppleScript. Or you might consider using a commercial AppleScriptable webscraping application such as Anthracite.
Great, you rock hhas! Thanks so much.