cURL problems...

Scripting Forums AppleScript Studio & Xcode
#1

I have this code:

set thiscontent to do shell script "cURL " & “http://www.msnbc.com”
log thiscontent

this is what I get posted to my log:

2008-12-11 08:40:08.789 RSSparser[10216:10b] “”

however:

set thiscontent to do shell script “cURL " & http://www.netscape.com”
log thiscontent

returns this:

2008-12-11 08:43:25.194 RSSparser[10250:10b] "

301 Moved Permanently

Moved Permanently

The document has moved here.

"

is it possible for a web site to block curl queries (if that’s the right term)?

#2

Some websites filter and block by user agents, but that’s not happening with your script. If you add the follow redirects flag -L as I suggested in your last thread you’ll get the desired html.

set thiscontent to do shell script "cURL  -L " & "http://www.msnbc.com"
log thiscontent

John M