How to "scrape" HTML and display it on your own site?

[thumbsucker]

Anyone know the easiest way to "scrape" the HTML from another site and display it in your own?

[lemkepf]

Don't. It's called stealing. Don't be a ******.



p.s. this stuff really pisses me off.

[thumbsucker]

Don't be stupid.  It's legal when it's a government data source, which by law can't be copyrighted.  Get a clue. 

[lemkepf]

You also have to realize that 99% of people wanting to do this are people trying to steal content. I've been a victim twice. I've also had clients that have been victims. It's a nasty battle to try and get that content taken down ....

Anyways, to answer your question... you can use a linux command "wget".

Code: Select all

wget -r --progress=binary -w1 -Q1000m -v -t3 -nH -np -k -l10 -Dwww.yoursite.com http://www.yoursite/index.html