Page 1 of 1
How to "scrape" HTML and display it on your own site?
Posted: Tue Mar 07, 2006 9:29 pm
by thumbsucker
Anyone know the easiest way to "scrape" the HTML from another site and display it in your own?
Re: How to "scrape" HTML and display it on your own site?
Posted: Tue Mar 07, 2006 10:10 pm
by lemkepf
Don't. It's called stealing. Don't be a ******.
p.s. this stuff really pisses me off.
Re: How to "scrape" HTML and display it on your own site?
Posted: Tue Mar 07, 2006 10:29 pm
by thumbsucker
Don't be stupid. It's legal when it's a government data source, which by law can't be copyrighted. Get a clue.
Re: How to "scrape" HTML and display it on your own site?
Posted: Tue Mar 07, 2006 10:47 pm
by lemkepf
You also have to realize that 99% of people wanting to do this are people trying to steal content. I've been a victim twice. I've also had clients that have been victims. It's a nasty battle to try and get that content taken down ....
Anyways, to answer your question... you can use a linux command "wget".
Code: Select all
wget -r --progress=binary -w1 -Q1000m -v -t3 -nH -np -k -l10 -Dwww.yoursite.com http://www.yoursite/index.html