Tuesday, September 30, 2003

How To - Wget

Download a Complete Site in u r system using Wget

wget --mirror -w 2 -p --HTML-extension --convert-links -P /home/sriram/websites/raid/mirror/ http://www.techtutorials.info


How can I make Wget ignore the robots.txt file?

wget -erobots=off http://your.site.here
Posted by at

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)