2015-08-19 12:10:50 -05:00
2015-08-15 15:36:26 -05:00
2015-08-17 19:42:43 -05:00
2015-07-25 19:07:51 -05:00
2015-07-26 00:02:35 -05:00
2015-08-19 11:23:13 -05:00

Wayback Machine Downloader

Download any website from the Internet Archive Wayback Machine.

Installation

You need to install Ruby on your system (>= 1.9.2) - if you don't already have it, then run:

gem install wayback_machine_downloader

Usage

Basic

Run wayback_machine_downloader with the base url of the website you want to retrieve as a parameter (e.g., http://example.com):

wayback_machine_downloader http://example.com

How it works

It will download the last version of every file present on Wayback Machine to websites/example.com/. It will also re-create a directory structure and auto-create index.html pages to work seamlessly with Apache and Nginx. URLs and links structure are preserved as much as possible.

Optional Timestamp

You may want to supply a specific timestamp to lock your backup to an older version of the website. Wayback Machine Downloader will then fetch only file versions on or prior to the timestamp specified:

wayback_machine_downloader http://example.com --timestamp 20060716231334

Contributing

Contributions are welcome! Just submit a pull request via GitHub.

To run the tests:

rake test
Description
Languages
Ruby 99.1%
Shell 0.5%
Dockerfile 0.4%