External/wayback-machine-downloader
1
0
Fork 0
mirror of https://github.com/StrawberryMaster/wayback-machine-downloader.git synced 2025-12-17 17:56:44 +00:00
Code Issues Packages Projects Releases Wiki Activity
385 Commits 1 Branch 17 Tags
Commit Graph

385 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ian Kirker
132e3fa5f8 Alters encoding of file_url to fix encoding incompatibilities 2017-02-15 11:01:26 +00:00
Ian Kirker
0a324016b8 Split encoding test into two tests 
(One for downloading, one for when files are already present)
 2017-02-15 10:58:40 +00:00
Ian Kirker
2fd50480ea Added prospective test for encoding conflict errors 2017-02-15 10:50:12 +00:00
insaner
5bd9fbffdd Update wayback_machine_downloader.rb 2017-01-24 05:03:07 -05:00
insaner
330c1888fb Update wayback_machine_downloader 2017-01-24 04:55:51 -05:00
hartator
63941f99dd Merge branch 'antoneliasson-master' 2016-11-14 18:20:42 -06:00
hartator
734521803a Bump Gem version 2016-11-14 18:20:16 -06:00
hartator
5195c36156 Remove Rubinius from Rubies following Travis CI issues 2016-11-14 18:20:06 -06:00
hartator
8d5be7a89e Fix compatibility with Ruby 1.9.x and proxies 2016-11-14 18:18:58 -06:00
Anton Eliasson
54bd5d3852 Support http(s)_proxy ENV variables 
Closes issue #65
 2016-10-31 17:49:30 +01:00
hartator
4177425a1b Fix Travis CI support of Rubinius by using precise supported version 2016-10-31 02:20:43 -05:00
hartator
6d7dbc13f6 Revert back to regular Rubinius version 2016-10-31 01:58:12 -05:00
hartator
ff05a2ab90 Fix Travis CI Ruby versions 2016-10-17 16:05:54 -05:00
hartator
ac759f3752 Replace Ruby 1.9.1 by 1.8.7 2016-10-17 13:26:36 -05:00
hartator
a3a02e0129 Add more Rubies to try out 2016-10-17 12:45:36 -05:00
hartator
7383bdfadc Bump Gem version 2016-10-17 12:42:05 -05:00
hartator
9fc60b5385 Require thread library explicitly for 1.9.x Ruby versions 2016-10-17 12:42:05 -05:00
hartator
1ea897d4e0 Align correctly CLI help texts 2016-10-03 08:45:57 -07:00
hartator
d254c5c541 Update file information to reflect new API selectors 2016-09-26 10:51:02 -07:00
hartator
c9be8ae945 Bump Gem version 2016-09-26 10:36:05 -07:00
hartator
c9e15636b1 Fix spelling in comment 2016-09-26 10:36:05 -07:00
hartator
5d1fefe252 Update tests to reflect new API selectors 2016-09-26 10:36:05 -07:00
hartator
fe96570c93 Fix spacing issues in CLI help text 2016-09-24 10:24:46 -07:00
hartator
c1d77259c9 Bump Gem version 2016-09-24 10:21:50 -07:00
hartator
7414c34d05 Add an additional request to archive.org API to get fresher snapshots 2016-09-24 10:21:17 -07:00
hartator
45f5f29826 Add new maximum snapshot page option 2016-09-24 10:06:58 -07:00
hartator
188b285848 Bump gem version 2016-09-24 10:06:35 -07:00
hartator
1b42f57e6f Add maximum snapshot page option 2016-09-24 10:06:27 -07:00
hartator
7eedc1a183 Get snapshot result page per page index 2016-09-24 10:04:57 -07:00
hartator
ec6aa17a07 Add option to set the maximum number of snapshot pages to consider 2016-09-23 18:19:37 -07:00
hartator
d37c56e7dc Force spacing for CLI help text 2016-09-23 18:18:34 -07:00
hartator
f7afca7d95 Bump Gem version 2016-09-18 12:24:29 -05:00
hartator
87eee70969 Show 404 archives when a resource had 200 response previously 2016-09-18 12:24:29 -05:00
hartator
6f10fc64ff Add Gem and build badges to Readme 2016-09-17 17:17:08 -05:00
hartator
a5b15d6d83 Fix formatting, spacing and spelling issues 2016-09-17 15:12:53 -05:00
hartator
21dd22f581 Disable gzip compression on API calls 2016-09-17 14:42:32 -05:00
hartator
2e7f8611ef Load early net/http library for Ruby 1.9.x 2016-09-17 14:08:29 -05:00
hartator
95eaa91715 Refactor archive API calls to own module 2016-09-17 13:37:17 -05:00
hartator
59b379b9c6 Add directory option explanation to Readme 2016-09-17 13:05:51 -05:00
hartator
8e6dab2bba Bump Gem version 2016-09-17 12:49:56 -05:00
hartator
bd462ab36d Add possibility to save files to an user specified directory 2016-09-17 12:49:48 -05:00
hartator
45c393a106 Reorder in a more logic sense CLI options 2016-09-17 12:48:49 -05:00
hartator
f3729d6378 Add the possibility to change directory to save to as a CLI option 2016-09-17 12:48:28 -05:00
hartator
8623d3a74b Bump Gem version 2016-09-16 19:17:53 -05:00
hartator
d4bc975043 Skip lines that don't include an url 2016-09-16 19:16:47 -05:00
hartator
bdf611bce9 Set file id to nil when encounter UTF-8 issues 2016-09-16 15:52:18 -05:00
hartator
94acdd6a7d Skip lines with no actionable data 2016-09-16 15:02:55 -05:00
hartator
50ee9e60be Replace String#split processing by substring selectors 2016-09-16 12:32:31 -05:00
hartator
7b69f3c236 Clean up data earlier from UTF-8 bad bytes 2016-09-16 12:09:58 -05:00
hartator
cfa236a4d1 Replace UTF-8 probematic blank space with another text editor 2016-09-16 12:04:47 -05:00