329 Commits

Author SHA1 Message Date
Paul Wise
afab72c894
Construct the cdx API query using a URI object
This avoids problems related to URL encoding.

Obsoletes: https://github.com/hartator/wayback-machine-downloader/pull/116
2021-05-03 17:44:36 +08:00
hartator
e6707a9d8b
Merge pull request #163 from DessertArbiter/master
updated deprecated calls, changed URI http to https
2020-05-28 11:12:51 -05:00
DessertArbiter
15edae6a92 updated deprecated calls, changed URI to https 2020-05-27 20:28:06 -04:00
hartator
069a7cc315 Merge branch 'niklasjansson-master' 2017-10-26 20:09:43 -05:00
hartator
0a2ae60378 Bump Gem version 2017-10-26 20:09:23 -05:00
hartator
c360d4621f Merge branch 'master' of https://github.com/niklasjansson/wayback-machine-downloader into niklasjansson-master 2017-10-26 20:05:10 -05:00
hartator
0e96feee01 Fix typo and formatting 2017-10-26 20:02:13 -05:00
hartator
f3ddbe8f92 Explain all-timestamps option 2017-10-26 19:55:24 -05:00
hartator
aa5977c53a Bump Gem version 2017-10-26 19:44:00 -05:00
hartator
c06ab067aa Fix missing comma issue 2017-10-26 19:43:48 -05:00
hartator
a7c3d9b6c1 Merge branch 'pr/89'
# Conflicts:
#	lib/wayback_machine_downloader.rb
2017-10-26 19:39:36 -05:00
hartator
5116b77eb9 Give more details about what the option --all-timestamps do 2017-10-26 19:36:06 -05:00
hartator
d80b51f502 Use more explicit variable name all_timestamps 2017-10-26 19:35:29 -05:00
hartator
4a6fdb1462 Test all_timestamps option download all timestamps 2017-10-26 19:34:36 -05:00
hartator
058fc62b3e Fix Readme errors on flag name 2017-06-11 22:21:03 -05:00
hartator
3179faca2e Bump Gem version 2017-06-11 22:18:07 -05:00
hartator
e9ffa6cf0d Fix issues with CLI option not setting exact_url option right 2017-06-11 22:17:23 -05:00
hartator
123c2f3024 Bump Gem version 2017-06-11 22:06:57 -05:00
hartator
b6f3d6f808 Add explanations to use exact url flag to Readme 2017-06-11 22:05:13 -05:00
hartator
e0982e9544 Merge branch 'p-master' 2017-06-11 21:55:13 -05:00
hartator
af8ef28d67 Add explanation to use exact url flag for the CLI 2017-06-11 21:53:45 -05:00
hartator
246441ff17 Replace exact match by exact url 2017-06-11 21:53:13 -05:00
hartator
4eca581257 Remove too verbose comment 2017-06-11 13:19:50 -05:00
hartator
28fd1e10a2 Fix length of arguments per line 2017-06-11 13:19:36 -05:00
hartator
62f424b6d1 Merge branch 'master' of https://github.com/p/wayback-machine-downloader into p-master 2017-06-11 12:46:00 -05:00
hartator
5b0ed26ab5 Fix row align for GitHub repository preview 2017-06-10 15:54:15 -05:00
hartator
d4d13612cf Remove donation bit for the Readme 2017-06-10 15:49:58 -05:00
hartator
f465c83a80 Bump Gem version 2017-06-10 15:49:35 -05:00
hartator
7953bb5b1d Left align correctly multiline help description text 2017-06-10 15:49:25 -05:00
Niklas Jansson
662ab9eeb7 fixed bad characters in directories for windows 2017-06-05 12:32:37 +02:00
Oleg Pudeyev
4af80adca6 Fix exact match logic and add a test 2017-06-03 17:45:06 -04:00
Oleg Pudeyev
e166e9443d Line length 2017-06-03 17:24:30 -04:00
Oleg Pudeyev
aab9a49509 Get rid of assigned but unused variable warnings under ruby 2.4 2017-06-03 17:00:50 -04:00
Oleg Pudeyev
e6157c21b9 Parens are required before * when used for splatting.
https://stackoverflow.com/questions/41821628/ruby-how-can-i-kill-warning-interpreted-as-argument-prefix
2017-06-03 16:59:08 -04:00
Oleg Pudeyev
43ab0b2f48 Fix test name so that it does not shadow another test 2017-06-03 16:54:51 -04:00
Oleg Pudeyev
e73a88ab56 File.exists? causes warning is ruby 2.4.1, use exist? 2017-06-03 16:53:37 -04:00
Oleg Pudeyev
d926f965f9 Add exact_match option.
With this option set, Wayback Machine Downloader
will only look for snapshots matching the exact base_url
passed in rather than base_url and its children.

This is useful when trying to download a single file
rather than mirroring a site.
2017-03-15 17:58:05 -04:00
Oleg Pudeyev
65b1948517 Avoid interleaving status output with file listing.
Before:

[
Getting snapshot pages.. found 1 snaphots to consider.

{"file_url":"http://www.trackpedia.com:80/forums/archive/index.php/f-115.html","timestamp":20131221124252,"file_id":"forums/archive/index.php/f-115.html"},
]

After:

Getting snapshot pages.. found 1 snaphots to consider.

[
{"file_url":"http://www.trackpedia.com:80/forums/archive/index.php/f-115.html","timestamp":20131221124252,"file_id":"forums/archive/index.php/f-115.html"},
]
2017-03-15 17:19:34 -04:00
Oleg Pudeyev
6b8c1aa194 Remove list attribute from the downloader.
Whether to list or download is a program option external to the downloader
2017-03-15 17:12:43 -04:00
Oleg Pudeyev
ea73ed5ed6 Shorten some lines for readability 2017-03-15 17:10:16 -04:00
Oleg Pudeyev
6779971dc9 Fix whitespace 2017-03-15 17:08:40 -04:00
hartator
e95ade8079 Bump Gem version 2017-02-17 12:55:58 -06:00
hartator
6e3986b875 Merge branch 'pr/82' 2017-02-17 12:55:20 -06:00
hartator
4830913ed3 Add explicit variable current encoding 2017-02-17 12:54:12 -06:00
Ian Kirker
132e3fa5f8 Alters encoding of file_url to fix encoding incompatibilities 2017-02-15 11:01:26 +00:00
Ian Kirker
0a324016b8 Split encoding test into two tests
(One for downloading, one for when files are already present)
2017-02-15 10:58:40 +00:00
Ian Kirker
2fd50480ea Added prospective test for encoding conflict errors 2017-02-15 10:50:12 +00:00
insaner
5bd9fbffdd Update wayback_machine_downloader.rb 2017-01-24 05:03:07 -05:00
insaner
330c1888fb Update wayback_machine_downloader 2017-01-24 04:55:51 -05:00
hartator
63941f99dd Merge branch 'antoneliasson-master' 2016-11-14 18:20:42 -06:00