hartator
fe9893e959
Merge pull request #192 from pabs3/uri-open-compat
...
Make URI#open cross Ruby versions compatible
2021-09-04 01:45:56 -05:00
Paul Wise
9da87bfa74
Make URI#open cross Ruby versions compatible
...
Inspired-by: commit 30475c5c9e1d92d63b75dc5f22a40dd16c1aa23a
2021-06-08 07:59:38 +08:00
hartator
66ff4d9111
Merge pull request #188 from pabs3/fixes
...
Fix various issues
2021-06-06 19:53:43 -05:00
hartator
83b4f880b1
Bump Gem version
2021-06-06 19:47:48 -05:00
hartator
30475c5c9e
Make URI#open cross Ruby versions compatible
2021-06-06 19:47:11 -05:00
Paul Wise
ba4ca60377
Do not emit a comma for the final item in JSON output
...
This avoids producing JSON that is not parsable.
2021-05-03 20:54:29 +08:00
Paul Wise
06e25957b6
Print progress messages to stderr when printing JSON
...
This avoids the messages breaking JSON parsing when
the output is being redirected to a file and parsed.
2021-05-03 20:52:28 +08:00
Paul Wise
ea15965d6d
Fix typos
...
Suggested-by: codespell, spellintian
2021-05-03 20:20:09 +08:00
Paul Wise
bec41e09ea
Instruct git to ignore a file generated by the tests
2021-05-03 20:15:17 +08:00
Paul Wise
3d0c702fdf
Update Internet Archive URLs to https
2021-05-03 17:50:26 +08:00
Paul Wise
cd29f79fd0
Switch to the JSON output format for easier parsing
2021-05-03 17:44:56 +08:00
Paul Wise
afab72c894
Construct the cdx API query using a URI object
...
This avoids problems related to URL encoding.
Obsoletes: https://github.com/hartator/wayback-machine-downloader/pull/116
2021-05-03 17:44:36 +08:00
hartator
e6707a9d8b
Merge pull request #163 from DessertArbiter/master
...
updated deprecated calls, changed URI http to https
2020-05-28 11:12:51 -05:00
DessertArbiter
15edae6a92
updated deprecated calls, changed URI to https
2020-05-27 20:28:06 -04:00
hartator
069a7cc315
Merge branch 'niklasjansson-master'
2017-10-26 20:09:43 -05:00
hartator
0a2ae60378
Bump Gem version
2017-10-26 20:09:23 -05:00
hartator
c360d4621f
Merge branch 'master' of https://github.com/niklasjansson/wayback-machine-downloader into niklasjansson-master
2017-10-26 20:05:10 -05:00
hartator
0e96feee01
Fix typo and formatting
2017-10-26 20:02:13 -05:00
hartator
f3ddbe8f92
Explain all-timestamps option
2017-10-26 19:55:24 -05:00
hartator
aa5977c53a
Bump Gem version
2017-10-26 19:44:00 -05:00
hartator
c06ab067aa
Fix missing comma issue
2017-10-26 19:43:48 -05:00
hartator
a7c3d9b6c1
Merge branch 'pr/89'
...
# Conflicts:
# lib/wayback_machine_downloader.rb
2017-10-26 19:39:36 -05:00
hartator
5116b77eb9
Give more details about what the option --all-timestamps do
2017-10-26 19:36:06 -05:00
hartator
d80b51f502
Use more explicit variable name all_timestamps
2017-10-26 19:35:29 -05:00
hartator
4a6fdb1462
Test all_timestamps option download all timestamps
2017-10-26 19:34:36 -05:00
hartator
058fc62b3e
Fix Readme errors on flag name
2017-06-11 22:21:03 -05:00
hartator
3179faca2e
Bump Gem version
2017-06-11 22:18:07 -05:00
hartator
e9ffa6cf0d
Fix issues with CLI option not setting exact_url option right
2017-06-11 22:17:23 -05:00
hartator
123c2f3024
Bump Gem version
2017-06-11 22:06:57 -05:00
hartator
b6f3d6f808
Add explanations to use exact url flag to Readme
2017-06-11 22:05:13 -05:00
hartator
e0982e9544
Merge branch 'p-master'
2017-06-11 21:55:13 -05:00
hartator
af8ef28d67
Add explanation to use exact url flag for the CLI
2017-06-11 21:53:45 -05:00
hartator
246441ff17
Replace exact match by exact url
2017-06-11 21:53:13 -05:00
hartator
4eca581257
Remove too verbose comment
2017-06-11 13:19:50 -05:00
hartator
28fd1e10a2
Fix length of arguments per line
2017-06-11 13:19:36 -05:00
hartator
62f424b6d1
Merge branch 'master' of https://github.com/p/wayback-machine-downloader into p-master
2017-06-11 12:46:00 -05:00
hartator
5b0ed26ab5
Fix row align for GitHub repository preview
2017-06-10 15:54:15 -05:00
hartator
d4d13612cf
Remove donation bit for the Readme
2017-06-10 15:49:58 -05:00
hartator
f465c83a80
Bump Gem version
2017-06-10 15:49:35 -05:00
hartator
7953bb5b1d
Left align correctly multiline help description text
2017-06-10 15:49:25 -05:00
Niklas Jansson
662ab9eeb7
fixed bad characters in directories for windows
2017-06-05 12:32:37 +02:00
Oleg Pudeyev
4af80adca6
Fix exact match logic and add a test
2017-06-03 17:45:06 -04:00
Oleg Pudeyev
e166e9443d
Line length
2017-06-03 17:24:30 -04:00
Oleg Pudeyev
aab9a49509
Get rid of assigned but unused variable warnings under ruby 2.4
2017-06-03 17:00:50 -04:00
Oleg Pudeyev
e6157c21b9
Parens are required before * when used for splatting.
...
https://stackoverflow.com/questions/41821628/ruby-how-can-i-kill-warning-interpreted-as-argument-prefix
2017-06-03 16:59:08 -04:00
Oleg Pudeyev
43ab0b2f48
Fix test name so that it does not shadow another test
2017-06-03 16:54:51 -04:00
Oleg Pudeyev
e73a88ab56
File.exists? causes warning is ruby 2.4.1, use exist?
2017-06-03 16:53:37 -04:00
Oleg Pudeyev
d926f965f9
Add exact_match option.
...
With this option set, Wayback Machine Downloader
will only look for snapshots matching the exact base_url
passed in rather than base_url and its children.
This is useful when trying to download a single file
rather than mirroring a site.
2017-03-15 17:58:05 -04:00
Oleg Pudeyev
65b1948517
Avoid interleaving status output with file listing.
...
Before:
[
Getting snapshot pages.. found 1 snaphots to consider.
{"file_url":"http://www.trackpedia.com:80/forums/archive/index.php/f-115.html ","timestamp":20131221124252,"file_id":"forums/archive/index.php/f-115.html"},
]
After:
Getting snapshot pages.. found 1 snaphots to consider.
[
{"file_url":"http://www.trackpedia.com:80/forums/archive/index.php/f-115.html ","timestamp":20131221124252,"file_id":"forums/archive/index.php/f-115.html"},
]
2017-03-15 17:19:34 -04:00
Oleg Pudeyev
6b8c1aa194
Remove list attribute from the downloader.
...
Whether to list or download is a program option external to the downloader
2017-03-15 17:12:43 -04:00
