419 Commits

Author SHA1 Message Date
Felipe
9bbb67cd90 More testing 2024-12-31 00:11:58 +00:00
Felipe
a78b62ae7a Significant cleanup 2024-12-30 23:56:44 +00:00
Felipe
8543243c6e testing 2024-12-05 12:35:31 +00:00
Felipe
7ed71bdfbd Updated action versions 2024-12-05 12:33:36 +00:00
Felipe
495abfe301 Fixed tests 2024-12-05 12:31:20 +00:00
Felipe
f96c7342ed testing 2024-12-05 12:20:29 +00:00
Felipe
08630b4d48 typo fix 2024-12-05 12:15:01 +00:00
Felipe
39c78cb52c Workflow changes, pt.4 2024-12-05 12:13:39 +00:00
Felipe
75617060d7 Workflow fixes, pt.3
You've gotta be squidding me. How did I never notice this
2024-12-05 12:11:16 +00:00
Felipe
cd1fac8b37 Testing workflow, pt.2 2024-12-05 12:06:52 +00:00
Felipe
02785b2eba Workflow fixes, pt. 1 2024-12-05 12:00:44 +00:00
Felipe
d1b70d83b1 Minor cleanup 2024-12-05 11:53:38 +00:00
Felipe
45fa2be573 Significant refactoring
including extra config settings, a proper rate limit, and a logger. Fixes: #307 #291 #281 #269 and probably others too
2024-12-03 00:23:47 +00:00
Felipe
eaff48fbdb Merge branch 'master' of https://github.com/StrawberryMaster/wayback-machine-downloader 2024-06-27 18:54:32 +00:00
Felipe
886f90a700 Updated some tests 2024-06-27 18:53:54 +00:00
Felipe
4b9dd3064c
Update ruby.yml 2024-06-26 21:44:40 -03:00
Felipe
83e5641bb8
Create ruby.yml 2024-06-26 18:27:42 -03:00
Felipe
a3ac4e0341 Minor cleanup 2024-06-26 20:30:59 +00:00
Felipe
93a6fb3c1b typo 2024-06-26 19:52:34 +00:00
Felipe
509d7034a1 Setting file modified time to value reported by Wayback Machine
Implements 937306712c564e5757d898feacc14fbabd10722d, fixes Maintain original creation/modified dates of files while downloading #174
2024-06-26 19:52:12 +00:00
Felipe
0a7752eb41 Minor cleanup 2024-06-26 19:47:19 +00:00
Felipe
78252cfed8 Cleanup 2024-06-26 17:06:15 +00:00
Felipe
cff30f529e Using net:HTTP and decompressing gzip content
see https://github.com/ShiftaDeband/wayback-machine-downloader and bf6e33c2fe
2024-06-26 16:54:55 +00:00
Felipe
466228fee4 Refactoring the archive API 2024-06-26 16:53:08 +00:00
Felipe
86b1abc646 Updated 'rake' dependency to version 12.2 2024-06-26 16:51:42 +00:00
Felipe
c26ace97b3 Fix Dockerfile to correctly install dependencies
taken from @matthid/wayback-machine-downloader @ d75de94ac6
2024-06-26 16:51:13 +00:00
hartator
653b94ba12
Merge pull request #234 from giovanni-cutri/master
Fix small typo in README.md
2022-10-28 11:51:23 -05:00
Giovanni Cutrì
c8051084c8
Fix small typo 2022-10-28 17:37:19 +02:00
hartator
cf770c2e55 Bump gem version 2021-09-04 01:51:08 -05:00
hartator
fe9893e959
Merge pull request #192 from pabs3/uri-open-compat
Make URI#open cross Ruby versions compatible
2021-09-04 01:45:56 -05:00
Paul Wise
9da87bfa74
Make URI#open cross Ruby versions compatible
Inspired-by: commit 30475c5c9e1d92d63b75dc5f22a40dd16c1aa23a
2021-06-08 07:59:38 +08:00
hartator
66ff4d9111
Merge pull request #188 from pabs3/fixes
Fix various issues
2021-06-06 19:53:43 -05:00
hartator
83b4f880b1 Bump Gem version 2021-06-06 19:47:48 -05:00
hartator
30475c5c9e Make URI#open cross Ruby versions compatible 2021-06-06 19:47:11 -05:00
Paul Wise
ba4ca60377
Do not emit a comma for the final item in JSON output
This avoids producing JSON that is not parsable.
2021-05-03 20:54:29 +08:00
Paul Wise
06e25957b6
Print progress messages to stderr when printing JSON
This avoids the messages breaking JSON parsing when
the output is being redirected to a file and parsed.
2021-05-03 20:52:28 +08:00
Paul Wise
ea15965d6d
Fix typos
Suggested-by: codespell, spellintian
2021-05-03 20:20:09 +08:00
Paul Wise
bec41e09ea
Instruct git to ignore a file generated by the tests 2021-05-03 20:15:17 +08:00
Paul Wise
3d0c702fdf
Update Internet Archive URLs to https 2021-05-03 17:50:26 +08:00
Paul Wise
cd29f79fd0
Switch to the JSON output format for easier parsing 2021-05-03 17:44:56 +08:00
Paul Wise
afab72c894
Construct the cdx API query using a URI object
This avoids problems related to URL encoding.

Obsoletes: https://github.com/hartator/wayback-machine-downloader/pull/116
2021-05-03 17:44:36 +08:00
hartator
e6707a9d8b
Merge pull request #163 from DessertArbiter/master
updated deprecated calls, changed URI http to https
2020-05-28 11:12:51 -05:00
DessertArbiter
15edae6a92 updated deprecated calls, changed URI to https 2020-05-27 20:28:06 -04:00
hartator
069a7cc315 Merge branch 'niklasjansson-master' 2017-10-26 20:09:43 -05:00
hartator
0a2ae60378 Bump Gem version 2017-10-26 20:09:23 -05:00
hartator
c360d4621f Merge branch 'master' of https://github.com/niklasjansson/wayback-machine-downloader into niklasjansson-master 2017-10-26 20:05:10 -05:00
hartator
0e96feee01 Fix typo and formatting 2017-10-26 20:02:13 -05:00
hartator
f3ddbe8f92 Explain all-timestamps option 2017-10-26 19:55:24 -05:00
hartator
aa5977c53a Bump Gem version 2017-10-26 19:44:00 -05:00
hartator
c06ab067aa Fix missing comma issue 2017-10-26 19:43:48 -05:00