External/wayback-machine-downloader
1
0
Fork 0
mirror of https://github.com/StrawberryMaster/wayback-machine-downloader.git synced 2025-12-17 09:46:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
427 Commits 1 Branch 17 Tags
Commit Graph

427 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Felipe
3fff7daf35 Minor README cleanup 2025-01-01 12:36:52 +00:00
Felipe
b38d528656 typo fix 2025-01-01 12:20:06 +00:00
Felipe
840c763ee4 Fixed Dockerfile 
attribution to rohfle in cfba774f4b51677c7adfbb9b337a180ec6078bf1
 2024-12-31 17:09:45 +00:00
Felipe
fdcb81f1a0 Refactoring 2024-12-31 16:50:50 +00:00
Felipe
4d5f187f15 Proper connection pool lifecycle management 2024-12-31 16:48:29 +00:00
Felipe
01f0fc9587 Merge branch 'master' of https://github.com/StrawberryMaster/wayback-machine-downloader 2024-12-31 15:04:01 +00:00
Felipe
7de1c5a028 typo fix 2024-12-31 15:03:28 +00:00
Felipe
29bc8a0f81
README corrections 2024-12-31 11:42:19 -03:00
Felipe
9bbb67cd90 More testing 2024-12-31 00:11:58 +00:00
Felipe
a78b62ae7a Significant cleanup 2024-12-30 23:56:44 +00:00
Felipe
8543243c6e testing 2024-12-05 12:35:31 +00:00
Felipe
7ed71bdfbd Updated action versions 2024-12-05 12:33:36 +00:00
Felipe
495abfe301 Fixed tests 2024-12-05 12:31:20 +00:00
Felipe
f96c7342ed testing 2024-12-05 12:20:29 +00:00
Felipe
08630b4d48 typo fix 2024-12-05 12:15:01 +00:00
Felipe
39c78cb52c Workflow changes, pt.4 2024-12-05 12:13:39 +00:00
Felipe
75617060d7 Workflow fixes, pt.3 
You've gotta be squidding me. How did I never notice this
 2024-12-05 12:11:16 +00:00
Felipe
cd1fac8b37 Testing workflow, pt.2 2024-12-05 12:06:52 +00:00
Felipe
02785b2eba Workflow fixes, pt. 1 2024-12-05 12:00:44 +00:00
Felipe
d1b70d83b1 Minor cleanup 2024-12-05 11:53:38 +00:00
Felipe
45fa2be573 Significant refactoring 
including extra config settings, a proper rate limit, and a logger. Fixes: #307 #291 #281 #269 and probably others too
 2024-12-03 00:23:47 +00:00
Felipe
eaff48fbdb Merge branch 'master' of https://github.com/StrawberryMaster/wayback-machine-downloader 2024-06-27 18:54:32 +00:00
Felipe
886f90a700 Updated some tests 2024-06-27 18:53:54 +00:00
Felipe
4b9dd3064c
Update ruby.yml 2024-06-26 21:44:40 -03:00
Felipe
83e5641bb8
Create ruby.yml 2024-06-26 18:27:42 -03:00
Felipe
a3ac4e0341 Minor cleanup 2024-06-26 20:30:59 +00:00
Felipe
93a6fb3c1b typo 2024-06-26 19:52:34 +00:00
Felipe
509d7034a1 Setting file modified time to value reported by Wayback Machine 
Implements 937306712c564e5757d898feacc14fbabd10722d, fixes Maintain original creation/modified dates of files while downloading #174
 2024-06-26 19:52:12 +00:00
Felipe
0a7752eb41 Minor cleanup 2024-06-26 19:47:19 +00:00
Felipe
78252cfed8 Cleanup 2024-06-26 17:06:15 +00:00
Felipe
cff30f529e Using net:HTTP and decompressing gzip content 
see https://github.com/ShiftaDeband/wayback-machine-downloader and bf6e33c2fe
 2024-06-26 16:54:55 +00:00
Felipe
466228fee4 Refactoring the archive API 2024-06-26 16:53:08 +00:00
Felipe
86b1abc646 Updated 'rake' dependency to version 12.2 2024-06-26 16:51:42 +00:00
Felipe
c26ace97b3 Fix Dockerfile to correctly install dependencies 
taken from @matthid/wayback-machine-downloader @ d75de94ac6
 2024-06-26 16:51:13 +00:00
hartator
653b94ba12
Merge pull request #234 from giovanni-cutri/master 
Fix small typo in README.md
 2022-10-28 11:51:23 -05:00
Giovanni Cutrì
c8051084c8
Fix small typo 2022-10-28 17:37:19 +02:00
hartator
cf770c2e55 Bump gem version 2021-09-04 01:51:08 -05:00
hartator
fe9893e959
Merge pull request #192 from pabs3/uri-open-compat 
Make URI#open cross Ruby versions compatible
 2021-09-04 01:45:56 -05:00
Paul Wise
9da87bfa74
Make URI#open cross Ruby versions compatible 
Inspired-by: commit 30475c5c9e1d92d63b75dc5f22a40dd16c1aa23a
 2021-06-08 07:59:38 +08:00
hartator
66ff4d9111
Merge pull request #188 from pabs3/fixes 
Fix various issues
 2021-06-06 19:53:43 -05:00
hartator
83b4f880b1 Bump Gem version 2021-06-06 19:47:48 -05:00
hartator
30475c5c9e Make URI#open cross Ruby versions compatible 2021-06-06 19:47:11 -05:00
Paul Wise
ba4ca60377
Do not emit a comma for the final item in JSON output 
This avoids producing JSON that is not parsable.
 2021-05-03 20:54:29 +08:00
Paul Wise
06e25957b6
Print progress messages to stderr when printing JSON 
This avoids the messages breaking JSON parsing when
the output is being redirected to a file and parsed.
 2021-05-03 20:52:28 +08:00
Paul Wise
ea15965d6d
Fix typos 
Suggested-by: codespell, spellintian
 2021-05-03 20:20:09 +08:00
Paul Wise
bec41e09ea
Instruct git to ignore a file generated by the tests 2021-05-03 20:15:17 +08:00
Paul Wise
3d0c702fdf
Update Internet Archive URLs to https 2021-05-03 17:50:26 +08:00
Paul Wise
cd29f79fd0
Switch to the JSON output format for easier parsing 2021-05-03 17:44:56 +08:00
Paul Wise
afab72c894
Construct the cdx API query using a URI object 
This avoids problems related to URL encoding.

Obsoletes: https://github.com/hartator/wayback-machine-downloader/pull/116
 2021-05-03 17:44:36 +08:00
hartator
e6707a9d8b
Merge pull request #163 from DessertArbiter/master 
updated deprecated calls, changed URI http to https
 2020-05-28 11:12:51 -05:00