External/wayback-machine-downloader
1
0
Fork 0
mirror of https://github.com/StrawberryMaster/wayback-machine-downloader.git synced 2025-12-17 17:56:44 +00:00
Code Issues Packages Projects Releases Wiki Activity
445 Commits 1 Branch 17 Tags
Commit Graph

198 Commits

Author SHA1 Message Date
hartator
7414c34d05 Add an additional request to archive.org API to get fresher snapshots 2016-09-24 10:21:17 -07:00
hartator
188b285848 Bump gem version 2016-09-24 10:06:35 -07:00
hartator
1b42f57e6f Add maximum snapshot page option 2016-09-24 10:06:27 -07:00
hartator
f7afca7d95 Bump Gem version 2016-09-18 12:24:29 -05:00
hartator
2e7f8611ef Load early net/http library for Ruby 1.9.x 2016-09-17 14:08:29 -05:00
hartator
95eaa91715 Refactor archive API calls to own module 2016-09-17 13:37:17 -05:00
hartator
8e6dab2bba Bump Gem version 2016-09-17 12:49:56 -05:00
hartator
bd462ab36d Add possibility to save files to an user specified directory 2016-09-17 12:49:48 -05:00
hartator
8623d3a74b Bump Gem version 2016-09-16 19:17:53 -05:00
hartator
d4bc975043 Skip lines that don't include an url 2016-09-16 19:16:47 -05:00
hartator
bdf611bce9 Set file id to nil when encounter UTF-8 issues 2016-09-16 15:52:18 -05:00
hartator
94acdd6a7d Skip lines with no actionable data 2016-09-16 15:02:55 -05:00
hartator
50ee9e60be Replace String#split processing by substring selectors 2016-09-16 12:32:31 -05:00
hartator
7b69f3c236 Clean up data earlier from UTF-8 bad bytes 2016-09-16 12:09:58 -05:00
hartator
cfa236a4d1 Replace UTF-8 probematic blank space with another text editor 2016-09-16 12:04:47 -05:00
hartator
7da624d2bf Bump Gem version 2016-09-16 11:52:49 -05:00
hartator
e508d761c8 Fix UTF-8 blank space issues with Ruby 1.9.x and JRuby 2016-09-16 11:52:15 -05:00
hartator
dd9c91b433 Bump Gem version 2016-09-15 20:15:50 -05:00
hartator
87c28b0895 Fix random UTF-8 issues with Ruby 1.9 and JRuby 2016-09-15 20:15:40 -05:00
hartator
fbfa8f8e63 Bump Gem version 2016-09-15 20:02:36 -05:00
hartator
5696853e23 Format seconds to avoid too long output 2016-09-15 20:00:35 -05:00
hartator
85a9fae671 Make instance variable definitions more explicit 2016-09-15 19:59:42 -05:00
Šarūnas Kūjalis
ee5c87378d Add downloading in multi threads 2016-09-04 23:38:38 +03:00
hartator
82a938b628 Add support for raw domain names as inputed url 2016-08-16 11:48:00 -05:00
hartator
d6f65250cd Bump Gem version 2016-08-16 11:48:00 -05:00
hartator
53f621e6a1 Bump Gem version 2016-08-10 14:33:21 -05:00
hartator
e7fc5a2eb9 Fix case when file wasn't created 2016-08-10 14:32:41 -05:00
hartator
5532a6408b Bump gem version 2016-08-09 20:56:54 -05:00
hartator
762ccb20c7 Filter more windows unsafe characters 2016-08-09 20:56:47 -05:00
hartator
9d863b327a Remove empty files if --all option is not passed 2016-08-09 15:57:13 -05:00
hartator
9312c3cff4 Bump Gem version 2016-08-09 15:56:52 -05:00
hartator
a397476681 Save error files only if --all option is passed 2016-08-09 12:53:46 -05:00
hartator
5d4fa42fda Bump Gem version 2016-08-09 12:53:05 -05:00
hartator
32156db551 Add option to only list files without downloading 2016-08-03 14:23:35 -05:00
hartator
4ea8505394 Bump gem version 2016-08-01 17:02:23 -05:00
hartator
cbbd840548 Fix typo #50 2016-08-01 17:01:39 -05:00
hartator
811a61e852 Bump gem version 2016-07-31 09:51:38 -05:00
hartator
7ca5f579d5 Add all file types download option 2016-07-31 09:51:38 -05:00
hartator
b8f0bc46f3 Bump gem version 2016-07-31 09:51:38 -05:00
hartator
1ab39481c9 Add verbosity to timestamp errors 2016-07-31 09:51:38 -05:00
hartator
7885c822fa Bump gem version 2016-07-30 14:10:20 -05:00
hartator
7a4a612276 Remove old API requests 2016-07-30 14:08:57 -05:00
hartator
e6a5f5f999 Pass parameters directly to Wayback Machine API 2016-07-30 14:08:26 -05:00
hartator
92e687cfd6 Add to timestamp option 2016-07-30 14:08:01 -05:00
hartator
a3ebcec937 Improve user output 2016-07-28 17:59:59 -05:00
hartator
6fb6af6547 Fix behavior when no exclude filter is supplied 2016-07-28 17:58:54 -05:00
hartator
6f138d014f Bump minor version (new feature) 2016-07-28 17:58:12 -05:00
tedder
1eaa8098c0
add --exclude filter 
- add exclude filter. Has precedence over the --only filter.
- bumped the version.
- tests: I modified the tests, but.. the whole suite is hopelessly broken. And when I say hopeless, I'm talking about myself; my Ruby is so rudimentary I was looking up how to create a variable. It really needs a static list of the website 'contents' mocked into it. I have a branch in my repo showing my hopeless work.
 2016-06-28 23:27:36 -07:00
hartator
7000035a30 Bump Gem Version 2016-03-29 18:39:31 -05:00
hartator
e3ac4ed22b Merge pull request #34 from tamersalama/master 
Set Accepted-Encoding to plain to avoid OpenURI issue
 2016-03-29 18:38:09 -05:00