External/wayback-machine-downloader
1
0
Fork 0
mirror of https://github.com/StrawberryMaster/wayback-machine-downloader.git synced 2025-12-22 20:26:46 +00:00
Code Issues Packages Projects Releases Wiki Activity

Remove old API requests

Browse Source
This commit is contained in:
hartator 2016-07-30 14:08:57 -05:00
parent e6a5f5f999
commit 7a4a612276
1 changed files with 0 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
lib/wayback_machine_downloader.rb
View File

@ -55,8 +55,6 @@ class WaybackMachineDownloader
end end
def get_file_list_curated def get_file_list_curated
index_file_list_raw = open "http://web.archive.org/cdx/search/xd?url=#{@base_url}"
all_file_list_raw = open "http://web.archive.org/cdx/search/xd?url=#{@base_url}/*"
parameters_for_wayback_machine_api = "&fl=timestamp,original&fastLatest=true&filter=statuscode:200&collapse=original" parameters_for_wayback_machine_api = "&fl=timestamp,original&fastLatest=true&filter=statuscode:200&collapse=original"
if @from_timestamp and @from_timestamp != 0 if @from_timestamp and @from_timestamp != 0
parameters_for_wayback_machine_api += "&from=" + @from_timestamp.to_s parameters_for_wayback_machine_api += "&from=" + @from_timestamp.to_s