v3.5.4

Add Added on and Order columns

.gitignore

@@ -3,4 +3,5 @@
 /**/*/target
 /**/*/build-dir
 /**/*/java-runtime
-.idea
+.idea
+.vripper

CHANGELOG.md

@@ -1,135 +1,417 @@
 # Changelog
 
-## [2.11.7] - 2020-05-08
+## [3.5.4] - 2021-05-29
+
 ### Changed
+
+- Fix download queue bug
+
+## [3.5.3] - 2021-05-24
+
+### Changed
+
+- Update donation infos
+
+## [3.5.1] - 2021-05-22
+
+### Changed
+
+- Bug fix
+
+## [3.5.0] - 2021-05-21
+
+### Changed
+
+- Download queue bug fix
+- Save window size and position
+- Resize confirmation box
+- Enhance metadata interruption
+- Add Added on and Order columns
+
+## [3.4.2] - 2021-05-10
+
+### Changed
+
+- Fix potential issue with imagebam host
+- Enhance download queue logic
+- Code source enhancements
+- Fix app icons
+- Fix race condition bug
+
+## [3.3.8] - 2021-05-05
+
+### Changed
+
+- Fix imagebam host
+- Fix font path
+
+## [3.3.6] - 2021-03-20
+
+### Changed
+
+- Optimize build size
+
+## [3.3.5] - 2021-03-18
+
+### Changed
+
+- Bug fixe
+
+## [3.3.4] - 2021-03-18
+
+### Changed
+
+- Bug fixes
+
+## [3.3.3] - 2021-03-13
+
+### Changed
+
+- Remove unnecessary event logs
+
+## [3.3.2] - 2021-03-11
+
+### Changed
+
+- Fix a bug with event logs
+- Change event names and add some icons
+
+## [3.3.1] - 2021-02-18
+
+### Added
+
+- Add about menu
+
+### Changed
+
+- Fix README.md
+
+## [3.3.0] - 2021-02-16
+
+### Changed
+
+- Add support for proxies
+- Add a Event Logs
+- Fix bugs with the database
+
+## [3.2.3] - 2021-01-13
+
+### Changed
+
+- Finished posts are not cleared from the UI
+
+## [3.2.2] - 2021-01-13
+
+### Changed
+
+- Set total download to max value
+
+## [3.2.1] - 2021-01-12
+
+### Added
+
+- Add settings for connection timeout
+- Add settings for maximum attempts
+
+### Changed
+
+- Enhance posts rename logic
+- Dependencies update
+- Switch reactive from rx-java to reactor
+
+## [3.2.0] - 2020-11-16
+
+### Changed
+
+- Fix build issue
+
+## [3.1.0] - 2020-11-16
+
+### Changed
+
+- UI revamp
+- Fix bugs
+
+## [3.0.11] - 2020-10-31
+
+### Added
+
+- Support for vipr.im
+
+## [3.0.10] - 2020-10-04
+
+### Changed
+
+- Fix bug on settings update
+
+## [3.0.9] - 2020-09-27
+
+### Changed
+
+- Revert to appending post id to download folders
+- Fix a bug that lead to adding duplicate posts
+- Remove old unused settings
+
+## [3.0.8] - 2020-08-22
+
+### Changed
+
+- Bug fix which breaks concurrent downloads
+
+## [3.0.7] - 2020-08-22
+
+### Changed
+
+- Fix MacOs build
+
+## [3.0.6] - 2020-08-18
+
+### Changed
+
+- Fix TurboImageHost
+
+## [3.0.5] - 2020-08-17
+
+### Changed
+
+- Update packages
+- Host class refactoring
+
+## [3.0.4] - 2020-08-16
+
+### Changed
+
+- Improve rename UI
+
+## [3.0.3] - 2020-08-16
+
+### Changed
+
+- Fix bugs with electron app
+
+## [3.0.2] - 2020-08-15
+
+### Changed
+
+- Fix bugs with download queue
+
+## [3.0.1] - 2020-08-03
+
+### Changed
+
+- Fix bugs with download queue
+
+## [3.0.0] - 2020-08-03
+
+### Changed
+
+- Major rewrites
+- Introducing a proper database for persistence
+
+## [2.12.1] - 2020-05-22
+
+### Changed
+
+- Fix alternative name bug
+
+## [2.12.0] - 2020-05-21
+
+### Changed
+
+- Use new user hash from the api
+
+## [2.11.7] - 2020-05-08
+
+### Changed
+
 - Fix bug with paths creation
 - Move Open Link button
 - Rename rename all title
 
 ## [2.11.6] - 2020-05-04
+
 ### Changed
+
 - PNG filenames are now correctly named
 - Fix issue with special characters in post titles
 
 ## [2.11.5] - 2020-05-03
+
 ### Changed
+
 - Reduce rows buffer size
 
 ## [2.11.4] - 2020-05-03
+
 ### Changed
+
 - Code cleanup
 - Dependencies update
 
 ## [2.11.3] - 2020-04-30
+
 ### Changed
+
 - Source code restructure
 - UI fixes and enhancements
+
 ### Added
+
 - Add menu entry to rename a gallery to first alternative title
 - Add menu on toolbar for massive rename to first alternative title
 
 ## [2.11.2] - 2020-04-26
+
 ### Changed
+
 - Bug fixes
 
 ## [2.11.1] - 2020-04-25
+
 ### Changed
+
 - Code source maintenance
+
 ### Added
+
 - Added option to rename gallery
 
 ## [2.11.0] - 2020-03-29
+
 ### Changed
+
 - Upgrade Electron to v8
 - Upgrade Angular to v9
 - App settings are now portable in a json file
 - General code source maintenance
+
 ### Added
+
 - Added Support for pixroute.com
 - Added grab post title from thread option
 
 ## [2.10.8] - 2020-01-25
+
 ### Changed
+
 - Fix app url
 
 ## [2.10.7] - 2020-01-25
+
 ### Changed
+
 - Drop SockJs and switch to WebSocket
 - Autoreconnect front to back
 
 ## [2.10.6] - 2020-01-19
+
 ### Changed
+
 - Limit cache size
 
 ## [2.10.5] - 2020-01-18
+
 ### Changed
+
 - Bug fixes
 
 ## [2.10.4] - 2020-01-18
+
 ### Changed
+
 - Zero value for total max download will disable the limit
 - Add system notification
 - Bug fixes
 
 ## [2.10.3] - 2020-01-16
+
 ### Changed
+
 - Some bug fixes
 - Enhance download queue logic
 - Clear cache button
 - Fix the partial status
 - Sanitize URLs with spaces
+
 ### Added
+
 - Support for Postimg host
 - Support for Imagevenue host
 
 ## [2.10.2] - 2019-12-29
+
 ### Changed
+
 - Upgrade electron to v7
 - Bug fix
 
 ## [2.10.1] - 2019-12-27
+
 ### Changed
+
 - Bug fix
 
 ## [2.10.0] - 2019-12-27
+
 ### Changed
+
 - Fix spring dependency bug
+
 ### Added
+
 - Add support for imgspice
 
 ## [2.9.0] - 2019-12-27
+
 ### Changed
+
 - Fix build issue
 
 ## [2.9.0] - 2019-12-27
+
 ### Changed
+
 - Decrease timeout for fast fail
+
 ### Added
+
 - Allow many hosts to run at the same time
 - Add title to gallery
 - Add global concurrent downloads
 - Add counter badge in link collector
 
 ## [2.8.1] - 2019-12-24
+
 ### Changed
+
 - Fix issue with path creation
 
 ## [2.8.0] - 2019-12-24
+
 ### Added
+
 - Photo gallery feature
 
 ## [2.7.1] - 2019-12-21
+
 ### Added
+
 - Add version to title bar
 
 ## [2.7.0] - 2019-12-21
+
 ### Changed
+
 - Add missing icon
+
 ### Added
+
 - Add support for pixxxels
 
 ## [2.6.0] - 2019-12-21
+
 ### Changed
+
 - Disable download button when nothing selected in Link collector grab menu
 - Better quality app icon
 - Implement context menu on download tab
@@ -138,143 +420,207 @@
 - Some UI fixes
 
 ## [2.5.1] - 2019-12-09
+
 ### Changed
+
 - Disable download button when nothing selected in Link collector grab menu
+
 ### Added
+
 - Add hosts column in Link collector grab menu
 
 ## [2.5.0] - 2019-12-08
+
 ### Changed
+
 - Change loading screen
 - UI Fixes
 - Fix bug with previews
+
 ### Added
+
 - Add link collector feature
 - Add support for multiple links at a time
 
 ## [2.4.1] - 2019-11-26
+
 ### Changed
+
 - Increase attempts for establishing ws connection between front and back end
 - Change default download folder to Home folder (installer), App folder (portable)
 
 ## [2.4.0] - 2019-11-23
+
 ### Changed
+
 - Pimpandhost Host support
 
 ## [2.3.2] - 2019-11-23
+
 ### Changed
+
 - Fix a bug with the scan component
 
 ## [2.3.1] - 2019-11-22
+
 ### Changed
+
 - Fix connexion reset issue
 - Fix Post Status when autostart option is selected
 - Add stop all button
 
 ## [2.3.0] - 2019-11-21
+
 ### Changed
+
 - UI enhancements and overhaul
 - Stability fixes with HTTP connections
 - MacOS official support
 - Use local sockjs and material icons font
 
 ## [2.2.5] - 2019-11-09
+
 ### Changed
+
 - Exclude thumbs download for imagezilla and pixhost
 - Change retry on fail logic (may help avoid having download errors)
 
 ## [2.2.4] - 2019-10-05
+
 ### Added
+
 - AppImage target for linux
 
 ## [2.2.3] - 2019-10-01
+
 ### Changed
+
 - Strip libjvm.so for debian
 
 ## [2.2.2] - 2019-10-01
+
 ### Changed
+
 - Update product name
 
 ## [2.2.1] - 2019-10-01
+
 ### Changed
+
 - Update dependency list for deb package
 
 ## [2.2.0] - 2019-10-01
+
 ### Added
+
 - Embedd JRE within the app
+
 ### Changed
+
 - Fix 'Start' on pending items
 - Upgrade to Java 11
 
 ## [2.1.0] - 2019-09-30
+
 ### Added
+
 - Add a create a subfolder per thread option
 
 ## [2.0.4] - 2019-09-27
+
 ### Changed
+
 - Fix some issues with ImxHost
 
 ## [2.0.3] - 2019-09-23
+
 ### Changed
+
 - Update deb dependencies
 
 ## [2.0.2] - 2019-09-23
+
 ### Changed
+
 - Add portable mode
 
 ## [2.0.1] - 2019-09-22
+
 ### Changed
+
 - Change app name
 
 ## [2.0.0] - 2019-09-22
+
 ### Added
+
 - Add sub folder option
 - Add clear finished option
+
 ### Changed
+
 - UI enhancements
 - Bug fixes
 - Change data and log paths
 
 ## [1.6.5] - 2019-09-18
+
 ### Changed
+
 - electron update
 
 ## [1.6.4] - 2019-09-18
+
 ### Changed
+
 - Change menu item name
 
 ## [1.6.3] - 2019-09-18
+
 ### Changed
+
 - Better multithread management
 - Fix partial state UI
 
 ## [1.6.2] - 2019-09-17
+
 ### Changed
+
 - Rework UI colors
 - Fix scan input bug
 
 ## [1.6.1] - 2019-09-16
+
 ### Changed
+
 - Rework UI
 - Fix clipboard monitoring
 
 ## [1.6.0] - 2019-09-15
+
 ### Changed
+
 - Rework the UI
 - Add a dark theme
 - Fix the force ordering bug
 - Other bug fixes
 
 ## [1.5.2] - 2019-09-01
+
 ### Added
+
 - imx.to host fix
 
 ## [1.5.1] - 2019-08-24
+
 ### Added
+
 - Bug fixes
 
 ## [1.5.0] - 2019-08-24
+
 ### Added
+
 - Display logged in user
 - Add post details when clicking on main list items (Status, Post URL, Host)
 - Add open download location on main list items menu
@@ -282,86 +628,126 @@
 - Add link to image from details list
 
 ## [1.4.10] - 2019-08-15
+
 ### Changed
+
 - Fix a rename issue on windows
 
 ## [1.4.9] - 2019-08-13
+
 ### Changed
+
 - Update Built-By to be generic
 
 ## [1.4.8] - 2019-08-13
+
 ### Changed
+
 - Add option to force image ordering
 
 ## [1.4.7] - 2019-08-13
+
 ### Changed
-- Fixed a bug in image filename extensions 
+
+- Fixed a bug in image filename extensions
 
 ## [1.4.6] - 2019-08-06
+
 ### Changed
+
 - Fixed a bug when creating image file names
 - Remove unnecessary logs
-- Fix data.json init 
+- Fix data.json init
 
 ## [1.4.5] - 2019-08-03
+
 ### Changed
+
 - Add min width and height for electron app
+
 ### Added
+
 - Add download speed to status bar
 
 ## [1.4.4] - 2019-08-01
+
 ### Changed
+
 - Fix names for ImgboxHost
 - Enhance UI
 - Minor fixes
+
 ### Added
+
 - Add start and stop button
 
 ## [1.4.3] - 2019-07-14
+
 ### Changed
+
 - Update some messages
 - Fix scrolling issue
 
 ## [1.4.2] - 2019-07-14
+
 ### Changed
+
 - Fix layout issue in web mode
 
 ## [1.4.1] - 2019-07-14
+
 ### Changed
+
 - Change title's font
+
 ### Added
+
 - Add borders
 
 ## [1.4.0] - 2019-07-14
+
 ### Changed
+
 - Better error handling on startup
 - Better support for linux AppImage
+
 ### Added
+
 - Clear all completed
 - Add clipboard support
 - Add option to remove all posts
 - Add confirmation on remove
 
 ## [1.3.0-rc0] - 2019-07-04
+
 ### Changed
+
 - Change default setting for autostart false -> true
 - Change default setting for max concurrent downloads 1 -> 4
+
 ### Added
+
 - Desktop app built with electron
 - Add the option to remove a post
 
 ## [1.2.0] - 2019-06-23
+
 ### Added
+
 - Add a shutdown button to gracefully shutdown the app
 - Open and redirect the browser to the app address on startup
 - Add the option to run the app in headless mode (-Djava.awt.headless=true)
 
 ## [1.1.1] - 2019-06-22
+
 ### Changed
+
 - Fix a stability issue with progress updates when the app is runninh for a long time
 
 ## [1.0.0] - 2019-06-22
+
 ### Added
+
 - Add real time communication for progress updates via websocket (SockJS)
 - Add settings for download path, max concurrent download, enable/disable integration with vipergirls
 - Add integration with vipergitls.to (possibility to auto leave thanks after grab post)

README.md

@@ -1,24 +1,35 @@
-# Viper Ripper!
+# VRipper!
 
-This is my spin for a cross platform gallery ripper app for [vipergirls](https://vipergirls.to) website.
-The purpose of this project is to build a robust and clean application to conveniently download photo galleries using modern web technologies, Java + Spring boot for the back end and angular + electron for the front end.
+This is my spin for a cross platform gallery ripper app for [vipergirls](https://vipergirls.to) website. The purpose of
+this project is to build a robust and clean application to conveniently download photo galleries using modern web
+technologies, Java + Spring boot for the back end and angular + electron for the front end.
 
 ## How to build
+
 You need a recent version of maven 3.6.1+.
 
 The application support 2 build modes:
- - Desktop app: Self contained app, built with electron includes Java runtimes.
- - Server app: Depends on Java runtimes, you need a web browser to access the app UI.
 
-Most people will be interested only on the desktop app, however if you have a nas or a server, the server app is there for you.
+- Desktop app: Self contained app, built with electron includes Java runtimes.
+- Server app: Depends on Java runtimes, you need a web browser to access the app UI.
+
+Most people will be interested only on the desktop app, however if you have a nas or a server, the server app is there
+for you.
 
 To build the server app:
 
     mvn clean install -DskipTests
+
 To build the desktop app:
 
     mvn clean install -Pelectron -DskipTests
 
-Maven will automatically handle front end compilation. However, for development, you will need to install a recent version of nodejs on your system.
+Maven will automatically handle front end compilation. However, for development, you will need to install a recent
+version of nodejs on your system.
 
-[![Donate with PayPal](https://raw.githubusercontent.com/stefan-niedermann/paypal-donate-button/master/paypal-donate-button.png)](https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=SC7M5LNWZ528Q)
+If you feel generous and want to support me, you can donate some coins, and I would be very grateful 🙏
+
+I accept [PayPal](https://www.paypal.com/myaccount/transfer/homepage/buy/preview) donations, following is my email
+address
+
+    dev.vripper@gmail.com

pom.xml

@@ -4,17 +4,17 @@
     <modelVersion>4.0.0</modelVersion>
     <groupId>tn.mnlr</groupId>
     <artifactId>vripper</artifactId>
-    <version>2.11.7</version>
+    <version>3.5.4</version>
     <packaging>pom</packaging>
     <parent>
         <groupId>org.springframework.boot</groupId>
         <artifactId>spring-boot-starter-parent</artifactId>
-        <version>2.1.1.RELEASE</version>
-        <relativePath/> <!-- lookup parent from repository -->
+        <version>2.4.5</version>
+        <relativePath/>
     </parent>
     <modules>
         <module>vripper-server</module>
         <module>vripper-ui</module>
         <module>vripper-electron</module>
     </modules>
-</project>
+</project>

vripper-electron/main.js

@@ -1,13 +1,17 @@
 require('v8-compile-cache');
-const { app, BrowserWindow } = require("electron");
+const {app, BrowserWindow} = require("electron");
 const path = require("path");
 const url = require("url");
 const getPort = require("get-port");
-const { spawn } = require("child_process");
-const { ipcMain } = require("electron");
-const { dialog } = require("electron");
+const {spawn} = require("child_process");
+const {ipcMain} = require("electron");
+const {dialog} = require("electron");
 const axios = require('axios');
-const appDir = process.env.APPDIR;
+const windowStateKeeper = require('electron-window-state');
+
+// non null value when it is an AppImage
+const appImageDir = process.env.APPDIR;
+const appImagePath = process.env.APPIMAGE;
 
 let win;
 let vripperServer;
@@ -23,29 +27,39 @@ process.on("uncaughtException", err => {
     process.exit(1);
 });
 
-function createWindow() {
+createWindow = () => {
 
     if (process.platform === 'win32') {
-        app.setAppUserModelId("tn.mnlr.vripper");
+        app.setAppUserModelId('tn.mnlr.vripper');
     }
 
     let icon;
-    if(process.platform === "win32") {
+    if (process.platform === 'win32') {
         icon = __dirname + '/icon.ico';
-    } else {
+    } else if (process.platform === 'linux') {
         icon = __dirname + '/icon.png';
     }
+
+    const mainWindowState = windowStateKeeper({
+        defaultWidth: 1024,
+        defaultHeight: 800
+    });
+
     win = new BrowserWindow({
-        width: 1024,
-        height: 800,
+        x: mainWindowState.x,
+        y: mainWindowState.y,
+        width: mainWindowState.width,
+        height: mainWindowState.height,
         minWidth: 800,
         minHeight: 600,
         webPreferences: {
-            nodeIntegration: true
+            nodeIntegration: true,
+            enableRemoteModule: true
         },
         icon: icon
     });
 
+    mainWindowState.manage(win);
     win.removeMenu();
     win.setMenu(null);
     win.setMenuBarVisibility(false);
@@ -65,6 +79,33 @@ function createWindow() {
     });
 }
 
+shutdownServer = () => {
+    axios.post('http://localhost:' + serverPort + '/actuator/shutdown', {}, {
+        headers: {'content-type': 'application/json'},
+    }).then((response) => {
+        terminationInteval = setInterval(() => {
+            terminationAttemps++;
+            if (terminated) {
+                console.log('viper server terminated');
+                clearInterval(terminationInteval);
+                app.quit();
+            } else if (terminationAttemps > maxTerminationAttemps) {
+                console.log('viper server is not terminated');
+                console.log('Proceed to kill');
+                vripperServer.kill('SIGKILL');
+                clearInterval(terminationInteval);
+                app.quit();
+            }
+        }, 1000);
+    }).catch((error) => {
+        // Terminate immediately
+        console.log(error);
+        vripperServer.kill('SIGKILL');
+        terminated = true;
+        app.quit();
+    });
+}
+
 const gotTheLock = app.requestSingleInstanceLock();
 
 if (!gotTheLock) {
@@ -75,29 +116,31 @@ if (!gotTheLock) {
         ipcMain.on("get-port", event => {
             event.reply("port", port);
         });
-        let javaBinPath;
-        if(appDir !== undefined) {
-            javaBinPath = path.join(appDir, "java-runtime/bin/java");
+
+        const appPath = path.join(app.getAppPath(), '../../');
+        let javaBinPath, jarPath, baseDir;
+        if (appImageDir !== undefined && process.platform === 'linux') {
+            javaBinPath = path.join(appImageDir, "java-runtime/bin/java");
+            jarPath = path.join(appImageDir, "bin/vripper-server.jar");
+            baseDir = path.join(appImagePath, '..');
+        } else if (process.platform === 'darwin') {
+            javaBinPath = path.join(appPath, "java-runtime/bin/java");
+            jarPath = path.join(appPath, "bin/vripper-server.jar");
+            baseDir = app.getPath('appData');
+        } else if (process.platform === 'win32') {
+            javaBinPath = path.join(appPath, "java-runtime/bin/java");
+            jarPath = path.join(appPath, "bin/vripper-server.jar");
+            baseDir = appPath;
         } else {
-            if(process.platform === 'darwin') {
-                javaBinPath = path.join(app.getPath('exe'), "../../java-runtime/bin/java");
-            } else {
-                javaBinPath = path.join(app.getPath('exe'), "../java-runtime/bin/java");
-            }
-        }
-        let jarPath;
-        if(appDir !== undefined) {
-            jarPath = path.join(appDir, "bin/vripper-server.jar");
-        } else {
-            if(process.platform === 'darwin') {
-                jarPath = path.join(app.getPath('exe'), "../../bin/vripper-server.jar");
-            } else {
-                jarPath = path.join(app.getPath('exe'), "../bin/vripper-server.jar");
-            }
+            console.error(`Unknown platform ${process.platform}`);
+            app.quit();
         }
+
         vripperServer = spawn(javaBinPath, [
             "-Xms256m",
             "-Dvripper.server.port=" + port,
+            "-Dbase.dir=" + baseDir,
+            "-Djava.net.preferIPv4Stack=true",
             "-jar",
             jarPath
         ], {
@@ -121,31 +164,13 @@ if (!gotTheLock) {
 
     app.on("window-all-closed", () => {
         if (process.platform !== "darwin") {
-            axios.post('http://localhost:' + serverPort + '/actuator/shutdown', {}, {
-                headers: { 'content-type': 'application/json' },
-            }).then((response) => {
-                terminationInteval=  setInterval(() => {
-                    terminationAttemps++;
-                    if(terminated) {
-                        console.log('viper server terminated');
-                        clearInterval(terminationInteval);
-                        app.quit();
-                    } else if(terminationAttemps > maxTerminationAttemps) {
-                        console.log('viper server is not terminated');
-                        console.log('Proceed to kill');
-                        vripperServer.kill('SIGKILL');
-                        clearInterval(terminationInteval);
-                        app.quit();
-                    }
-                }, 1000);
-            })
-                .catch((error) => {
-                    // Terminate immediately
-                    console.log(error);
-                    vripperServer.kill('SIGKILL');
-                    terminated = true;
-                    app.quit();
-                });
+            shutdownServer();
+        }
+    });
+
+    app.on("will-quit", () => {
+        if (process.platform === "darwin") {
+            shutdownServer();
         }
     });
 

vripper-electron/package.json

@@ -1,6 +1,6 @@
 {
   "name": "vripper-electron",
-  "version": "2.11.7",
+  "version": "3.5.4",
   "description": "A ripper for vipergirls.to built using web technolgies",
   "main": "main.js",
   "author": "death-claw <53543762+death-claw@users.noreply.github.com>",
@@ -22,6 +22,10 @@
       "!**/{__pycache__,thumbs.db,.flowconfig,.idea,.vs,.nyc_output}",
       "!**/{appveyor.yml,.travis.yml,circle.yml}",
       "!**/{npm-debug.log,yarn.lock,.yarn-integrity,.yarn-metadata.json}",
+      "!**/build-dir",
+      "!**/java-runtime",
+      "!**/pre-build.js",
+      "!**/pom.xml",
       {
         "from": "./build/",
         "to": "."
@@ -40,19 +44,13 @@
     "win": {
       "icon": "icon.ico",
       "target": [
-        "nsis"
+        "dir"
       ]
     },
-    "nsis": {
-      "createDesktopShortcut": "always",
-      "oneClick": false,
-      "perMachine": false
-    },
     "linux": {
       "synopsis": "vipergirls.to ripper",
       "category": "Utility",
       "packageCategory": "Utility",
-      "icon": "icons",
       "target": [
         "AppImage"
       ]
@@ -70,16 +68,17 @@
     "dist": "node pre-build.js && electron-builder"
   },
   "devDependencies": {
-    "electron": "8.2.4",
-    "electron-builder": "22.6.0"
+    "electron": "11.1.1",
+    "electron-builder": "22.9.1"
   },
   "dependencies": {
-    "axios": "^0.19.0",
-    "cheerio": "^1.0.0-rc.3",
-    "copy-dir": "^1.1.0",
-    "electron-context-menu": "^0.13.0",
-    "get-port": "^5.0.0",
-    "rimraf": "^2.6.3",
-    "v8-compile-cache": "^2.1.0"
+    "axios": "0.21.1",
+    "cheerio": "1.0.0-rc.3",
+    "copy-dir": "1.3.0",
+    "electron-context-menu": "2.1.0",
+    "electron-window-state": "^5.0.3",
+    "get-port": "5.1.1",
+    "rimraf": "3.0.2",
+    "v8-compile-cache": "2.1.1"
   }
 }

vripper-electron/pom.xml

@@ -1,77 +1,77 @@
 <?xml version="1.0"?>
-<project xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"
-         xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
-  <modelVersion>4.0.0</modelVersion>
-  <parent>
-    <groupId>tn.mnlr</groupId>
-    <artifactId>vripper</artifactId>
-    <version>2.11.7</version>
-  </parent>
-  <artifactId>vripper-electron</artifactId>
-  <name>vripper-electron</name>
-  <build>
-    <plugins>
-      <plugin>
-        <artifactId>maven-jar-plugin</artifactId>
-        <configuration>
-          <classifier>${buildClassifier}</classifier>
-        </configuration>
-      </plugin>
-    </plugins>
-  </build>
-  <profiles>
-    <profile>
-      <id>electron</id>
-      <properties>
-        <buildClassifier>electron</buildClassifier>
-      </properties>
-      <dependencies>
-        <dependency>
-          <groupId>tn.mnlr</groupId>
-          <artifactId>vripper-server</artifactId>
-          <version>${project.version}</version>
-          <scope>runtime</scope>
-          <classifier>${buildClassifier}</classifier>
-        </dependency>
-      </dependencies>
-      <build>
+<project xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
+         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"
+         xmlns="http://maven.apache.org/POM/4.0.0">
+    <modelVersion>4.0.0</modelVersion>
+    <parent>
+        <groupId>tn.mnlr</groupId>
+        <artifactId>vripper</artifactId>
+        <version>3.5.4</version>
+    </parent>
+    <artifactId>vripper-electron</artifactId>
+    <name>vripper-electron</name>
+    <build>
         <plugins>
-          <plugin>
-            <groupId>com.github.eirslett</groupId>
-            <artifactId>frontend-maven-plugin</artifactId>
-            <version>1.3</version>
-            <configuration>
-              <nodeVersion>v12.2.0</nodeVersion>
-              <npmVersion>6.9.0</npmVersion>
-              <workingDirectory>build-dir</workingDirectory>
-            </configuration>
-            <executions>
-              <execution>
-                <id>install node and npm</id>
-                <goals>
-                  <goal>install-node-and-npm</goal>
-                </goals>
-              </execution>
-              <execution>
-                <id>npm install</id>
-                <goals>
-                  <goal>npm</goal>
-                </goals>
-              </execution>
-              <execution>
-                <id>npm run build</id>
-                <goals>
-                  <goal>npm</goal>
-                </goals>
+            <plugin>
+                <artifactId>maven-jar-plugin</artifactId>
                 <configuration>
-                  <arguments>run dist</arguments>
+                    <classifier>${buildClassifier}</classifier>
                 </configuration>
-                <phase>generate-resources</phase>
-              </execution>
-            </executions>
-          </plugin>
+            </plugin>
         </plugins>
-      </build>
-    </profile>
-  </profiles>
+    </build>
+    <profiles>
+        <profile>
+            <id>electron</id>
+            <properties>
+                <buildClassifier>electron</buildClassifier>
+            </properties>
+            <dependencies>
+                <dependency>
+                    <groupId>tn.mnlr</groupId>
+                    <artifactId>vripper-server</artifactId>
+                    <version>${project.version}</version>
+                    <scope>runtime</scope>
+                    <classifier>${buildClassifier}</classifier>
+                </dependency>
+            </dependencies>
+            <build>
+                <plugins>
+                    <plugin>
+                        <groupId>com.github.eirslett</groupId>
+                        <artifactId>frontend-maven-plugin</artifactId>
+                        <version>1.11.2</version>
+                        <configuration>
+                            <nodeVersion>v14.16.0</nodeVersion>
+                            <yarnVersion>v1.22.10</yarnVersion>
+                            <workingDirectory>build-dir</workingDirectory>
+                        </configuration>
+                        <executions>
+                            <execution>
+                                <id>install node and yarn</id>
+                                <goals>
+                                    <goal>install-node-and-yarn</goal>
+                                </goals>
+                            </execution>
+                            <execution>
+                                <id>yarn install</id>
+                                <goals>
+                                    <goal>yarn</goal>
+                                </goals>
+                            </execution>
+                            <execution>
+                                <id>yarn run build</id>
+                                <goals>
+                                    <goal>yarn</goal>
+                                </goals>
+                                <configuration>
+                                    <arguments>run dist</arguments>
+                                </configuration>
+                            </execution>
+                        </executions>
+                    </plugin>
+                </plugins>
+            </build>
+        </profile>
+    </profiles>
 </project>

vripper-electron/pre-build.js

@@ -2,7 +2,7 @@ const cheerio = require('cheerio');
 const fs = require('fs');
 const rimraf = require("rimraf");
 const copydir = require("copy-dir");
-const { execSync } = require("child_process");
+const {execSync} = require("child_process");
 
 rimraf.sync('./build/vripper-ui');
 copydir.sync('../vripper-ui/dist/vripper-ui', './build/vripper-ui', {});
@@ -18,8 +18,8 @@ fs.writeFileSync('./build/vripper-ui/index.html', $.html());
 
 console.log('Building runtime environment');
 rimraf.sync('java-runtime');
-execSync('jlink --no-header-files --no-man-pages --compress=2 --strip-debug --add-modules java.base,java.desktop,java.instrument,java.management,java.naming,java.prefs,java.rmi,java.scripting,java.security.jgss,java.sql,jdk.httpserver,jdk.unsupported,jdk.crypto.ec --output java-runtime');
-if(process.platform === 'linux') {
+execSync('jlink --no-header-files --no-man-pages --compress=2 --strip-debug --add-modules java.base,java.desktop,java.instrument,java.management,java.security.jgss,java.sql,jdk.unsupported,jdk.crypto.ec --output java-runtime');
+if (process.platform === 'linux') {
     console.log('Stripping libjvm.so');
     execSync('strip -p --strip-unneeded java-runtime/lib/server/libjvm.so');
-}
+}

vripper-electron/vripper-electron.iml

@@ -0,0 +1,12 @@
+<?xml version="1.0" encoding="UTF-8"?>
+<module org.jetbrains.idea.maven.project.MavenProjectsManager.isMavenModule="true" type="JAVA_MODULE" version="4">
+  <component name="NewModuleRootManager" LANGUAGE_LEVEL="JDK_1_8">
+    <output url="file://$MODULE_DIR$/target/classes" />
+    <output-test url="file://$MODULE_DIR$/target/test-classes" />
+    <content url="file://$MODULE_DIR$">
+      <excludeFolder url="file://$MODULE_DIR$/target" />
+    </content>
+    <orderEntry type="inheritedJdk" />
+    <orderEntry type="sourceFolder" forTests="false" />
+  </component>
+</module>

vripper-server/pom.xml

@@ -1,11 +1,11 @@
 <?xml version="1.0" encoding="UTF-8"?>
-<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
+<project xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://maven.apache.org/POM/4.0.0"
          xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
     <modelVersion>4.0.0</modelVersion>
     <parent>
         <groupId>tn.mnlr</groupId>
         <artifactId>vripper</artifactId>
-        <version>2.11.7</version>
+        <version>3.5.4</version>
     </parent>
     <artifactId>vripper-server</artifactId>
     <name>vripper-server</name>
@@ -16,14 +16,6 @@
     </properties>
 
     <dependencies>
-        <dependency>
-            <groupId>org.springframework.boot</groupId>
-            <artifactId>spring-boot-starter-jersey</artifactId>
-        </dependency>
-        <dependency>
-            <groupId>org.springframework.boot</groupId>
-            <artifactId>spring-boot-starter-web</artifactId>
-        </dependency>
         <dependency>
             <groupId>org.springframework.boot</groupId>
             <artifactId>spring-boot-starter-websocket</artifactId>
@@ -32,6 +24,19 @@
             <groupId>org.springframework.boot</groupId>
             <artifactId>spring-boot-starter-actuator</artifactId>
         </dependency>
+        <dependency>
+            <groupId>org.springframework.boot</groupId>
+            <artifactId>spring-boot-starter-data-jdbc</artifactId>
+        </dependency>
+        <dependency>
+            <groupId>org.liquibase</groupId>
+            <artifactId>liquibase-core</artifactId>
+        </dependency>
+        <dependency>
+            <groupId>org.hsqldb</groupId>
+            <artifactId>hsqldb</artifactId>
+            <scope>runtime</scope>
+        </dependency>
         <dependency>
             <groupId>org.projectlombok</groupId>
             <artifactId>lombok</artifactId>
@@ -50,17 +55,15 @@
         <dependency>
             <groupId>org.apache.httpcomponents</groupId>
             <artifactId>httpclient</artifactId>
-            <version>4.5.6</version>
         </dependency>
         <dependency>
             <groupId>net.sourceforge.htmlcleaner</groupId>
             <artifactId>htmlcleaner</artifactId>
-            <version>2.22</version>
+            <version>2.24</version>
         </dependency>
         <dependency>
-            <groupId>io.reactivex.rxjava2</groupId>
-            <artifactId>rxjava</artifactId>
-            <version>2.2.6</version>
+            <groupId>io.projectreactor</groupId>
+            <artifactId>reactor-core</artifactId>
         </dependency>
         <dependency>
             <groupId>net.jodah</groupId>
@@ -68,14 +71,8 @@
             <version>2.0.1</version>
         </dependency>
         <dependency>
-            <groupId>com.google.guava</groupId>
-            <artifactId>guava</artifactId>
-            <version>28.1-jre</version>
-        </dependency>
-        <dependency>
-            <groupId>org.imgscalr</groupId>
-            <artifactId>imgscalr-lib</artifactId>
-            <version>4.2</version>
+            <groupId>com.github.ben-manes.caffeine</groupId>
+            <artifactId>caffeine</artifactId>
         </dependency>
         <dependency>
             <groupId>tn.mnlr</groupId>
@@ -92,6 +89,12 @@
                 <artifactId>maven-jar-plugin</artifactId>
                 <configuration>
                     <classifier>${buildClassifier}</classifier>
+                    <archive>
+                        <manifestEntries>
+                            <Build-Time>${maven.build.timestamp}</Build-Time>
+                            <Built-By>${user.name}</Built-By>
+                        </manifestEntries>
+                    </archive>
                 </configuration>
             </plugin>
             <plugin>
@@ -109,54 +112,6 @@
                     </execution>
                 </executions>
             </plugin>
-            <plugin>
-                <groupId>pl.project13.maven</groupId>
-                <artifactId>git-commit-id-plugin</artifactId>
-                <version>3.0.0</version>
-                <executions>
-                    <execution>
-                        <id>get-the-git-infos</id>
-                        <goals>
-                            <goal>revision</goal>
-                        </goals>
-                    </execution>
-                    <execution>
-                        <id>validate-the-git-infos</id>
-                        <goals>
-                            <goal>validateRevision</goal>
-                        </goals>
-                    </execution>
-                </executions>
-                <configuration>
-                    <dotGitDirectory>${project.parent.basedir}/.git</dotGitDirectory>
-                </configuration>
-            </plugin>
-            <plugin>
-                <groupId>org.apache.maven.plugins</groupId>
-                <artifactId>maven-jar-plugin</artifactId>
-                <version>3.1.0</version>
-                <configuration>
-                    <archive>
-                        <manifestEntries>
-                            <Build-Time>${maven.build.timestamp}</Build-Time>
-                            <Built-By>${user.name}</Built-By>
-                        </manifestEntries>
-                        <manifestSections>
-                            <manifestSection>
-                                <name>Versions</name>
-                                <manifestEntries>
-                                    <Implementation-Version>${git.build.version}</Implementation-Version>
-                                    <Implementation-SCM-Revision>${git.commit.id}</Implementation-SCM-Revision>
-                                    <Implementation-SCM-Branch>${git.branch}</Implementation-SCM-Branch>
-                                    <Implementation-SCM-Time>${git.build.time}</Implementation-SCM-Time>
-                                    <Implementation-SCM-Dirty>${git.dirty}</Implementation-SCM-Dirty>
-                                    <Implementation-SCM-Tags>${git.tags}</Implementation-SCM-Tags>
-                                </manifestEntries>
-                            </manifestSection>
-                        </manifestSections>
-                    </archive>
-                </configuration>
-            </plugin>
         </plugins>
     </build>
 

vripper-server/src/main/java/tn/mnlr/vripper/EventListenerBean.java

@@ -5,20 +5,27 @@ import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.context.event.ContextRefreshedEvent;
 import org.springframework.context.event.EventListener;
 import org.springframework.stereotype.Component;
-import tn.mnlr.vripper.services.PersistenceService;
+import tn.mnlr.vripper.jpa.repositories.IPostRepository;
+import tn.mnlr.vripper.services.DataService;
 
 @Component
 public class EventListenerBean {
 
-    @Autowired
-    private PersistenceService persistenceService;
+  @Getter private static boolean init = false;
 
-    @Getter
-    private static boolean init = false;
+  private final IPostRepository postRepository;
+  private final DataService dataService;
 
-    @EventListener
-    public void onApplicationEvent(ContextRefreshedEvent event) {
-        init = true;
-        persistenceService.restore();
-    }
-}
+  @Autowired
+  public EventListenerBean(IPostRepository postRepository, DataService dataService) {
+    this.postRepository = postRepository;
+    this.dataService = dataService;
+  }
+
+  @EventListener
+  public void onApplicationEvent(ContextRefreshedEvent event) {
+    postRepository.setDownloadingToStopped();
+    dataService.sortPostsByRank();
+    init = true;
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/SpringContext.java

@@ -1,7 +1,6 @@
 package tn.mnlr.vripper;
 
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
+import lombok.extern.slf4j.Slf4j;
 import org.springframework.beans.BeansException;
 import org.springframework.context.ApplicationContext;
 import org.springframework.context.ApplicationContextAware;
@@ -11,32 +10,30 @@ import org.springframework.stereotype.Component;
 import java.util.Map;
 
 @Component
+@Slf4j
 public class SpringContext implements ApplicationContextAware {
 
-    private static final Logger logger = LoggerFactory.getLogger(SpringContext.class);
+  private static ConfigurableApplicationContext context;
 
-    private static ConfigurableApplicationContext context;
+  public static <T> T getBean(Class<T> beanClass) {
+    return context.getBean(beanClass);
+  }
 
-    public static <T> T getBean(Class<T> beanClass) {
-        return context.getBean(beanClass);
+  public static <T> Map<String, T> getBeansOfType(Class<T> beanClass) {
+    return context.getBeansOfType(beanClass);
+  }
+
+  public static void close() {
+    log.info("Application terminating...");
+    if (context != null) {
+      context.close();
     }
+  }
 
-    public static <T> Map<String, T> getBeansOfType(Class<T> beanClass) {
-        return context.getBeansOfType(beanClass);
-    }
+  @Override
+  public void setApplicationContext(ApplicationContext context) throws BeansException {
 
-    public static void close() {
-        logger.info("Application terminating...");
-        if (context != null) {
-            context.close();
-        }
-
-    }
-
-    @Override
-    public void setApplicationContext(ApplicationContext context) throws BeansException {
-
-        // store ApplicationContext reference to access required beans later on
-        SpringContext.context = ((ConfigurableApplicationContext) context);
-    }
-}
+    // store ApplicationContext reference to access required beans later on
+    SpringContext.context = ((ConfigurableApplicationContext) context);
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/Utils.java

@@ -0,0 +1,24 @@
+package tn.mnlr.vripper;
+
+import lombok.extern.slf4j.Slf4j;
+
+import java.io.IOException;
+import java.io.PrintWriter;
+import java.io.StringWriter;
+
+@Slf4j
+public class Utils {
+
+  public static String throwableToString(Throwable th) {
+    try (StringWriter stringWriter = new StringWriter();
+        PrintWriter printWriter = new PrintWriter(stringWriter)) {
+      th.printStackTrace(printWriter);
+      printWriter.flush();
+      stringWriter.flush();
+      return stringWriter.toString();
+    } catch (IOException e) {
+      log.error("Failed to convert throwable to string", e);
+    }
+    return "Cannot display error, please check the log file for details";
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/VripperApplication.java

@@ -1,31 +1,19 @@
 package tn.mnlr.vripper;
 
-import net.jodah.failsafe.RetryPolicy;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
+import lombok.extern.slf4j.Slf4j;
 import org.springframework.boot.SpringApplication;
 import org.springframework.boot.autoconfigure.SpringBootApplication;
 
-import java.time.temporal.ChronoUnit;
-
 @SpringBootApplication
+@Slf4j
 public class VripperApplication {
 
-    private static final Logger logger = LoggerFactory.getLogger(VripperApplication.class);
-    public static final RetryPolicy<Object> retryPolicy = new RetryPolicy<>()
-            .handleIf(e -> !(e instanceof InterruptedException))
-            .withDelay(1, 3, ChronoUnit.SECONDS)
-            .withMaxAttempts(5)
-            .abortOn(InterruptedException.class)
-            .onFailedAttempt(e -> logger.warn(String.format("#%d tries failed", e.getAttemptCount()), e.getLastFailure()));
-
-    public static void main(String[] args) {
-        try {
-            Runtime.getRuntime().addShutdownHook(new Thread(SpringContext::close));
-            SpringApplication.run(VripperApplication.class, args);
-        } catch (Exception e) {
-            logger.error("Failed to run the application", e);
-        }
+  public static void main(String[] args) {
+    try {
+      Runtime.getRuntime().addShutdownHook(new Thread(SpringContext::close));
+      SpringApplication.run(VripperApplication.class, args);
+    } catch (Exception e) {
+      log.error("Failed to run the application", e);
     }
+  }
 }
-

vripper-server/src/main/java/tn/mnlr/vripper/download/DownloadJob.java

@@ -0,0 +1,295 @@
+package tn.mnlr.vripper.download;
+
+import lombok.Getter;
+import lombok.extern.slf4j.Slf4j;
+import net.jodah.failsafe.function.CheckedRunnable;
+import org.apache.http.client.HttpClient;
+import org.apache.http.client.methods.AbstractExecutionAwareRequest;
+import org.apache.http.client.methods.CloseableHttpResponse;
+import org.apache.http.client.methods.HttpGet;
+import org.apache.http.client.protocol.HttpClientContext;
+import org.apache.http.impl.client.BasicCookieStore;
+import org.apache.http.util.EntityUtils;
+import tn.mnlr.vripper.SpringContext;
+import tn.mnlr.vripper.exception.DownloadException;
+import tn.mnlr.vripper.exception.HostException;
+import tn.mnlr.vripper.jpa.domain.Image;
+import tn.mnlr.vripper.jpa.domain.Post;
+import tn.mnlr.vripper.jpa.domain.enums.Status;
+import tn.mnlr.vripper.services.*;
+import tn.mnlr.vripper.services.domain.Settings;
+
+import javax.imageio.ImageIO;
+import javax.imageio.ImageReader;
+import javax.imageio.stream.ImageInputStream;
+import java.io.File;
+import java.io.FileOutputStream;
+import java.io.IOException;
+import java.io.InputStream;
+import java.nio.file.Files;
+import java.nio.file.StandardCopyOption;
+import java.util.*;
+
+@Slf4j
+public class DownloadJob implements CheckedRunnable {
+
+  private static final Object LOCK = new Object();
+  private static final int READ_BUFFER_SIZE = 8192;
+  private final DataService dataService;
+  private final PathService pathService;
+  private final ConnectionService cm;
+  private final VGAuthService authService;
+  private final DownloadSpeedService downloadSpeedService;
+  private final Settings settings;
+  private final HttpClientContext context;
+  @Getter private final Image image;
+  @Getter private final Post post;
+  private volatile boolean stopped = false;
+  @Getter private volatile boolean finished = false;
+
+  DownloadJob(Post post, Image image, Settings settings) {
+    this.image = image;
+    this.post = post;
+    this.settings = settings;
+    dataService = SpringContext.getBean(DataService.class);
+    pathService = SpringContext.getBean(PathService.class);
+    cm = SpringContext.getBean(ConnectionService.class);
+    authService = SpringContext.getBean(VGAuthService.class);
+    downloadSpeedService = SpringContext.getBean(DownloadSpeedService.class);
+    context = HttpClientContext.create();
+    context.setCookieStore(new BasicCookieStore());
+    context.setAttribute(
+        ContextAttributes.OPEN_CONNECTION.toString(),
+        Collections.synchronizedList(new ArrayList<AbstractExecutionAwareRequest>()));
+  }
+
+  public void download(final Post post, final Image image) throws DownloadException {
+
+    try {
+
+      image.setStatus(Status.DOWNLOADING);
+      image.setCurrent(0);
+      dataService.updateImageStatus(image.getStatus(), image.getId());
+      dataService.updateImageCurrent(image.getCurrent(), image.getId());
+
+      synchronized (LOCK) {
+        if (!post.getStatus().equals(Status.DOWNLOADING)
+            && !post.getStatus().equals(Status.PARTIAL)) {
+          post.setStatus(Status.DOWNLOADING);
+          dataService.updatePostStatus(post.getStatus(), post.getId());
+        }
+
+        // The post may be updated and the download directory might be set by another thread
+        Post updatedPost = dataService.findById(post.getId()).orElseThrow();
+        if (updatedPost.getDownloadDirectory() == null) {
+          pathService.createDefaultPostFolder(updatedPost, settings);
+        }
+        if (settings.getLeaveThanksOnStart() != null && settings.getLeaveThanksOnStart()) {
+          authService.leaveThanks(updatedPost);
+        }
+      }
+
+      if (stopped) {
+        return;
+      }
+      /*
+       * HOST SPECIFIC
+       */
+      log.debug(
+          String.format(
+              "Getting image url and name from %s using %s", image.getUrl(), image.getHost()));
+      HostService.NameUrl nameAndUrl = image.getHost().getNameAndUrl(image.getUrl(), context);
+      log.debug(String.format("Resolved name for %s: %s", image.getUrl(), nameAndUrl.getName()));
+      log.debug(
+          String.format("Resolved image url for %s: %s", image.getUrl(), nameAndUrl.getUrl()));
+      /*
+       * END HOST SPECIFIC
+       */
+
+      if (stopped) {
+        return;
+      }
+      String formatImageFileName = pathService.formatImageFileName(nameAndUrl.getName());
+      log.debug(
+          String.format(
+              "Sanitizing image name from %s to %s", nameAndUrl.getName(), formatImageFileName));
+      nameAndUrl = new HostService.NameUrl(formatImageFileName, nameAndUrl.getUrl());
+
+      HttpClient client = cm.getClient().build();
+
+      log.debug(String.format("Downloading %s", nameAndUrl.getUrl()));
+      HttpGet httpGet = cm.buildHttpGet(nameAndUrl.getUrl(), context);
+      httpGet.addHeader("Referer", image.getUrl());
+      try (CloseableHttpResponse response =
+          (CloseableHttpResponse) client.execute(httpGet, context)) {
+
+        if (response.getStatusLine().getStatusCode() / 100 != 2) {
+          EntityUtils.consumeQuietly(response.getEntity());
+          throw new DownloadException(
+              String.format("Server returned code %d", response.getStatusLine().getStatusCode()));
+        }
+        if (stopped) {
+          return;
+        }
+        File outputFile = Files.createTempFile("vripper", "tmp").toFile();
+        try (InputStream downloadStream = response.getEntity().getContent();
+            FileOutputStream fos = new FileOutputStream(outputFile)) {
+
+          if (stopped) {
+            return;
+          }
+
+          image.setTotal(response.getEntity().getContentLength());
+          dataService.updateImageTotal(image.getTotal(), image.getId());
+
+          log.debug(String.format("%s length is %d", nameAndUrl.getUrl(), image.getTotal()));
+          log.debug(String.format("Starting data transfer for %s", nameAndUrl.getUrl()));
+
+          byte[] buffer = new byte[READ_BUFFER_SIZE];
+          int read;
+          while ((read = downloadStream.read(buffer, 0, READ_BUFFER_SIZE)) != -1 && !stopped) {
+            fos.write(buffer, 0, read);
+            image.increase(read);
+            downloadSpeedService.increase(read);
+            dataService.updateImageCurrent(image.getCurrent(), image.getId());
+          }
+          fos.flush();
+          EntityUtils.consumeQuietly(response.getEntity());
+          if (stopped) {
+            return;
+          }
+        }
+        checkImageTypeAndRename(
+            dataService.findById(post.getId()).orElseThrow(),
+            outputFile,
+            nameAndUrl.getName(),
+            image.getIndex());
+      }
+    } catch (Exception e) {
+      if (stopped) {
+        return;
+      }
+      throw new DownloadException(e);
+    } finally {
+      if (image.getCurrent() == image.getTotal() && image.getTotal() > 0) {
+        image.setStatus(Status.COMPLETE);
+      } else if (stopped) {
+        image.setStatus(Status.STOPPED);
+      } else {
+        image.setStatus(Status.ERROR);
+      }
+      dataService.updateImageStatus(image.getStatus(), image.getId());
+      finished = true;
+    }
+  }
+
+  private void checkImageTypeAndRename(Post post, File outputFile, String imageName, int index)
+      throws HostException {
+    try (ImageInputStream iis = ImageIO.createImageInputStream(outputFile)) {
+      Iterator<ImageReader> it = ImageIO.getImageReaders(iis);
+      if (!it.hasNext()) {
+        throw new HostException("Image file is not recognized!");
+      }
+      ImageReader reader = it.next();
+      if (reader.getFormatName().equalsIgnoreCase("JPEG")) {
+        String imageNameLC = imageName.toLowerCase();
+        if (!imageNameLC.endsWith("_jpg") && !imageNameLC.endsWith("_jpeg")) {
+          imageName += ".jpg";
+        } else {
+          String toReplace = null;
+          if (imageNameLC.endsWith("_jpg")) {
+            toReplace = "_jpg";
+          } else if (imageNameLC.endsWith("_jpeg")) {
+            toReplace = "_jpeg";
+          }
+          if (toReplace != null) {
+            imageName = imageName.substring(0, imageName.length() - toReplace.length()) + ".jpg";
+          }
+        }
+      } else if (reader.getFormatName().equalsIgnoreCase("PNG")) {
+        String imageNameLC = imageName.toLowerCase();
+        if (!imageNameLC.endsWith("_png")) {
+          imageName += ".png";
+        } else {
+          String toReplace = null;
+          if (imageNameLC.endsWith("_png")) {
+            toReplace = "_png";
+          }
+          if (toReplace != null) {
+            imageName = imageName.substring(0, imageName.length() - toReplace.length()) + ".png";
+          }
+        }
+      }
+    } catch (Exception e) {
+      throw new HostException("Failed to guess image format", e);
+    }
+    try {
+      pathService.getDirectoryAccess().lock();
+      File downloadDestinationFolder = pathService.calcDownloadDirectory(post, settings);
+      File outImage =
+          new File(
+              downloadDestinationFolder,
+              (settings.getForceOrder() ? String.format("%03d_", index) : "") + imageName);
+      Files.copy(outputFile.toPath(), outImage.toPath(), StandardCopyOption.REPLACE_EXISTING);
+    } catch (Exception e) {
+      throw new HostException("Failed to rename the image", e);
+    } finally {
+      pathService.getDirectoryAccess().unlock();
+      try {
+        Files.delete(outputFile.toPath());
+      } catch (IOException e) {
+        log.warn(String.format("Failed to delete temporary file %s", outputFile.getAbsolutePath()));
+      }
+    }
+  }
+
+  @Override
+  public void run() throws Exception {
+    if (stopped) {
+      finished = true;
+      return;
+    }
+    log.debug(String.format("Starting downloading %s", image.getUrl()));
+    download(post, image);
+  }
+
+  @Override
+  public boolean equals(Object o) {
+    if (this == o) return true;
+    if (o == null || getClass() != o.getClass()) return false;
+    DownloadJob that = (DownloadJob) o;
+    return Objects.equals(image, that.image) && Objects.equals(post, that.post);
+  }
+
+  @Override
+  public int hashCode() {
+    return Objects.hash(image, post);
+  }
+
+  public void stop() {
+    this.stopped = true;
+    List<AbstractExecutionAwareRequest> requests =
+        (List<AbstractExecutionAwareRequest>)
+            this.context.getAttribute(ContextAttributes.OPEN_CONNECTION.toString());
+    if (requests != null) {
+      for (AbstractExecutionAwareRequest request : requests) {
+        request.abort();
+      }
+    }
+  }
+
+  public enum ContextAttributes {
+    OPEN_CONNECTION("OPEN_CONNECTION");
+
+    private final String value;
+
+    ContextAttributes(String value) {
+      this.value = value;
+    }
+
+    @Override
+    public String toString() {
+      return value;
+    }
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/download/DownloadJobWrapper.java

@@ -0,0 +1,70 @@
+package tn.mnlr.vripper.download;
+
+import lombok.extern.slf4j.Slf4j;
+import net.jodah.failsafe.Failsafe;
+import tn.mnlr.vripper.SpringContext;
+import tn.mnlr.vripper.Utils;
+import tn.mnlr.vripper.jpa.domain.LogEvent;
+import tn.mnlr.vripper.jpa.domain.enums.Status;
+import tn.mnlr.vripper.jpa.repositories.ILogEventRepository;
+import tn.mnlr.vripper.services.ConnectionService;
+import tn.mnlr.vripper.services.DataService;
+
+import java.time.LocalDateTime;
+
+@Slf4j
+public class DownloadJobWrapper implements Runnable {
+
+  private final DownloadService downloadService;
+  private final DataService dataService;
+  private final ConnectionService connectionService;
+  private final ILogEventRepository eventRepository;
+
+  private final DownloadJob downloadJob;
+
+  public DownloadJobWrapper(final DownloadJob downloadJob) {
+    downloadService = SpringContext.getBean(DownloadService.class);
+    dataService = SpringContext.getBean(DataService.class);
+    connectionService = SpringContext.getBean(ConnectionService.class);
+    eventRepository = SpringContext.getBean(ILogEventRepository.class);
+
+    this.downloadJob = downloadJob;
+  }
+
+  @Override
+  public void run() {
+    Failsafe.with(connectionService.getRetryPolicy())
+        .onFailure(
+            e -> {
+              try {
+                LogEvent logEvent =
+                    new LogEvent(
+                        LogEvent.Type.DOWNLOAD,
+                        LogEvent.Status.ERROR,
+                        LocalDateTime.now(),
+                        String.format(
+                            "Failed to download %s\n %s",
+                            downloadJob.getImage().getUrl(),
+                            Utils.throwableToString(e.getFailure())));
+                eventRepository.save(logEvent);
+              } catch (Exception exp) {
+                log.error("Failed to save event", exp);
+              }
+              log.error(
+                  String.format(
+                      "Failed to download %s after %d tries",
+                      downloadJob.getImage().getUrl(), e.getAttemptCount()),
+                  e.getFailure());
+              downloadJob.getImage().setStatus(Status.ERROR);
+              dataService.updateImageStatus(
+                  downloadJob.getImage().getStatus(), downloadJob.getImage().getId());
+            })
+        .onComplete(
+            e -> {
+              dataService.afterJobFinish(downloadJob.getImage(), downloadJob.getPost());
+              downloadService.afterJobFinish(downloadJob);
+              log.debug(String.format("Finished downloading %s", downloadJob.getImage().getUrl()));
+            })
+        .run(downloadJob);
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/download/DownloadService.java

@@ -0,0 +1,277 @@
+package tn.mnlr.vripper.download;
+
+import lombok.NonNull;
+import lombok.extern.slf4j.Slf4j;
+import org.springframework.beans.factory.annotation.Autowired;
+import org.springframework.stereotype.Service;
+import tn.mnlr.vripper.host.Host;
+import tn.mnlr.vripper.jpa.domain.Image;
+import tn.mnlr.vripper.jpa.domain.Post;
+import tn.mnlr.vripper.jpa.domain.enums.Status;
+import tn.mnlr.vripper.services.DataService;
+import tn.mnlr.vripper.services.MetadataService;
+import tn.mnlr.vripper.services.SettingsService;
+import tn.mnlr.vripper.services.domain.Settings;
+
+import javax.annotation.PostConstruct;
+import java.util.*;
+import java.util.concurrent.ConcurrentHashMap;
+import java.util.concurrent.ExecutorService;
+import java.util.concurrent.Executors;
+import java.util.concurrent.TimeUnit;
+import java.util.concurrent.atomic.AtomicInteger;
+import java.util.stream.Collectors;
+
+@Service
+@Slf4j
+public class DownloadService {
+
+  private final int MAX_POOL_SIZE = 12;
+
+  private final ConcurrentHashMap<Host, AtomicInteger> threadCount = new ConcurrentHashMap<>();
+  private final ExecutorService executor = Executors.newFixedThreadPool(MAX_POOL_SIZE);
+  private final List<DownloadJob> running = new ArrayList<>();
+  private final List<DownloadJob> pending = new ArrayList<>();
+
+  private final SettingsService settingsService;
+  private final DataService dataService;
+  private final MetadataService metadataService;
+
+  private final List<Host> hosts;
+
+  private Thread pollThread;
+
+  @Autowired
+  public DownloadService(
+      SettingsService settingsService,
+      DataService dataService,
+      MetadataService metadataService,
+      List<Host> hosts) {
+    this.settingsService = settingsService;
+    this.dataService = dataService;
+    this.metadataService = metadataService;
+    this.hosts = hosts;
+  }
+
+  @PostConstruct
+  private void init() {
+    pollThread = new Thread(this::start, "Polling thread");
+    pollThread.start();
+  }
+
+  public void destroy() throws Exception {
+    log.info("Shutting down ExecutionService");
+    pollThread.interrupt();
+    executor.shutdown();
+    dataService
+        .findAllPosts()
+        .forEach(
+            p -> {
+              log.debug(String.format("Stopping download jobs for %s", p));
+              this.stopRunning(p.getPostId());
+            });
+    executor.awaitTermination(5, TimeUnit.SECONDS);
+  }
+
+  private synchronized void stopRunning(@NonNull String postId) {
+    List<DownloadJob> stopping = new ArrayList<>();
+    Iterator<DownloadJob> iterator = running.iterator();
+    while (iterator.hasNext()) {
+      DownloadJob downloadJob = iterator.next();
+      if (postId.equals(downloadJob.getPost().getPostId())) {
+        downloadJob.stop();
+        iterator.remove();
+        stopping.add(downloadJob);
+      }
+    }
+
+    while (!stopping.isEmpty()) {
+      stopping.removeIf(DownloadJob::isFinished);
+      try {
+        Thread.sleep(100);
+      } catch (InterruptedException e) {
+        Thread.currentThread().interrupt();
+      }
+    }
+  }
+
+  public void stopAll(List<String> postIds) {
+    stop(
+        Objects.requireNonNullElseGet(
+            postIds,
+            () ->
+                dataService.findAllPosts().stream()
+                    .map(Post::getPostId)
+                    .collect(Collectors.toList())));
+  }
+
+  public void restartAll(List<String> posIds) {
+    restart(
+        Objects.requireNonNullElseGet(
+            posIds,
+            () ->
+                dataService.findAllPosts().stream()
+                    .map(Post::getPostId)
+                    .collect(Collectors.toList())));
+  }
+
+  private void restart(@NonNull List<String> postIds) {
+    Map<Post, Collection<Image>> data = new HashMap<>();
+    for (String postId : postIds) {
+      if (isPending(postId)) {
+        log.warn(
+            String.format("Cannot restart, jobs are currently running for post id %s", postIds));
+        continue;
+      }
+      List<Image> images = dataService.findByPostIdAndIsNotCompleted(postId);
+      if (images.isEmpty()) {
+        continue;
+      }
+      Post post = dataService.findPostByPostId(postId).orElseThrow();
+      log.debug(String.format("Restarting %d jobs for post id %s", images.size(), postIds));
+      data.put(post, images);
+    }
+    enqueue(data);
+  }
+
+  private synchronized boolean isPending(String postId) {
+    return pending.stream().anyMatch(p -> p.getPost().getPostId().equals(postId));
+  }
+
+  private synchronized boolean isRunning(String postId) {
+    return running.stream().anyMatch(p -> p.getPost().getPostId().equals(postId));
+  }
+
+  private synchronized void stop(List<String> postIds) {
+
+    for (String postId : postIds) {
+      final Post post = dataService.findPostByPostId(postId).orElseThrow();
+      if (post == null) {
+        continue;
+      }
+      pending.removeIf(p -> p.getPost().equals(post));
+      stopRunning(postId);
+      dataService.stopImagesByPostIdAndIsNotCompleted(postId);
+      dataService.finishPost(post);
+    }
+    metadataService.stopFetchingMetadata(postIds);
+  }
+
+  private boolean canRun(Host host) {
+    boolean canRun;
+    int totalRunning = threadCount.values().stream().mapToInt(AtomicInteger::get).sum();
+    canRun =
+        threadCount.get(host).get() < settingsService.getSettings().getMaxThreads()
+            && (settingsService.getSettings().getMaxTotalThreads() == 0
+                ? totalRunning < MAX_POOL_SIZE
+                : totalRunning < settingsService.getSettings().getMaxTotalThreads());
+    if (canRun) {
+      threadCount.get(host).incrementAndGet();
+      return true;
+    }
+    return false;
+  }
+
+  private Map<Host, Integer> candidateCount() {
+    HashMap<Host, Integer> map = new HashMap<>();
+    hosts.forEach(
+        h -> {
+          AtomicInteger count = threadCount.get(h);
+          if (count == null) {
+            count = new AtomicInteger(0);
+            threadCount.put(h, count);
+          }
+          map.put(h, settingsService.getSettings().getMaxThreads() - count.get());
+        });
+    return map;
+  }
+
+  private List<DownloadJob> getCandidates(Map<Host, Integer> candidateCount, int max) {
+    int i = 0;
+    List<DownloadJob> candidates = new ArrayList<>();
+    for (DownloadJob downloadJob : pending) {
+      Host host = downloadJob.getImage().getHost();
+      Integer maxPerHost = candidateCount.get(host);
+      if (maxPerHost > 0 && i < max) {
+        candidates.add(downloadJob);
+        candidateCount.put(host, maxPerHost - 1);
+        i++;
+      }
+      if (i >= max) {
+        break;
+      }
+    }
+    return candidates;
+  }
+
+  public void enqueue(Map<Post, Collection<Image>> images) {
+    synchronized (this) {
+      for (Map.Entry<Post, Collection<Image>> entry : images.entrySet()) {
+        entry.getKey().setStatus(Status.PENDING);
+        dataService.updatePostStatus(entry.getKey().getStatus(), entry.getKey().getId());
+        for (Image image : entry.getValue()) {
+          log.debug(String.format("Enqueuing a job for %s", image.getUrl()));
+          image.init();
+          dataService.updateImageStatus(image.getStatus(), image.getId());
+          dataService.updateImageCurrent(image.getCurrent(), image.getId());
+          DownloadJob downloadJob =
+              new DownloadJob(
+                  entry.getKey(), image, (Settings) settingsService.getSettings().clone());
+          pending.add(downloadJob);
+        }
+      }
+      pending.sort(Comparator.comparing(e -> e.getPost().getAddedOn()));
+      this.notify();
+    }
+  }
+
+  private void start() {
+    while (!Thread.interrupted()) {
+      try {
+        synchronized (this) {
+          List<DownloadJob> accepted = new ArrayList<>();
+          List<DownloadJob> candidates = getCandidates(candidateCount(), MAX_POOL_SIZE);
+          candidates.forEach(
+              c -> {
+                if (canRun(c.getImage().getHost())) {
+                  accepted.add(c);
+                }
+              });
+          pending.removeAll(accepted);
+          accepted.forEach(this::push);
+          accepted.clear();
+          this.wait();
+        }
+      } catch (InterruptedException e) {
+        Thread.currentThread().interrupt();
+        break;
+      }
+    }
+  }
+
+  private synchronized void push(DownloadJob downloadJob) {
+    log.debug(String.format("Scheduling a job for %s", downloadJob.getImage().getUrl()));
+    executor.execute(new DownloadJobWrapper(downloadJob));
+    running.add(downloadJob);
+  }
+
+  public void afterJobFinish(DownloadJob downloadJob) {
+    synchronized (this) {
+      running.remove(downloadJob);
+      threadCount.get(downloadJob.getImage().getHost()).decrementAndGet();
+      if (!isPending(downloadJob.getPost().getPostId())
+          && !isRunning(downloadJob.getPost().getPostId())) {
+        dataService.finishPost(downloadJob.getPost());
+      }
+      this.notify();
+    }
+  }
+
+  public int pendingCount() {
+    return pending.size();
+  }
+
+  public int runningCount() {
+    return running.size();
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/entities/Image.java

@@ -1,124 +0,0 @@
-package tn.mnlr.vripper.entities;
-
-import io.reactivex.disposables.Disposable;
-import io.reactivex.processors.BehaviorProcessor;
-import lombok.Getter;
-import lombok.Setter;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
-import tn.mnlr.vripper.SpringContext;
-import tn.mnlr.vripper.exception.PostParseException;
-import tn.mnlr.vripper.host.Host;
-import tn.mnlr.vripper.services.AppStateService;
-
-import java.util.Objects;
-import java.util.concurrent.atomic.AtomicLong;
-
-@Getter
-public class Image {
-
-    private static final Logger logger = LoggerFactory.getLogger(Image.class);
-    private final AppStateService appStateService;
-
-    private final String type = "img";
-    private String postId;
-    private String postName;
-    private Host host;
-    private String url;
-    private int index;
-    private AtomicLong current = new AtomicLong(0);
-
-    @Setter
-    private long total = 0;
-    private Status status;
-    private BehaviorProcessor<Image> imageStateProcessor;
-    private Disposable subscription;
-
-    private Image() {
-        this.appStateService = SpringContext.getBean(AppStateService.class);
-    }
-
-    public Image(String url, String postId, String postName, Host host, int index) throws PostParseException {
-        this();
-        this.url = url;
-        this.postId = postId;
-        this.postName = postName;
-        this.host = host;
-        this.index = index;
-        status = Status.STOPPED;
-
-        if (!appStateService.newImage(this)) {
-            throw new PostParseException("Image already loaded");
-        }
-    }
-
-    public void setStatus(Status status) {
-        this.status = status;
-        update();
-    }
-
-    public boolean isCompleted() {
-        return status.equals(Status.COMPLETE);
-    }
-
-    public void init() {
-        cleanup();
-        imageStateProcessor = BehaviorProcessor.create();
-        subscription = imageStateProcessor
-                .onBackpressureBuffer()
-                .doOnNext(appStateService::imageUpdated)
-                .subscribe();
-
-        current.set(0);
-        status = Status.STOPPED;
-        imageStateProcessor.onNext(this);
-    }
-
-    public void cleanup() {
-        if (imageStateProcessor != null) {
-            imageStateProcessor.onComplete();
-        }
-        if (subscription != null) {
-            subscription.dispose();
-        }
-    }
-
-    public void setCurrent(int current) {
-        this.current.set(current);
-        update();
-    }
-
-    public void increase(int read) {
-        current.addAndGet(read);
-        update();
-    }
-
-    private void update() {
-        if (imageStateProcessor == null) {
-            return;
-        }
-        imageStateProcessor.onNext(this);
-        if (isCompleted()) {
-            imageStateProcessor.onComplete();
-            subscription.dispose();
-            imageStateProcessor = null;
-        }
-    }
-
-    public enum Status {
-        PENDING, DOWNLOADING, COMPLETE, ERROR, STOPPED
-    }
-
-    @Override
-    public boolean equals(Object o) {
-        if (this == o) return true;
-        if (o == null || getClass() != o.getClass()) return false;
-        Image image = (Image) o;
-        return url.equals(image.url);
-    }
-
-    @Override
-    public int hashCode() {
-        return Objects.hash(url);
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/entities/Post.java

@@ -1,124 +0,0 @@
-package tn.mnlr.vripper.entities;
-
-import lombok.Getter;
-import lombok.Setter;
-import lombok.ToString;
-import tn.mnlr.vripper.SpringContext;
-import tn.mnlr.vripper.exception.PostParseException;
-import tn.mnlr.vripper.host.Host;
-import tn.mnlr.vripper.services.AppStateService;
-
-import java.util.List;
-import java.util.Map;
-import java.util.Objects;
-import java.util.Set;
-import java.util.concurrent.atomic.AtomicInteger;
-import java.util.stream.Collectors;
-
-@Getter
-@ToString
-public class Post {
-
-    public enum METADATA {
-        PREVIEWS, RESOLVED_NAME, POSTED_BY, THANKED
-    }
-
-    private final AppStateService appStateService;
-
-    private Status status;
-
-    private final String type = "post";
-
-    private String postId;
-
-    private String threadTitle;
-
-    private String threadId;
-
-    private String title;
-
-    private String url;
-
-    private List<Image> images;
-
-    private Map<String, Object> metadata;
-
-    private AtomicInteger done = new AtomicInteger(0);
-
-    private int total;
-
-    private Set<String> hosts;
-
-    private boolean removed = false;
-
-    private String forum;
-
-    @Setter
-    private String postFolderName;
-
-    private Post() {
-        this.appStateService = SpringContext.getBean(AppStateService.class);
-    }
-
-    public Post(String title, String url, List<Image> images, Map<String, Object> metadata, String postId, String threadId, String threadTitle, String forum) throws PostParseException {
-        this();
-        this.title = title;
-        this.url = url;
-        this.images = images;
-        this.metadata = metadata;
-        this.postId = postId;
-        this.forum = forum;
-        this.threadId = threadId;
-        this.threadTitle = threadTitle;
-        this.hosts = this.images.stream().map(Image::getHost).map(Host::getHost).collect(Collectors.toSet());
-        total = images.size();
-        status = Status.STOPPED;
-
-        if (!this.appStateService.newPost(this)) {
-            throw new PostParseException("Post already loaded");
-        }
-    }
-
-    public void setTitle(String title) {
-        this.title = title;
-        updateNotification();
-    }
-
-    public void setRemoved(boolean removed) {
-        this.removed = removed;
-        updateNotification();
-    }
-
-    public void increase() {
-        done.incrementAndGet();
-        updateNotification();
-    }
-
-    public void setStatus(Status status) {
-        this.status = status;
-        updateNotification();
-    }
-
-    private void updateNotification() {
-        if (appStateService != null) {
-            appStateService.postUpdated(this);
-        }
-    }
-
-    public enum Status {
-        PENDING, DOWNLOADING, COMPLETE, ERROR, PARTIAL, STOPPED
-    }
-
-    @Override
-    public boolean equals(Object o) {
-        if (this == o) return true;
-        if (o == null || getClass() != o.getClass()) return false;
-        Post post = (Post) o;
-        return postId.equals(post.postId);
-    }
-
-    @Override
-    public int hashCode() {
-        return Objects.hash(postId);
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/entities/mixin/persistance/HostToString.java

@@ -1,12 +0,0 @@
-package tn.mnlr.vripper.entities.mixin.persistance;
-
-import com.fasterxml.jackson.databind.util.StdConverter;
-import tn.mnlr.vripper.host.Host;
-
-public class HostToString extends StdConverter<Host, String> {
-
-    @Override
-    public String convert(Host value) {
-        return value.getClass().getSimpleName();
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/entities/mixin/persistance/ImagePersistanceMixin.java

@@ -1,36 +0,0 @@
-package tn.mnlr.vripper.entities.mixin.persistance;
-
-import com.fasterxml.jackson.annotation.JsonIgnore;
-import com.fasterxml.jackson.databind.annotation.JsonDeserialize;
-import com.fasterxml.jackson.databind.annotation.JsonSerialize;
-import io.reactivex.disposables.Disposable;
-import io.reactivex.processors.BehaviorProcessor;
-import lombok.Getter;
-import lombok.Setter;
-import tn.mnlr.vripper.entities.Image;
-import tn.mnlr.vripper.host.Host;
-import tn.mnlr.vripper.services.AppStateService;
-
-@Getter
-@Setter
-public abstract class ImagePersistanceMixin {
-
-    @JsonSerialize(converter = HostToString.class)
-    @JsonDeserialize(converter = StringToHost.class)
-    private Host host;
-
-    @JsonIgnore
-    private BehaviorProcessor<Image> imageStateProcessor;
-
-    @JsonIgnore
-    private Disposable subscription;
-
-    @JsonIgnore
-    private String type;
-
-    @JsonIgnore
-    public abstract boolean isCompleted();
-
-    @JsonIgnore
-    private AppStateService appStateService;
-}

vripper-server/src/main/java/tn/mnlr/vripper/entities/mixin/persistance/PostPersistanceMixin.java

@@ -1,21 +0,0 @@
-package tn.mnlr.vripper.entities.mixin.persistance;
-
-import com.fasterxml.jackson.annotation.JsonIgnore;
-import lombok.Getter;
-import lombok.Setter;
-import tn.mnlr.vripper.services.AppStateService;
-
-@Getter
-@Setter
-public abstract class PostPersistanceMixin {
-
-    @JsonIgnore
-    private String type;
-
-    @JsonIgnore
-    private AppStateService appStateService;
-
-
-    @JsonIgnore
-    private boolean removed;
-}

vripper-server/src/main/java/tn/mnlr/vripper/entities/mixin/persistance/StringToHost.java

@@ -1,17 +0,0 @@
-package tn.mnlr.vripper.entities.mixin.persistance;
-
-import com.fasterxml.jackson.databind.util.StdConverter;
-import tn.mnlr.vripper.SpringContext;
-import tn.mnlr.vripper.host.Host;
-
-import java.util.Collection;
-
-public class StringToHost extends StdConverter<String, Host> {
-
-    private Collection<Host> hosts = SpringContext.getBeansOfType(Host.class).values();
-
-    @Override
-    public Host convert(String value) {
-        return hosts.stream().filter(e -> e.getClass().getSimpleName().equals(value)).findAny().orElse(null);
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/entities/mixin/ui/ImageUIMixin.java

@@ -1,27 +0,0 @@
-package tn.mnlr.vripper.entities.mixin.ui;
-
-import com.fasterxml.jackson.annotation.JsonIgnore;
-import io.reactivex.disposables.Disposable;
-import io.reactivex.processors.BehaviorProcessor;
-import lombok.Getter;
-import lombok.Setter;
-import tn.mnlr.vripper.entities.Image;
-import tn.mnlr.vripper.host.Host;
-import tn.mnlr.vripper.services.AppStateService;
-
-@Getter
-@Setter
-public abstract class ImageUIMixin {
-
-    @JsonIgnore
-    private Host host;
-
-    @JsonIgnore
-    private BehaviorProcessor<Image> imageStateProcessor;
-
-    @JsonIgnore
-    private Disposable subscription;
-
-    @JsonIgnore
-    private AppStateService appStateService;
-}

vripper-server/src/main/java/tn/mnlr/vripper/entities/mixin/ui/PostUIMixin.java

@@ -1,20 +0,0 @@
-package tn.mnlr.vripper.entities.mixin.ui;
-
-import com.fasterxml.jackson.annotation.JsonIgnore;
-import lombok.Getter;
-import lombok.Setter;
-import tn.mnlr.vripper.entities.Image;
-import tn.mnlr.vripper.services.AppStateService;
-
-import java.util.List;
-
-@Getter
-@Setter
-public abstract class PostUIMixin {
-
-    @JsonIgnore
-    private List<Image> images;
-
-    @JsonIgnore
-    private AppStateService appStateService;
-}

vripper-server/src/main/java/tn/mnlr/vripper/event/Event.java

@@ -0,0 +1,34 @@
+package tn.mnlr.vripper.event;
+
+import lombok.Getter;
+
+@Getter
+public class Event<T> {
+
+  private final T data;
+  private final Kind kind;
+
+  private Event(Kind kind, T data) {
+    this.data = data;
+    this.kind = kind;
+  }
+
+  public static <T> Event<T> wrap(Kind kind, T data) {
+    return new Event<>(kind, data);
+  }
+
+  public enum Kind {
+    POST_UPDATE,
+    POST_REMOVE,
+    IMAGE_UPDATE,
+    METADATA_UPDATE,
+    QUEUED_UPDATE,
+    QUEUED_REMOVE,
+    LOG_EVENT_UPDATE,
+    LOG_EVENT_REMOVE,
+    VG_USER,
+    GLOBAL_STATE,
+    BYTES_PER_SECOND,
+    SETTINGS_UPDATE
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/event/EventBus.java

@@ -0,0 +1,27 @@
+package tn.mnlr.vripper.event;
+
+import org.springframework.stereotype.Service;
+import reactor.core.publisher.Flux;
+import reactor.core.publisher.Sinks;
+
+import javax.annotation.PreDestroy;
+
+@Service
+public class EventBus {
+
+  public static final Sinks.EmitFailureHandler RETRY = (signalType, emitResult) -> true;
+  private final Sinks.Many<Event<?>> sink = Sinks.many().multicast().onBackpressureBuffer();
+
+  public void publishEvent(Event<?> event) {
+    sink.emitNext(event, RETRY);
+  }
+
+  public Flux<Event<?>> flux() {
+    return sink.asFlux();
+  }
+
+  @PreDestroy
+  private void destroy() {
+    sink.emitComplete(RETRY);
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/exception/DownloadException.java

@@ -2,11 +2,11 @@ package tn.mnlr.vripper.exception;
 
 public class DownloadException extends Exception {
 
-    public DownloadException(String message) {
-        super(message);
-    }
+  public DownloadException(String message) {
+    super(message);
+  }
 
-    public DownloadException(Throwable e) {
-        super(e);
-    }
+  public DownloadException(Throwable e) {
+    super(e);
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/exception/HostException.java

@@ -1,15 +1,15 @@
 package tn.mnlr.vripper.exception;
 
 public class HostException extends Exception {
-    public HostException(Throwable e) {
-        super(e);
-    }
+  public HostException(Throwable e) {
+    super(e);
+  }
 
-    public HostException(String message) {
-        super(message);
-    }
+  public HostException(String message) {
+    super(message);
+  }
 
-    public HostException(String message, Throwable e) {
-        super(message,e);
-    }
+  public HostException(String message, Throwable e) {
+    super(message, e);
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/exception/HtmlProcessorException.java

@@ -2,7 +2,7 @@ package tn.mnlr.vripper.exception;
 
 public class HtmlProcessorException extends Exception {
 
-    public HtmlProcessorException(Throwable e) {
-        super(e);
-    }
+  public HtmlProcessorException(Throwable e) {
+    super(e);
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/exception/PostParseException.java

@@ -2,15 +2,15 @@ package tn.mnlr.vripper.exception;
 
 public class PostParseException extends Exception {
 
-    public PostParseException(String message) {
-        super(message);
-    }
+  public PostParseException(String message) {
+    super(message);
+  }
 
-    public PostParseException(String message, Throwable e) {
-        super(message, e);
-    }
+  public PostParseException(String message, Throwable e) {
+    super(message, e);
+  }
 
-    public PostParseException(Throwable e) {
-        super(e);
-    }
+  public PostParseException(Throwable e) {
+    super(e);
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/exception/QueueException.java

@@ -0,0 +1,16 @@
+package tn.mnlr.vripper.exception;
+
+public class QueueException extends Exception {
+
+  public QueueException(String message) {
+    super(message);
+  }
+
+  public QueueException(String message, Throwable e) {
+    super(message, e);
+  }
+
+  public QueueException(Throwable e) {
+    super(e);
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/exception/RenameException.java

@@ -0,0 +1,10 @@
+package tn.mnlr.vripper.exception;
+
+import java.io.IOException;
+
+public class RenameException extends Exception {
+
+  public RenameException(String message, IOException e) {
+    super(message, e);
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/exception/ValidationException.java

@@ -2,7 +2,7 @@ package tn.mnlr.vripper.exception;
 
 public class ValidationException extends Exception {
 
-    public ValidationException(String message) {
-        super(message);
-    }
+  public ValidationException(String message) {
+    super(message);
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/exception/VripperException.java

@@ -1,11 +1,11 @@
 package tn.mnlr.vripper.exception;
 
 public class VripperException extends Exception {
-    public VripperException(String message) {
-        super(message);
-    }
+  public VripperException(String message) {
+    super(message);
+  }
 
-    public VripperException(Throwable e) {
-        super(e);
-    }
+  public VripperException(Throwable e) {
+    super(e);
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/exception/XpathException.java

@@ -1,7 +1,7 @@
 package tn.mnlr.vripper.exception;
 
 public class XpathException extends Exception {
-    public XpathException(Throwable e) {
-        super(e);
-    }
+  public XpathException(Throwable e) {
+    super(e);
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/AcidimgHost.java

@@ -1,5 +1,6 @@
 package tn.mnlr.vripper.host;
 
+import lombok.extern.slf4j.Slf4j;
 import org.apache.http.NameValuePair;
 import org.apache.http.client.HttpClient;
 import org.apache.http.client.entity.UrlEncodedFormEntity;
@@ -8,103 +9,114 @@ import org.apache.http.client.methods.HttpPost;
 import org.apache.http.client.protocol.HttpClientContext;
 import org.apache.http.message.BasicNameValuePair;
 import org.apache.http.util.EntityUtils;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
 import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.stereotype.Service;
 import org.w3c.dom.Document;
 import org.w3c.dom.Node;
 import tn.mnlr.vripper.exception.HostException;
 import tn.mnlr.vripper.exception.XpathException;
-import tn.mnlr.vripper.q.ImageFileData;
-import tn.mnlr.vripper.services.ConnectionManager;
+import tn.mnlr.vripper.services.ConnectionService;
+import tn.mnlr.vripper.services.HostService;
+import tn.mnlr.vripper.services.HtmlProcessorService;
+import tn.mnlr.vripper.services.XpathService;
 
 import java.util.ArrayList;
 import java.util.List;
 
 @Service
+@Slf4j
 public class AcidimgHost extends Host {
 
-    private static final Logger logger = LoggerFactory.getLogger(AcidimgHost.class);
+  private static final String host = "acidimg.cc";
+  private static final String CONTINUE_BUTTON_XPATH = "//input[@id='continuebutton']";
+  private static final String IMG_XPATH = "//img[@class='centred']";
 
-    private static final String host = "acidimg.cc";
-    private static final String CONTINUE_BUTTON_XPATH = "//input[@id='continuebutton']";
-    private static final String IMG_XPATH = "//img[@class='centred']";
+  private final ConnectionService cm;
+  private final HostService hostService;
+  private final XpathService xpathService;
+  private final HtmlProcessorService htmlProcessorService;
 
-    @Autowired
-    private ConnectionManager cm;
+  @Autowired
+  public AcidimgHost(
+      ConnectionService cm,
+      HostService hostService,
+      XpathService xpathService,
+      HtmlProcessorService htmlProcessorService) {
+    this.cm = cm;
+    this.hostService = hostService;
+    this.xpathService = xpathService;
+    this.htmlProcessorService = htmlProcessorService;
+  }
 
-    public AcidimgHost() {
-        super();
+  @Override
+  public String getHost() {
+    return host;
+  }
+
+  @Override
+  public String getLookup() {
+    return host;
+  }
+
+  @Override
+  public HostService.NameUrl getNameAndUrl(final String url, final HttpClientContext context)
+      throws HostException {
+
+    Document doc = hostService.getResponse(url, context).getDocument();
+
+    Node contDiv;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", CONTINUE_BUTTON_XPATH, url));
+      contDiv = xpathService.getAsNode(doc, CONTINUE_BUTTON_XPATH);
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getHost() {
-        return host;
+    if (contDiv != null) {
+      log.debug(String.format("Click button found for %s", url));
+      HttpClient client = cm.getClient().build();
+      HttpPost httpPost = cm.buildHttpPost(url, context);
+      httpPost.addHeader("Referer", url);
+      List<NameValuePair> params = new ArrayList<>();
+      params.add(new BasicNameValuePair("imgContinue", "Continue to your image"));
+      try {
+        httpPost.setEntity(new UrlEncodedFormEntity(params));
+      } catch (Exception e) {
+        throw new HostException(e);
+      }
+
+      log.debug(String.format("Requesting %s", httpPost));
+      try (CloseableHttpResponse response =
+          (CloseableHttpResponse) client.execute(httpPost, context)) {
+        log.debug(String.format("Cleaning response for %s", httpPost));
+        doc = htmlProcessorService.clean(EntityUtils.toString(response.getEntity()));
+        EntityUtils.consumeQuietly(response.getEntity());
+      } catch (Exception e) {
+        throw new HostException(e);
+      }
     }
 
-    @Override
-    public String getLookup() {
-        return host;
+    Node imgNode;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
+      imgNode = xpathService.getAsNode(doc, IMG_XPATH);
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    protected void setNameAndUrl(final String url, final ImageFileData imageFileData, final HttpClientContext context) throws HostException {
-
-        Document doc = getResponse(url, context).getDocument();
-
-        Node contDiv;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", CONTINUE_BUTTON_XPATH, url));
-            contDiv = xpathService.getAsNode(doc, CONTINUE_BUTTON_XPATH);
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        if (contDiv != null) {
-            logger.debug(String.format("Click button found for %s", url));
-            HttpClient client = cm.getClient().build();
-            HttpPost httpPost = cm.buildHttpPost(url);
-            httpPost.addHeader("Referer", url);
-            List<NameValuePair> params = new ArrayList<>();
-            params.add(new BasicNameValuePair("imgContinue", "Continue to your image"));
-            try {
-                httpPost.setEntity(new UrlEncodedFormEntity(params));
-            } catch (Exception e) {
-                throw new HostException(e);
-            }
-
-            logger.debug(String.format("Requesting %s", httpPost));
-            try (CloseableHttpResponse response = (CloseableHttpResponse) client.execute(httpPost, context)) {
-                logger.debug(String.format("Cleaning response for %s", httpPost));
-                doc = htmlProcessorService.clean(EntityUtils.toString(response.getEntity()));
-                EntityUtils.consumeQuietly(response.getEntity());
-            } catch (Exception e) {
-                throw new HostException(e);
-            }
-        }
-
-        Node imgNode;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
-            imgNode = xpathService.getAsNode(doc, IMG_XPATH);
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        if (imgNode == null) {
-            throw new HostException("Cannot find the image node");
-        }
-
-        try {
-            logger.debug(String.format("Resolving name and image url for %s", url));
-            String imgTitle = imgNode.getAttributes().getNamedItem("alt").getTextContent().trim();
-            String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
-
-            imageFileData.setImageUrl(imgUrl);
-            imageFileData.setImageName(imgTitle.isEmpty() ? getDefaultImageName(imgUrl) : imgTitle);
-        } catch (Exception e) {
-            throw new HostException("Unexpected error occurred", e);
-        }
+    if (imgNode == null) {
+      throw new HostException("Cannot find the image node");
     }
+
+    try {
+      log.debug(String.format("Resolving name and image url for %s", url));
+      String imgTitle = imgNode.getAttributes().getNamedItem("alt").getTextContent().trim();
+      String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
+
+      return new HostService.NameUrl(
+          imgTitle.isEmpty() ? hostService.getDefaultImageName(imgUrl) : imgTitle, imgUrl);
+    } catch (Exception e) {
+      throw new HostException("Unexpected error occurred", e);
+    }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/Host.java

@@ -1,294 +1,43 @@
 package tn.mnlr.vripper.host;
 
-import lombok.Getter;
-import org.apache.http.Header;
-import org.apache.http.client.HttpClient;
-import org.apache.http.client.methods.CloseableHttpResponse;
-import org.apache.http.client.methods.HttpGet;
+import lombok.extern.slf4j.Slf4j;
 import org.apache.http.client.protocol.HttpClientContext;
-import org.apache.http.impl.client.BasicCookieStore;
-import org.apache.http.util.EntityUtils;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
-import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.stereotype.Service;
-import org.w3c.dom.Document;
-import tn.mnlr.vripper.entities.Image;
-import tn.mnlr.vripper.entities.Post;
-import tn.mnlr.vripper.exception.DownloadException;
 import tn.mnlr.vripper.exception.HostException;
-import tn.mnlr.vripper.exception.HtmlProcessorException;
-import tn.mnlr.vripper.q.ImageFileData;
-import tn.mnlr.vripper.services.*;
+import tn.mnlr.vripper.services.HostService;
 
-import javax.imageio.ImageIO;
-import javax.imageio.ImageReader;
-import javax.imageio.stream.ImageInputStream;
-import java.io.File;
-import java.io.FileOutputStream;
-import java.io.IOException;
-import java.io.InputStream;
-import java.net.URI;
-import java.net.URISyntaxException;
-import java.nio.file.Files;
-import java.nio.file.StandardCopyOption;
-import java.util.Iterator;
 import java.util.Objects;
 
 @Service
-abstract public class Host {
+@Slf4j
+public abstract class Host {
 
-    private static final Logger logger = LoggerFactory.getLogger(Host.class);
+  public abstract String getHost();
 
-    private static final int READ_BUFFER_SIZE = 8192;
+  public abstract String getLookup();
 
-    @Autowired
-    protected HtmlProcessorService htmlProcessorService;
+  public boolean isSupported(String url) {
+    return url.contains(getLookup());
+  }
 
-    @Autowired
-    protected XpathService xpathService;
+  public abstract HostService.NameUrl getNameAndUrl(
+      final String url, final HttpClientContext context) throws HostException;
 
-    @Autowired
-    private AppSettingsService appSettingsService;
+  @Override
+  public boolean equals(Object o) {
+    if (this == o) return true;
+    if (o == null || getClass() != o.getClass()) return false;
+    Host host = (Host) o;
+    return Objects.equals(getHost(), host.getHost());
+  }
 
-    @Autowired
-    private AppStateService appStateService;
+  @Override
+  public int hashCode() {
+    return Objects.hash(getHost());
+  }
 
-    @Autowired
-    private ConnectionManager cm;
-
-    @Autowired
-    private DownloadSpeedService downloadSpeedService;
-
-    @Autowired
-    private PathService pathService;
-
-    @Autowired
-    private AppStateExchange appStateExchange;
-
-    @Autowired
-    private VipergirlsAuthService authService;
-
-    protected Host() {
-
-    }
-
-    abstract public String getHost();
-
-    abstract public String getLookup();
-
-    public boolean isSupported(String url) {
-        return url.contains(getLookup());
-    }
-
-    public void download(final Post post, final Image image, final ImageFileData imageFileData) throws DownloadException, InterruptedException {
-
-        HttpClientContext context = HttpClientContext.create();
-        context.setCookieStore(new BasicCookieStore());
-        try {
-
-            File destinationFolder;
-            synchronized (appStateExchange.getPost(post.getPostId())) {
-                if (post.getPostFolderName() == null) {
-                    pathService.createDefaultPostFolder(post);
-                }
-                destinationFolder = pathService.getDownloadDestinationFolder(post);
-                authService.leaveThanks(post);
-            }
-
-            appStateService.postDownloadingUpdate(image.getPostId());
-
-            imageFileData.setPageUrl(image.getUrl());
-
-            /*
-             * HOST SPECIFIC
-             */
-            logger.debug(String.format("Getting image url and name from %s using %s", image.getUrl(), this.getHost()));
-            setNameAndUrl(image.getUrl(), imageFileData, context);
-            logger.debug(String.format("Resolved name for %s: %s", image.getUrl(), imageFileData.getImageName()));
-            logger.debug(String.format("Resolved image url for %s: %s", image.getUrl(), imageFileData.getImageUrl()));
-
-            logger.debug(String.format("Building image request for %s", image.getUrl()));
-            setImageRequest(imageFileData);
-            /*
-             * END HOST SPECIFIC
-             */
-
-            String formatImageFileName = pathService.formatImageFileName(imageFileData.getImageName());
-            logger.debug(String.format("Sanitizing image name from %s to %s", imageFileData.getImageName(), formatImageFileName));
-            imageFileData.setImageName(formatImageFileName);
-            logger.debug(String.format("Saving to %s", destinationFolder.getPath()));
-
-            HttpClient client = cm.getClient().build();
-
-            logger.debug(String.format("Downloading %s", imageFileData.getImageUrl()));
-            try (CloseableHttpResponse response = (CloseableHttpResponse) client.execute(imageFileData.getImageRequest(), context)) {
-
-                if (response.getStatusLine().getStatusCode() / 100 != 2) {
-                    EntityUtils.consumeQuietly(response.getEntity());
-                    throw new DownloadException(String.format("Server returned code %d", response.getStatusLine().getStatusCode()));
-                }
-
-                File outputFile = new File(destinationFolder.getPath() + File.separator + String.format("%03d_", image.getIndex()) + imageFileData.getImageName() + ".tmp");
-                try (InputStream downloadStream = response.getEntity().getContent(); FileOutputStream fos = new FileOutputStream(outputFile)) {
-                    image.setTotal(response.getEntity().getContentLength());
-                    logger.debug(String.format("%s length is %d", imageFileData.getImageUrl(), image.getTotal()));
-                    logger.debug(String.format("Starting data transfer for %s", imageFileData.getImageUrl()));
-
-                    byte[] buffer = new byte[READ_BUFFER_SIZE];
-                    int read;
-                    while ((read = downloadStream.read(buffer, 0, READ_BUFFER_SIZE)) != -1) {
-                        fos.write(buffer, 0, read);
-                        image.increase(read);
-                        downloadSpeedService.increase(read);
-                    }
-                    fos.flush();
-                    EntityUtils.consumeQuietly(response.getEntity());
-                }
-                File finalName = checkImageTypeAndRename(post, outputFile, imageFileData.getImageName(), image.getIndex());
-                imageFileData.setFileName(finalName.getName());
-            }
-        } catch (Exception e) {
-            if (Thread.interrupted()) {
-                throw new InterruptedException("Download was interrupted");
-            }
-            throw new DownloadException(e);
-        }
-    }
-
-    private File checkImageTypeAndRename(Post post, File outputFile, String imageName, int index) throws HostException {
-        try (ImageInputStream iis = ImageIO.createImageInputStream(outputFile)) {
-            Iterator<ImageReader> it = ImageIO.getImageReaders(iis);
-            if (!it.hasNext()) {
-                throw new HostException("Image file is not recognized!");
-            }
-            ImageReader reader = it.next();
-            if (reader.getFormatName().toUpperCase().equals("JPEG")) {
-                String imageNameLC = imageName.toLowerCase();
-                if (!imageNameLC.endsWith("_jpg") && !imageNameLC.endsWith("_jpeg")) {
-                    imageName += ".jpg";
-                } else {
-                    String toReplace = null;
-                    if (imageNameLC.endsWith("_jpg")) {
-                        toReplace = "_jpg";
-                    } else if (imageNameLC.endsWith("_jpeg")) {
-                        toReplace = "_jpeg";
-                    }
-                    if (toReplace != null) {
-                        imageName = imageName.substring(0, imageName.length() - toReplace.length()) + ".jpg";
-                    }
-                }
-            } else if (reader.getFormatName().toUpperCase().equals("PNG")) {
-                String imageNameLC = imageName.toLowerCase();
-                if (!imageNameLC.endsWith("_png")) {
-                    imageName += ".png";
-                } else {
-                    String toReplace = null;
-                    if (imageNameLC.endsWith("_png")) {
-                        toReplace = "_png";
-                    }
-                    if (toReplace != null) {
-                        imageName = imageName.substring(0, imageName.length() - toReplace.length()) + ".png";
-                    }
-                }
-            }
-        } catch (Exception e) {
-            throw new HostException("Failed to guess image format", e);
-        }
-        try {
-            File downloadDestinationFolder = pathService.getDownloadDestinationFolder(post);
-            File outImage = new File(downloadDestinationFolder, (appSettingsService.getSettings().getForceOrder() ? String.format("%03d_", index) : "") + imageName);
-            if (outImage.exists() && outImage.delete()) {
-                logger.debug(String.format("%s is deleted", outImage.toString()));
-            }
-            return Files.move(outputFile.toPath(), outImage.toPath(), StandardCopyOption.ATOMIC_MOVE).toFile();
-        } catch (Exception e) {
-            throw new HostException("Failed to rename the image", e);
-        }
-    }
-
-    final String getDefaultImageName(final String imgUrl) {
-        String imageTitle = imgUrl.substring(imgUrl.lastIndexOf('/') + 1);
-        logger.debug(String.format("Extracting name from url %s: %s", imgUrl, imageTitle));
-        return imgUrl;
-    }
-
-    final Response getResponse(final String url, final HttpClientContext context) throws HostException {
-        String basePage;
-
-        HttpClient client = cm.getClient().build();
-        HttpGet httpGet = cm.buildHttpGet(url);
-        Header[] headers;
-        logger.debug(String.format("Requesting %s", url));
-        try (CloseableHttpResponse response = (CloseableHttpResponse) client.execute(httpGet, context)) {
-            if (response.getStatusLine().getStatusCode() / 100 != 2) {
-                throw new HostException(String.format("Unexpected response code: %d", response.getStatusLine().getStatusCode()));
-            }
-            headers = response.getAllHeaders();
-            basePage = EntityUtils.toString(response.getEntity());
-            logger.debug(String.format("%s response: %n%s", url, basePage));
-            EntityUtils.consumeQuietly(response.getEntity());
-        } catch (IOException e) {
-            throw new HostException(e);
-        }
-
-        try {
-            logger.debug(String.format("Cleaning %s response", url));
-            return new Response(htmlProcessorService.clean(basePage), headers);
-        } catch (HtmlProcessorException e) {
-            throw new HostException(e);
-        }
-    }
-
-    protected String appendUri(String uri, String appendQuery) throws URISyntaxException {
-        URI oldUri = new URI(uri);
-
-        String newQuery = oldUri.getQuery();
-        if (newQuery == null) {
-            newQuery = appendQuery;
-        } else {
-            newQuery += "&" + appendQuery;
-        }
-
-        return new URI(oldUri.getScheme(), oldUri.getAuthority(),
-                oldUri.getPath(), newQuery, oldUri.getFragment()).toString();
-    }
-
-    private void setImageRequest(final ImageFileData imageFileData) {
-        HttpGet httpGet = cm.buildHttpGet(imageFileData.getImageUrl());
-        httpGet.addHeader("Referer", imageFileData.getPageUrl());
-        imageFileData.setImageRequest(httpGet);
-    }
-
-    protected abstract void setNameAndUrl(final String url, final ImageFileData imageFileData, final HttpClientContext context) throws HostException;
-
-    @Override
-    public boolean equals(Object o) {
-        if (this == o) return true;
-        if (o == null || getClass() != o.getClass()) return false;
-        Host host = (Host) o;
-        return Objects.equals(getHost(), host.getHost());
-    }
-
-    @Override
-    public int hashCode() {
-        return Objects.hash(getHost());
-    }
-
-    @Getter
-    public static class Response {
-
-        protected Response(Document document, Header[] headers) {
-            this.document = document;
-            this.headers = headers;
-        }
-
-        private Document document;
-        private Header[] headers;
-    }
-
-    @Override
-    public String toString() {
-        return getHost();
-    }
+  @Override
+  public String toString() {
+    return getHost();
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/ImageBamHost.java

@@ -1,98 +1,96 @@
 package tn.mnlr.vripper.host;
 
-import org.apache.http.client.HttpClient;
-import org.apache.http.client.methods.CloseableHttpResponse;
-import org.apache.http.client.methods.HttpGet;
+import lombok.extern.slf4j.Slf4j;
 import org.apache.http.client.protocol.HttpClientContext;
-import org.apache.http.util.EntityUtils;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
 import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.stereotype.Service;
 import org.w3c.dom.Document;
 import org.w3c.dom.Node;
 import tn.mnlr.vripper.exception.HostException;
-import tn.mnlr.vripper.exception.HtmlProcessorException;
 import tn.mnlr.vripper.exception.XpathException;
-import tn.mnlr.vripper.q.ImageFileData;
-import tn.mnlr.vripper.services.ConnectionManager;
+import tn.mnlr.vripper.services.HostService;
+import tn.mnlr.vripper.services.XpathService;
 
-import java.io.IOException;
+import java.util.Optional;
+import java.util.UUID;
 
 @Service
+@Slf4j
 public class ImageBamHost extends Host {
 
-    private static final Logger logger = LoggerFactory.getLogger(ImageBamHost.class);
+  private static final String host = "imagebam.com";
+  private static final String IMG_XPATH = "//img[contains(@class,'main-image')]";
+  private static final String CONTINUE_XPATH = "//*[contains(text(), 'Continue')]";
 
-    private static final String host = "imagebam.com";
-    private static final String CONTINUE_BUTTON_XPATH = "//a[@title='Continue to your image']";
-    private static final String IMG_XPATH = "//img[@class='image']";
+  private final HostService hostService;
+  private final XpathService xpathService;
 
-    @Autowired
-    private ConnectionManager cm;
+  @Autowired
+  public ImageBamHost(HostService hostService, XpathService xpathService) {
+    this.hostService = hostService;
+    this.xpathService = xpathService;
+  }
 
-    public ImageBamHost() {
-        super();
+  @Override
+  public String getHost() {
+    return host;
+  }
+
+  @Override
+  public String getLookup() {
+    return host;
+  }
+
+  @Override
+  public HostService.NameUrl getNameAndUrl(final String url, final HttpClientContext context)
+      throws HostException {
+
+    HostService.Response response = hostService.getResponse(url, context);
+    Document doc = response.getDocument();
+
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", CONTINUE_XPATH, url));
+      if (xpathService.getAsNode(doc, CONTINUE_XPATH) != null) {
+        // Button detected. No need to actually click it, just make the call again.
+        response = hostService.getResponse(url, context);
+        doc = response.getDocument();
+      }
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getHost() {
-        return host;
+    Node imgNode;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
+      imgNode = xpathService.getAsNode(doc, IMG_XPATH);
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getLookup() {
-        return host;
+    if (imgNode == null) {
+      throw new HostException(String.format("Xpath '%s' cannot be found in '%s'", IMG_XPATH, url));
     }
 
-    @Override
-    protected void setNameAndUrl(final String url, final ImageFileData imageFileData, final HttpClientContext context) throws HostException {
+    try {
+      log.debug(String.format("Resolving name and image url for %s", url));
+      String imgTitle =
+          Optional.ofNullable(imgNode.getAttributes().getNamedItem("alt"))
+              .map(e -> e.getTextContent().trim())
+              .orElse("");
+      String imgUrl =
+          Optional.ofNullable(imgNode.getAttributes().getNamedItem("src"))
+              .map(e -> e.getTextContent().trim())
+              .orElse("");
+      String defaultName = UUID.randomUUID().toString();
 
-        Response response = getResponse(url, context);
-        Document doc = response.getDocument();
+      int index = imgUrl.lastIndexOf('/');
+      if (index != -1 && index < imgUrl.length()) {
+        defaultName = imgUrl.substring(imgUrl.lastIndexOf('/') + 1);
+      }
 
-        Node contDiv;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", CONTINUE_BUTTON_XPATH, url));
-            contDiv = xpathService.getAsNode(doc, CONTINUE_BUTTON_XPATH);
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        if (contDiv != null) {
-            logger.debug(String.format("Click button found for %s", url));
-            HttpClient client = cm.getClient().build();
-            HttpGet httpGet = cm.buildHttpGet(url);
-            httpGet.addHeader("Referer", url);
-            logger.debug(String.format("Requesting %s", httpGet));
-            try (CloseableHttpResponse res = (CloseableHttpResponse) client.execute(httpGet, context)) {
-                String s = EntityUtils.toString(res.getEntity());
-                logger.debug(String.format("%s response is:%n%s", httpGet, s));
-                logger.debug(String.format("Cleaning response for %s", httpGet));
-                doc = htmlProcessorService.clean(s);
-                EntityUtils.consumeQuietly(res.getEntity());
-            } catch (IOException | HtmlProcessorException e) {
-                throw new HostException(e);
-            }
-        }
-
-        Node imgNode;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
-            imgNode = xpathService.getAsNode(doc, IMG_XPATH);
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        try {
-            logger.debug(String.format("Resolving name and image url for %s", url));
-            String imgTitle = imgNode.getAttributes().getNamedItem("id").getTextContent().trim();
-            String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
-
-            imageFileData.setImageUrl(imgUrl);
-            imageFileData.setImageName(imgTitle.isEmpty() ? imgUrl.substring(imgUrl.lastIndexOf('/') + 1) : imgTitle);
-        } catch (Exception e) {
-            throw new HostException("Unexpected error occurred", e);
-        }
+      return new HostService.NameUrl(imgTitle.isEmpty() ? defaultName : imgTitle, imgUrl);
+    } catch (Exception e) {
+      throw new HostException("Unexpected error occurred", e);
     }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/ImageTwistHost.java

@@ -1,60 +1,70 @@
 package tn.mnlr.vripper.host;
 
+import lombok.extern.slf4j.Slf4j;
 import org.apache.http.client.protocol.HttpClientContext;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
+import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.stereotype.Service;
 import org.w3c.dom.Document;
 import org.w3c.dom.Node;
 import tn.mnlr.vripper.exception.HostException;
 import tn.mnlr.vripper.exception.XpathException;
-import tn.mnlr.vripper.q.ImageFileData;
+import tn.mnlr.vripper.services.HostService;
+import tn.mnlr.vripper.services.XpathService;
 
 import java.util.Optional;
 
 @Service
+@Slf4j
 public class ImageTwistHost extends Host {
 
-    private static final String IMG_XPATH = "//img[contains(@class, 'img')]";
-    private static final Logger logger = LoggerFactory.getLogger(ImageTwistHost.class);
-    private static final String host = "imagetwist.com";
+  private static final String IMG_XPATH = "//img[contains(@class, 'img')]";
+  private static final String host = "imagetwist.com";
 
-    public ImageTwistHost() {
-        super();
+  private final HostService hostService;
+  private final XpathService xpathService;
+
+  @Autowired
+  public ImageTwistHost(HostService hostService, XpathService xpathService) {
+    this.hostService = hostService;
+    this.xpathService = xpathService;
+  }
+
+  @Override
+  public String getHost() {
+    return host;
+  }
+
+  @Override
+  public String getLookup() {
+    return host;
+  }
+
+  @Override
+  public HostService.NameUrl getNameAndUrl(final String url, final HttpClientContext context)
+      throws HostException {
+
+    Document doc = hostService.getResponse(url, context).getDocument();
+
+    Node imgNode;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
+      imgNode = xpathService.getAsNode(doc, IMG_XPATH);
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getHost() {
-        return host;
-    }
-
-    @Override
-    public String getLookup() {
-        return host;
-    }
-
-    @Override
-    protected void setNameAndUrl(final String url, final ImageFileData imageFileData, final HttpClientContext context) throws HostException {
-
-        Document doc = getResponse(url, context).getDocument();
-
-        Node imgNode;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
-            imgNode = xpathService.getAsNode(doc, IMG_XPATH);
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        try {
-            logger.debug(String.format("Resolving name and image url for %s", url));
-            String imgTitle = Optional.ofNullable(imgNode.getAttributes().getNamedItem("alt")).map(Node::getTextContent).map(String::trim).orElse(null);
-            String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
-
-            imageFileData.setImageUrl(imgUrl);
-            imageFileData.setImageName(imgTitle);
-        } catch (Exception e) {
-            throw new HostException("Unexpected error occurred", e);
-        }
+    try {
+      log.debug(String.format("Resolving name and image url for %s", url));
+      String imgTitle =
+          Optional.ofNullable(imgNode.getAttributes().getNamedItem("alt"))
+              .map(Node::getTextContent)
+              .map(String::trim)
+              .orElse(null);
+      String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
+
+      return new HostService.NameUrl(imgTitle, imgUrl);
+    } catch (Exception e) {
+      throw new HostException("Unexpected error occurred", e);
     }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/ImageVenueHost.java

@@ -1,83 +1,84 @@
 package tn.mnlr.vripper.host;
 
+import lombok.extern.slf4j.Slf4j;
 import org.apache.http.client.protocol.HttpClientContext;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
+import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.stereotype.Service;
 import org.w3c.dom.Document;
 import org.w3c.dom.Node;
 import tn.mnlr.vripper.exception.HostException;
 import tn.mnlr.vripper.exception.XpathException;
-import tn.mnlr.vripper.q.ImageFileData;
-
-import java.net.URI;
+import tn.mnlr.vripper.services.HostService;
+import tn.mnlr.vripper.services.XpathService;
 
 @Service
+@Slf4j
 public class ImageVenueHost extends Host {
 
-    private static final Logger logger = LoggerFactory.getLogger(ImageVenueHost.class);
+  private static final String host = "imagevenue.com";
+  private static final String CONTINUE_BUTTON_XPATH = "//a[@title='Continue to ImageVenue']";
+  private static final String IMG_XPATH = "//a[@data-toggle='full']/img";
 
-    private static final String host = "imagevenue.com";
-    private static final String CONTINUE_BUTTON_XPATH = "//a[@title='Continue to your image']";
-    private static final String IMG_XPATH = "//img[@id='thepic']";
+  private final HostService hostService;
+  private final XpathService xpathService;
 
-    public ImageVenueHost() {
-        super();
+  @Autowired
+  public ImageVenueHost(HostService hostService, XpathService xpathService) {
+    this.hostService = hostService;
+    this.xpathService = xpathService;
+  }
+
+  @Override
+  public String getHost() {
+    return host;
+  }
+
+  @Override
+  public String getLookup() {
+    return host;
+  }
+
+  @Override
+  public HostService.NameUrl getNameAndUrl(final String _url, final HttpClientContext context)
+      throws HostException {
+
+    String url = _url.replace("http://", "https://");
+
+    HostService.Response resp = hostService.getResponse(url, context);
+    Document doc = resp.getDocument();
+
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", CONTINUE_BUTTON_XPATH, url));
+      if (xpathService.getAsNode(doc, CONTINUE_BUTTON_XPATH) != null) {
+        // Button detected. No need to actually click it, just make the call again.
+        resp = hostService.getResponse(url, context);
+        doc = resp.getDocument();
+      }
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getHost() {
-        return host;
+    Node imgNode;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
+      imgNode = xpathService.getAsNode(doc, IMG_XPATH);
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getLookup() {
-        return host;
+    if (imgNode == null) {
+      throw new HostException("Failed to locate image");
     }
 
-    @Override
-    protected void setNameAndUrl(final String url, final ImageFileData imageFileData, final HttpClientContext context) throws HostException {
+    try {
+      log.debug(String.format("Resolving name and image url for %s", url));
+      String imgTitle = imgNode.getAttributes().getNamedItem("alt").getTextContent().trim();
+      String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
 
-        //Sadly, they do not support https.
-        //If they add such support in the future,
-        //then we should automatically adapt the URL here as done elsewhere.
-
-        Response resp = getResponse(url, context);
-        Document doc = resp.getDocument();
-
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", CONTINUE_BUTTON_XPATH, url));
-            if(xpathService.getAsNode(doc, CONTINUE_BUTTON_XPATH) != null) {
-                //Button detected. No need to actually click it, just make the call again.
-                resp = getResponse(url, context);
-                doc = resp.getDocument();
-            }
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        Node imgNode;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
-            imgNode = xpathService.getAsNode(doc, IMG_XPATH);
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        if (imgNode == null) {
-            throw new HostException("Failed to locate image");
-        }
-
-        try {
-            logger.debug(String.format("Resolving name and image url for %s", url));
-            String imgTitle = imgNode.getAttributes().getNamedItem("alt").getTextContent().trim();
-            String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
-
-            URI baseUri = new URI(url);
-            imageFileData.setImageUrl(new URI(baseUri.getScheme(), baseUri.getHost(), '/'+imgUrl, null).toString());
-            imageFileData.setImageName(imgTitle.isEmpty() ? imgUrl.substring(imgUrl.lastIndexOf('/') + 1) : imgTitle);
-        } catch(Exception e) {
-            throw new HostException("Unexpected error occurred", e);
-        }
+      return new HostService.NameUrl(
+          imgTitle.isEmpty() ? imgUrl.substring(imgUrl.lastIndexOf('/') + 1) : imgTitle, imgUrl);
+    } catch (Exception e) {
+      throw new HostException("Unexpected error occurred", e);
     }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/ImageZillaHost.java

@@ -1,66 +1,71 @@
 package tn.mnlr.vripper.host;
 
+import lombok.extern.slf4j.Slf4j;
 import org.apache.http.client.protocol.HttpClientContext;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
+import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.stereotype.Service;
 import org.w3c.dom.Document;
 import org.w3c.dom.Node;
 import tn.mnlr.vripper.exception.HostException;
 import tn.mnlr.vripper.exception.XpathException;
-import tn.mnlr.vripper.q.ImageFileData;
+import tn.mnlr.vripper.services.HostService;
+import tn.mnlr.vripper.services.XpathService;
 
 @Service
+@Slf4j
 public class ImageZillaHost extends Host {
 
-    private static final Logger logger = LoggerFactory.getLogger(ImageZillaHost.class);
+  private static final String host = "imagezilla.net";
+  private static final String lookup = "imagezilla.net/show";
+  private static final String IMG_XPATH = "//img[@id='photo']";
 
-    private static final String host = "imagezilla.net";
-    private static final String lookup = "imagezilla.net/show";
-    private static final String IMG_XPATH = "//img[@id='photo']";
+  private final HostService hostService;
+  private final XpathService xpathService;
 
-    public ImageZillaHost() {
-        super();
+  @Autowired
+  public ImageZillaHost(HostService hostService, XpathService xpathService) {
+    this.hostService = hostService;
+    this.xpathService = xpathService;
+  }
+
+  @Override
+  public String getHost() {
+    return host;
+  }
+
+  @Override
+  public String getLookup() {
+    return lookup;
+  }
+
+  @Override
+  public HostService.NameUrl getNameAndUrl(final String url, final HttpClientContext context)
+      throws HostException {
+
+    Document doc = hostService.getResponse(url, context).getDocument();
+
+    String title;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
+      Node titleNode = xpathService.getAsNode(doc, IMG_XPATH).getAttributes().getNamedItem("title");
+      log.debug(String.format("Resolving name for %s", url));
+      if (titleNode != null) {
+        title = titleNode.getTextContent().trim();
+      } else {
+        title = null;
+      }
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getHost() {
-        return host;
+    if (title == null || title.isEmpty()) {
+      title = hostService.getDefaultImageName(url);
     }
 
-    @Override
-    public String getLookup() {
-        return lookup;
-    }
-
-    @Override
-    protected void setNameAndUrl(final String url, final ImageFileData imageFileData, final HttpClientContext context) throws HostException {
-
-        Document doc = getResponse(url, context).getDocument();
-
-        String title;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
-            Node titleNode = xpathService.getAsNode(doc, IMG_XPATH).getAttributes().getNamedItem("title");
-            logger.debug(String.format("Resolving name for %s", url));
-            if (titleNode != null) {
-                title = titleNode.getTextContent().trim();
-            } else {
-                title = null;
-            }
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        if (title == null || title.isEmpty()) {
-            title = getDefaultImageName(url);
-        }
-
-        try {
-            imageFileData.setImageUrl(url.replace("show", "images"));
-            imageFileData.setImageName(title);
-        } catch (Exception e) {
-            throw new HostException("Unexpected error occurred", e);
-        }
+    try {
+      return new HostService.NameUrl(title, url.replace("show", "images"));
+    } catch (Exception e) {
+      throw new HostException("Unexpected error occurred", e);
     }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/ImgSpiceHost.java

@@ -1,61 +1,67 @@
 package tn.mnlr.vripper.host;
 
+import lombok.extern.slf4j.Slf4j;
 import org.apache.http.client.protocol.HttpClientContext;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
+import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.stereotype.Service;
 import org.w3c.dom.Document;
 import org.w3c.dom.Node;
 import tn.mnlr.vripper.exception.HostException;
 import tn.mnlr.vripper.exception.XpathException;
-import tn.mnlr.vripper.q.ImageFileData;
+import tn.mnlr.vripper.services.HostService;
+import tn.mnlr.vripper.services.XpathService;
 
 @Service
+@Slf4j
 public class ImgSpiceHost extends Host {
 
-    private static final Logger logger = LoggerFactory.getLogger(ImgSpiceHost.class);
+  private static final String host = "imgspice.com";
+  private static final String IMG_XPATH = "//img[@id='imgpreview']";
 
-    private static final String host = "imgspice.com";
-    private static final String IMG_XPATH = "//img[@id='imgpreview']";
+  private final HostService hostService;
+  private final XpathService xpathService;
 
-    public ImgSpiceHost() {
-        super();
+  @Autowired
+  public ImgSpiceHost(HostService hostService, XpathService xpathService) {
+    this.hostService = hostService;
+    this.xpathService = xpathService;
+  }
+
+  @Override
+  public String getHost() {
+    return host;
+  }
+
+  @Override
+  public String getLookup() {
+    return host;
+  }
+
+  @Override
+  public HostService.NameUrl getNameAndUrl(final String _url, final HttpClientContext context)
+      throws HostException {
+
+    String url = _url.replace("http://", "https://");
+    HostService.Response resp = hostService.getResponse(url, context);
+    Document doc = resp.getDocument();
+
+    Node imgNode;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
+      imgNode = xpathService.getAsNode(doc, IMG_XPATH);
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getHost() {
-        return host;
-    }
-
-    @Override
-    public String getLookup() {
-        return host;
-    }
-
-    @Override
-    protected void setNameAndUrl(final String _url, final ImageFileData imageFileData, final HttpClientContext context) throws HostException {
-
-        String url = _url.replace("http://", "https://");
-        Response resp = getResponse(url, context);
-        Document doc = resp.getDocument();
-
-        Node imgNode;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
-            imgNode = xpathService.getAsNode(doc, IMG_XPATH);
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        try {
-            logger.debug(String.format("Resolving name and image url for %s", url));
-            String imgTitle = imgNode.getAttributes().getNamedItem("alt").getTextContent().trim();
-            String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
-
-            imageFileData.setImageUrl(imgUrl);
-            imageFileData.setImageName(imgTitle.isEmpty() ? imgUrl.substring(imgUrl.lastIndexOf('/') + 1) : imgTitle);
-        } catch (Exception e) {
-            throw new HostException("Unexpected error occurred", e);
-        }
+    try {
+      log.debug(String.format("Resolving name and image url for %s", url));
+      String imgTitle = imgNode.getAttributes().getNamedItem("alt").getTextContent().trim();
+      String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
+
+      return new HostService.NameUrl(
+          imgTitle.isEmpty() ? imgUrl.substring(imgUrl.lastIndexOf('/') + 1) : imgTitle, imgUrl);
+    } catch (Exception e) {
+      throw new HostException("Unexpected error occurred", e);
     }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/ImgboxHost.java

@@ -1,64 +1,64 @@
 package tn.mnlr.vripper.host;
 
+import lombok.extern.slf4j.Slf4j;
 import org.apache.http.client.protocol.HttpClientContext;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
 import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.stereotype.Service;
 import org.w3c.dom.Document;
 import org.w3c.dom.Node;
 import tn.mnlr.vripper.exception.HostException;
 import tn.mnlr.vripper.exception.XpathException;
-import tn.mnlr.vripper.q.ImageFileData;
-import tn.mnlr.vripper.services.ConnectionManager;
+import tn.mnlr.vripper.services.HostService;
+import tn.mnlr.vripper.services.XpathService;
 
 @Service
+@Slf4j
 public class ImgboxHost extends Host {
 
-    private static final Logger logger = LoggerFactory.getLogger(ImgboxHost.class);
+  private static final String host = "imgbox.com";
+  private static final String IMG_XPATH = "//img[@id='img']";
 
-    private static final String host = "imgbox.com";
-    private static final String IMG_XPATH = "//img[@id='img']";
+  private final HostService hostService;
+  private final XpathService xpathService;
 
-    @Autowired
-    private ConnectionManager cm;
+  @Autowired
+  public ImgboxHost(HostService hostService, XpathService xpathService) {
+    this.hostService = hostService;
+    this.xpathService = xpathService;
+  }
 
-    public ImgboxHost() {
-        super();
+  @Override
+  public String getHost() {
+    return host;
+  }
+
+  @Override
+  public String getLookup() {
+    return host;
+  }
+
+  @Override
+  public HostService.NameUrl getNameAndUrl(final String url, final HttpClientContext context)
+      throws HostException {
+
+    Document doc = hostService.getResponse(url, context).getDocument();
+
+    Node imgNode;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
+      imgNode = xpathService.getAsNode(doc, IMG_XPATH);
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getHost() {
-        return host;
-    }
-
-    @Override
-    public String getLookup() {
-        return host;
-    }
-
-    @Override
-    protected void setNameAndUrl(final String url, final ImageFileData imageFileData, final HttpClientContext context) throws HostException {
-
-        Document doc = getResponse(url, context).getDocument();
-
-        Node imgNode;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
-            imgNode = xpathService.getAsNode(doc, IMG_XPATH);
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        try {
-            logger.debug(String.format("Resolving name and image url for %s", url));
-            String imgTitle = imgNode.getAttributes().getNamedItem("title").getTextContent().trim();
-            String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
-
-            imageFileData.setImageUrl(imgUrl);
-            imageFileData.setImageName(imgTitle);
-        } catch (Exception e) {
-            throw new HostException("Unexpected error occurred", e);
-        }
+    try {
+      log.debug(String.format("Resolving name and image url for %s", url));
+      String imgTitle = imgNode.getAttributes().getNamedItem("title").getTextContent().trim();
+      String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
+
+      return new HostService.NameUrl(imgTitle, imgUrl);
+    } catch (Exception e) {
+      throw new HostException("Unexpected error occurred", e);
     }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/ImxHost.java

@@ -1,5 +1,6 @@
 package tn.mnlr.vripper.host;
 
+import lombok.extern.slf4j.Slf4j;
 import org.apache.http.NameValuePair;
 import org.apache.http.client.HttpClient;
 import org.apache.http.client.entity.UrlEncodedFormEntity;
@@ -8,8 +9,6 @@ import org.apache.http.client.methods.HttpPost;
 import org.apache.http.client.protocol.HttpClientContext;
 import org.apache.http.message.BasicNameValuePair;
 import org.apache.http.util.EntityUtils;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
 import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.stereotype.Service;
 import org.w3c.dom.Document;
@@ -17,94 +16,114 @@ import org.w3c.dom.Node;
 import tn.mnlr.vripper.exception.HostException;
 import tn.mnlr.vripper.exception.HtmlProcessorException;
 import tn.mnlr.vripper.exception.XpathException;
-import tn.mnlr.vripper.q.ImageFileData;
-import tn.mnlr.vripper.services.ConnectionManager;
+import tn.mnlr.vripper.services.ConnectionService;
+import tn.mnlr.vripper.services.HostService;
+import tn.mnlr.vripper.services.HtmlProcessorService;
+import tn.mnlr.vripper.services.XpathService;
 
 import java.io.IOException;
 import java.util.ArrayList;
 import java.util.List;
 
 @Service
+@Slf4j
 public class ImxHost extends Host {
 
-    private static final Logger logger = LoggerFactory.getLogger(ImxHost.class);
+  private static final String host = "imx.to";
+  private static final String CONTINUE_BUTTON_XPATH = "//*[@name='imgContinue']";
+  private static final String IMG_XPATH = "//img[@class='centred']";
 
-    private static final String host = "imx.to";
-    private static final String CONTINUE_BUTTON_XPATH = "//*[@name='imgContinue']";
-    private static final String IMG_XPATH = "//img[@class='centred']";
+  private final HostService hostService;
+  private final XpathService xpathService;
+  private final ConnectionService cm;
+  private final HtmlProcessorService htmlProcessorService;
 
-    @Autowired
-    private ConnectionManager cm;
+  @Autowired
+  public ImxHost(
+      HostService hostService,
+      XpathService xpathService,
+      ConnectionService cm,
+      HtmlProcessorService htmlProcessorService) {
+    this.hostService = hostService;
+    this.xpathService = xpathService;
+    this.cm = cm;
+    this.htmlProcessorService = htmlProcessorService;
+  }
 
-    @Override
-    public String getHost() {
-        return host;
+  @Override
+  public String getHost() {
+    return host;
+  }
+
+  @Override
+  public String getLookup() {
+    return host;
+  }
+
+  @Override
+  public HostService.NameUrl getNameAndUrl(final String _url, final HttpClientContext context)
+      throws HostException {
+
+    String url = _url.replace("http://", "https://");
+    HostService.Response resp = hostService.getResponse(url, context);
+    Document doc = resp.getDocument();
+
+    Node contDiv;
+    String value = null;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", CONTINUE_BUTTON_XPATH, url));
+      contDiv = xpathService.getAsNode(doc, CONTINUE_BUTTON_XPATH);
+      if (contDiv == null) {
+        throw new HostException(CONTINUE_BUTTON_XPATH + " cannot be found");
+      }
+      Node node = contDiv.getAttributes().getNamedItem("value");
+      if (node != null) {
+        value = node.getTextContent();
+      }
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getLookup() {
-        return host;
+    if (value == null) {
+      throw new HostException("Failed to obtain value attribute from continue input");
+    }
+    log.debug(String.format("Click button found for %s", url));
+    HttpClient client = cm.getClient().build();
+    HttpPost httpPost = cm.buildHttpPost(url, context);
+    List<NameValuePair> params = new ArrayList<>();
+    params.add(new BasicNameValuePair("imgContinue", value));
+    try {
+      httpPost.setEntity(new UrlEncodedFormEntity(params));
+    } catch (Exception e) {
+      throw new HostException(e);
+    }
+    log.debug(String.format("Requesting %s", httpPost));
+    try (CloseableHttpResponse response =
+        (CloseableHttpResponse) client.execute(httpPost, context)) {
+      log.debug(String.format("Cleaning response for %s", httpPost));
+      doc = htmlProcessorService.clean(EntityUtils.toString(response.getEntity()));
+      EntityUtils.consumeQuietly(response.getEntity());
+    } catch (IOException | HtmlProcessorException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    protected void setNameAndUrl(final String _url, final ImageFileData imageFileData, final HttpClientContext context) throws HostException {
-
-        String url = _url.replace("http://", "https://");
-        Response resp = getResponse(url, context);
-        Document doc = resp.getDocument();
-
-        Node contDiv;
-        String value = null;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", CONTINUE_BUTTON_XPATH, url));
-            contDiv = xpathService.getAsNode(doc, CONTINUE_BUTTON_XPATH);
-            Node node = contDiv.getAttributes().getNamedItem("value");
-            if (node != null) {
-                value = node.getTextContent();
-            }
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        if (value == null) {
-            throw new HostException("Failed to obtain value attribute from continue input");
-        }
-        logger.debug(String.format("Click button found for %s", url));
-        HttpClient client = cm.getClient().build();
-        HttpPost httpPost = cm.buildHttpPost(url);
-        List<NameValuePair> params = new ArrayList<>();
-        params.add(new BasicNameValuePair("imgContinue", value));
-        try {
-            httpPost.setEntity(new UrlEncodedFormEntity(params));
-        } catch (Exception e) {
-            throw new HostException(e);
-        }
-        logger.debug(String.format("Requesting %s", httpPost));
-        try (CloseableHttpResponse response = (CloseableHttpResponse) client.execute(httpPost, context)) {
-            logger.debug(String.format("Cleaning response for %s", httpPost));
-            doc = htmlProcessorService.clean(EntityUtils.toString(response.getEntity()));
-            EntityUtils.consumeQuietly(response.getEntity());
-        } catch (IOException | HtmlProcessorException e) {
-            throw new HostException(e);
-        }
-
-        Node imgNode;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
-            imgNode = xpathService.getAsNode(doc, IMG_XPATH);
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        try {
-            logger.debug(String.format("Resolving name and image url for %s", url));
-            String imgTitle = imgNode.getAttributes().getNamedItem("alt").getTextContent().trim();
-            String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
-
-            imageFileData.setImageUrl(imgUrl);
-            imageFileData.setImageName(imgTitle.isEmpty() ? imgUrl.substring(imgUrl.lastIndexOf('/') + 1) : imgTitle);
-        } catch (Exception e) {
-            throw new HostException("Unexpected error occurred", e);
-        }
+    Node imgNode;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
+      imgNode = xpathService.getAsNode(doc, IMG_XPATH);
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
+
+    try {
+      log.debug(String.format("Resolving name and image url for %s", url));
+      String imgTitle = imgNode.getAttributes().getNamedItem("alt").getTextContent().trim();
+      String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
+
+      return new HostService.NameUrl(
+          imgTitle.isEmpty() ? imgUrl.substring(imgUrl.lastIndexOf('/') + 1) : imgTitle, imgUrl);
+    } catch (Exception e) {
+      throw new HostException("Unexpected error occurred", e);
+    }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/PimpandhostHost.java

@@ -1,67 +1,75 @@
 package tn.mnlr.vripper.host;
 
+import lombok.extern.slf4j.Slf4j;
 import org.apache.http.client.protocol.HttpClientContext;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
+import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.stereotype.Service;
 import org.w3c.dom.Document;
 import org.w3c.dom.Node;
 import tn.mnlr.vripper.exception.HostException;
 import tn.mnlr.vripper.exception.XpathException;
-import tn.mnlr.vripper.q.ImageFileData;
+import tn.mnlr.vripper.services.HostService;
+import tn.mnlr.vripper.services.XpathService;
 
 @Service
+@Slf4j
 public class PimpandhostHost extends Host {
 
-    private static final Logger logger = LoggerFactory.getLogger(PimpandhostHost.class);
+  private static final String host = "pimpandhost.com";
+  private static final String IMG_XPATH = "//img[contains(@class, 'original')]";
 
-    private static final String host = "pimpandhost.com";
-    private static final String IMG_XPATH = "//img[contains(@class, 'original')]";
+  private final HostService hostService;
+  private final XpathService xpathService;
 
-    public PimpandhostHost() {
-        super();
+  @Autowired
+  public PimpandhostHost(HostService hostService, XpathService xpathService) {
+    super();
+    this.hostService = hostService;
+    this.xpathService = xpathService;
+  }
+
+  @Override
+  public String getHost() {
+    return host;
+  }
+
+  @Override
+  public String getLookup() {
+    return host;
+  }
+
+  @Override
+  public HostService.NameUrl getNameAndUrl(final String _url, final HttpClientContext context)
+      throws HostException {
+
+    String url;
+    try {
+      url = hostService.appendUri(_url.replace("http://", "https://"), "size=original");
+    } catch (Exception e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getHost() {
-        return host;
+    HostService.Response resp = hostService.getResponse(url, context);
+    Document doc = resp.getDocument();
+
+    Node imgNode;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
+      imgNode = xpathService.getAsNode(doc, IMG_XPATH);
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getLookup() {
-        return host;
-    }
-
-    @Override
-    protected void setNameAndUrl(final String _url, final ImageFileData imageFileData, final HttpClientContext context) throws HostException {
-
-        String url;
-        try {
-            url = appendUri(_url.replace("http://", "https://"), "size=original");
-        } catch (Exception e) {
-            throw new HostException(e);
-        }
-
-        Response resp = getResponse(url, context);
-        Document doc = resp.getDocument();
-
-        Node imgNode;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
-            imgNode = xpathService.getAsNode(doc, IMG_XPATH);
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        try {
-            logger.debug(String.format("Resolving name and image url for %s", url));
-            String imgTitle = imgNode.getAttributes().getNamedItem("alt").getTextContent().trim();
-            String imgUrl = "https:" + imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
-
-            imageFileData.setImageUrl(imgUrl);
-            imageFileData.setImageName(imgTitle.isEmpty() ? imgUrl.substring(imgUrl.lastIndexOf('/') + 1) : imgTitle);
-        } catch (Exception e) {
-            throw new HostException("Unexpected error occurred", e);
-        }
+    try {
+      log.debug(String.format("Resolving name and image url for %s", url));
+      String imgTitle = imgNode.getAttributes().getNamedItem("alt").getTextContent().trim();
+      String imgUrl =
+          "https:" + imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
+
+      return new HostService.NameUrl(
+          imgTitle.isEmpty() ? imgUrl.substring(imgUrl.lastIndexOf('/') + 1) : imgTitle, imgUrl);
+    } catch (Exception e) {
+      throw new HostException("Unexpected error occurred", e);
     }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/PixRouteHost.java

@@ -1,58 +1,69 @@
 package tn.mnlr.vripper.host;
 
+import lombok.extern.slf4j.Slf4j;
 import org.apache.http.client.protocol.HttpClientContext;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
+import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.stereotype.Service;
 import org.w3c.dom.Document;
 import org.w3c.dom.Node;
 import tn.mnlr.vripper.exception.HostException;
 import tn.mnlr.vripper.exception.XpathException;
-import tn.mnlr.vripper.q.ImageFileData;
+import tn.mnlr.vripper.services.HostService;
+import tn.mnlr.vripper.services.XpathService;
 
 @Service
+@Slf4j
 public class PixRouteHost extends Host {
 
-    private static final Logger logger = LoggerFactory.getLogger(PixRouteHost.class);
+  private static final String host = "pixroute.com";
+  private static final String IMG_XPATH = "//img[@id='imgpreview']";
 
-    private static final String host = "pixroute.com";
-    private static final String IMG_XPATH = "//img[@id='imgpreview']";
+  private final HostService hostService;
+  private final XpathService xpathService;
 
-    @Override
-    public String getHost() {
-        return host;
+  @Autowired
+  public PixRouteHost(HostService hostService, XpathService xpathService) {
+    this.hostService = hostService;
+    this.xpathService = xpathService;
+  }
+
+  @Override
+  public String getHost() {
+    return host;
+  }
+
+  @Override
+  public String getLookup() {
+    return host;
+  }
+
+  @Override
+  public HostService.NameUrl getNameAndUrl(final String _url, final HttpClientContext context)
+      throws HostException {
+
+    String url = _url.replace("http://", "https://");
+    Document doc = hostService.getResponse(url, context).getDocument();
+
+    Node imgNode;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
+      imgNode = xpathService.getAsNode(doc, IMG_XPATH);
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getLookup() {
-        return host;
+    if (imgNode == null) {
+      throw new HostException("Failed to locate image");
     }
 
-    @Override
-    protected void setNameAndUrl(final String _url, final ImageFileData imageFileData, final HttpClientContext context) throws HostException {
+    try {
+      log.debug(String.format("Resolving name and image url for %s", url));
 
-        String url = _url.replace("http://", "https://");
-        Document doc = getResponse(url, context).getDocument();
-
-        Node imgNode;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
-            imgNode = xpathService.getAsNode(doc, IMG_XPATH);
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        if (imgNode == null) {
-            throw new HostException("Failed to locate image");
-        }
-
-        try {
-            logger.debug(String.format("Resolving name and image url for %s", url));
-
-            imageFileData.setImageUrl(imgNode.getAttributes().getNamedItem("src").getTextContent().trim());
-            imageFileData.setImageName(imgNode.getAttributes().getNamedItem("alt").getTextContent().trim());
-        } catch (Exception e) {
-            throw new HostException("Unexpected error occurred", e);
-        }
+      return new HostService.NameUrl(
+          imgNode.getAttributes().getNamedItem("alt").getTextContent().trim(),
+          imgNode.getAttributes().getNamedItem("src").getTextContent().trim());
+    } catch (Exception e) {
+      throw new HostException("Unexpected error occurred", e);
     }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/PixhostHost.java

@@ -1,60 +1,65 @@
 package tn.mnlr.vripper.host;
 
+import lombok.extern.slf4j.Slf4j;
 import org.apache.http.client.protocol.HttpClientContext;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
+import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.stereotype.Service;
 import org.w3c.dom.Document;
 import org.w3c.dom.Node;
 import tn.mnlr.vripper.exception.HostException;
 import tn.mnlr.vripper.exception.XpathException;
-import tn.mnlr.vripper.q.ImageFileData;
+import tn.mnlr.vripper.services.HostService;
+import tn.mnlr.vripper.services.XpathService;
 
 @Service
+@Slf4j
 public class PixhostHost extends Host {
 
-    private static final Logger logger = LoggerFactory.getLogger(PixhostHost.class);
+  private static final String host = "pixhost.to";
+  private static final String lookup = "pixhost.to/show";
+  private static final String IMG_XPATH = "//img[@id='image']";
 
-    private static final String host = "pixhost.to";
-    private static final String lookup = "pixhost.to/show";
-    private static final String IMG_XPATH = "//img[@id='image']";
+  private final HostService hostService;
+  private final XpathService xpathService;
 
-    public PixhostHost() {
-        super();
+  @Autowired
+  public PixhostHost(HostService hostService, XpathService xpathService) {
+    this.hostService = hostService;
+    this.xpathService = xpathService;
+  }
+
+  @Override
+  public String getHost() {
+    return host;
+  }
+
+  @Override
+  public String getLookup() {
+    return lookup;
+  }
+
+  @Override
+  public HostService.NameUrl getNameAndUrl(final String url, final HttpClientContext context)
+      throws HostException {
+
+    Document doc = hostService.getResponse(url, context).getDocument();
+
+    Node imgNode;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
+      imgNode = xpathService.getAsNode(doc, IMG_XPATH);
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getHost() {
-        return host;
-    }
-
-    @Override
-    public String getLookup() {
-        return lookup;
-    }
-
-    @Override
-    protected void setNameAndUrl(final String url, final ImageFileData imageFileData, final HttpClientContext context) throws HostException {
-
-        Document doc = getResponse(url, context).getDocument();
-
-        Node imgNode;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
-            imgNode = xpathService.getAsNode(doc, IMG_XPATH);
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        try {
-            logger.debug(String.format("Resolving name and image url for %s", url));
-            String imgTitle = imgNode.getAttributes().getNamedItem("alt").getTextContent().trim();
-            String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
-
-            imageFileData.setImageUrl(imgUrl);
-            imageFileData.setImageName(imgTitle.substring(imgTitle.indexOf('_') + 1));
-        } catch (Exception e) {
-            throw new HostException("Unexpected error occurred", e);
-        }
+    try {
+      log.debug(String.format("Resolving name and image url for %s", url));
+      String imgTitle = imgNode.getAttributes().getNamedItem("alt").getTextContent().trim();
+      String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
+
+      return new HostService.NameUrl(imgTitle.substring(imgTitle.indexOf('_') + 1), imgUrl);
+    } catch (Exception e) {
+      throw new HostException("Unexpected error occurred", e);
     }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/PixxxelsHost.java

@@ -1,66 +1,72 @@
 package tn.mnlr.vripper.host;
 
+import lombok.extern.slf4j.Slf4j;
 import org.apache.http.client.protocol.HttpClientContext;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
+import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.stereotype.Service;
 import org.w3c.dom.Document;
 import org.w3c.dom.Node;
 import tn.mnlr.vripper.exception.HostException;
 import tn.mnlr.vripper.exception.XpathException;
-import tn.mnlr.vripper.q.ImageFileData;
+import tn.mnlr.vripper.services.HostService;
+import tn.mnlr.vripper.services.XpathService;
 
 @Service
+@Slf4j
 public class PixxxelsHost extends Host {
 
-    private static final Logger logger = LoggerFactory.getLogger(PixxxelsHost.class);
+  private static final String host = "pixxxels.cc";
+  private static final String IMG_XPATH = "//*[@id='download']";
+  private static final String TITLE_XPATH = "//*[contains(@class,'imagename')]";
 
-    private static final String host = "pixxxels.cc";
-    private static final String IMG_XPATH = "//*[@id='download']";
-    private static final String TITLE_XPATH = "//*[contains(@class,'imagename')]";
+  private final HostService hostService;
+  private final XpathService xpathService;
 
-    public PixxxelsHost() {
-        super();
+  @Autowired
+  public PixxxelsHost(HostService hostService, XpathService xpathService) {
+    this.hostService = hostService;
+    this.xpathService = xpathService;
+  }
+
+  @Override
+  public String getHost() {
+    return host;
+  }
+
+  @Override
+  public String getLookup() {
+    return host;
+  }
+
+  @Override
+  public HostService.NameUrl getNameAndUrl(final String _url, final HttpClientContext context)
+      throws HostException {
+
+    String url = _url.replace("http://", "https://");
+    HostService.Response resp = hostService.getResponse(url, context);
+    Document doc = resp.getDocument();
+
+    Node imgNode, titleNode;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
+      imgNode = xpathService.getAsNode(doc, IMG_XPATH);
+
+      log.debug(String.format("Looking for xpath expression %s in %s", TITLE_XPATH, url));
+      titleNode = xpathService.getAsNode(doc, TITLE_XPATH);
+
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getHost() {
-        return host;
-    }
-
-    @Override
-    public String getLookup() {
-        return host;
-    }
-
-    @Override
-    protected void setNameAndUrl(final String _url, final ImageFileData imageFileData, final HttpClientContext context) throws HostException {
-
-        String url = _url.replace("http://", "https://");
-        Response resp = getResponse(url, context);
-        Document doc = resp.getDocument();
-
-        Node imgNode, titleNode;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
-            imgNode = xpathService.getAsNode(doc, IMG_XPATH);
-
-            logger.debug(String.format("Looking for xpath expression %s in %s", TITLE_XPATH, url));
-            titleNode = xpathService.getAsNode(doc, TITLE_XPATH);
-
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        try {
-            logger.debug(String.format("Resolving name and image url for %s", url));
-            String imgTitle = titleNode.getTextContent().trim();
-            String imgUrl = imgNode.getAttributes().getNamedItem("href").getTextContent().trim();
-
-            imageFileData.setImageUrl(imgUrl);
-            imageFileData.setImageName(imgTitle.isEmpty() ? imgUrl.substring(imgUrl.lastIndexOf('/') + 1) : imgTitle);
-        } catch (Exception e) {
-            throw new HostException("Unexpected error occurred", e);
-        }
+    try {
+      log.debug(String.format("Resolving name and image url for %s", url));
+      String imgTitle = titleNode.getTextContent().trim();
+      String imgUrl = imgNode.getAttributes().getNamedItem("href").getTextContent().trim();
+
+      return new HostService.NameUrl(
+          imgTitle.isEmpty() ? imgUrl.substring(imgUrl.lastIndexOf('/') + 1) : imgTitle, imgUrl);
+    } catch (Exception e) {
+      throw new HostException("Unexpected error occurred", e);
     }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/PostImgHost.java

@@ -1,65 +1,74 @@
 package tn.mnlr.vripper.host;
 
+import lombok.extern.slf4j.Slf4j;
 import org.apache.http.client.protocol.HttpClientContext;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
+import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.stereotype.Service;
 import org.w3c.dom.Document;
 import org.w3c.dom.Node;
 import tn.mnlr.vripper.exception.HostException;
 import tn.mnlr.vripper.exception.XpathException;
-import tn.mnlr.vripper.q.ImageFileData;
+import tn.mnlr.vripper.services.HostService;
+import tn.mnlr.vripper.services.XpathService;
 
 import java.util.Optional;
 
 @Service
+@Slf4j
 public class PostImgHost extends Host {
 
-    private static final Logger logger = LoggerFactory.getLogger(PostImgHost.class);
+  private static final String host = "postimg.cc";
+  private static final String TITLE_XPATH = "//span[contains(@class,'imagename')]";
+  private static final String IMG_XPATH = "//a[@id='download']";
 
-    private static final String host = "postimg.cc";
-    private static final String TITLE_XPATH = "//span[contains(@class,'imagename')]";
-    private static final String IMG_XPATH = "//a[@id='download']";
+  private final HostService hostService;
+  private final XpathService xpathService;
 
-    public PostImgHost() {
-        super();
+  @Autowired
+  public PostImgHost(HostService hostService, XpathService xpathService) {
+    this.hostService = hostService;
+    this.xpathService = xpathService;
+  }
+
+  @Override
+  public String getHost() {
+    return host;
+  }
+
+  @Override
+  public String getLookup() {
+    return host;
+  }
+
+  @Override
+  public HostService.NameUrl getNameAndUrl(final String _url, final HttpClientContext context)
+      throws HostException {
+
+    String url = _url.replace("http://", "https://");
+    Document doc = hostService.getResponse(url, context).getDocument();
+
+    Node urlNode, titleNode;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", TITLE_XPATH, url));
+      titleNode = xpathService.getAsNode(doc, TITLE_XPATH);
+
+      log.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
+      urlNode = xpathService.getAsNode(doc, IMG_XPATH);
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getHost() {
-        return host;
-    }
-
-    @Override
-    public String getLookup() {
-        return host;
-    }
-
-    @Override
-    protected void setNameAndUrl(final String _url, final ImageFileData imageFileData, final HttpClientContext context) throws HostException {
-
-        String url = _url.replace("http://", "https://");
-        Document doc = getResponse(url, context).getDocument();
-
-        Node urlNode, titleNode;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", TITLE_XPATH, url));
-            titleNode = xpathService.getAsNode(doc, TITLE_XPATH);
-
-            logger.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
-            urlNode = xpathService.getAsNode(doc, IMG_XPATH);
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        try {
-            logger.debug(String.format("Resolving name and image url for %s", url));
-            String imgTitle = Optional.ofNullable(titleNode).map(node -> node.getTextContent().trim()).orElseGet(() -> getDefaultImageName(url));
-
-            imageFileData.setImageUrl(urlNode.getAttributes().getNamedItem("href").getTextContent().trim());
-            imageFileData.setImageName(imgTitle);
-        } catch (Exception e) {
-            throw new HostException("Unexpected error occurred", e);
-        }
+    try {
+      log.debug(String.format("Resolving name and image url for %s", url));
+      String imgTitle =
+          Optional.ofNullable(titleNode)
+              .map(node -> node.getTextContent().trim())
+              .orElseGet(() -> hostService.getDefaultImageName(url));
+
+      return new HostService.NameUrl(
+          imgTitle, urlNode.getAttributes().getNamedItem("href").getTextContent().trim());
+    } catch (Exception e) {
+      throw new HostException("Unexpected error occurred", e);
     }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/TurboImageHost.java

@@ -1,67 +1,73 @@
 package tn.mnlr.vripper.host;
 
+import lombok.extern.slf4j.Slf4j;
 import org.apache.http.client.protocol.HttpClientContext;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
+import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.stereotype.Service;
 import org.w3c.dom.Document;
 import org.w3c.dom.Node;
 import tn.mnlr.vripper.exception.HostException;
 import tn.mnlr.vripper.exception.XpathException;
-import tn.mnlr.vripper.q.ImageFileData;
+import tn.mnlr.vripper.services.HostService;
+import tn.mnlr.vripper.services.XpathService;
 
 @Service
+@Slf4j
 public class TurboImageHost extends Host {
 
-    private static final Logger logger = LoggerFactory.getLogger(TurboImageHost.class);
+  private static final String host = "turboimagehost.com";
+  private static final String TITLE_XPATH = "//div[contains(@class,'titleFullS')]/h1";
+  private static final String IMG_XPATH = "//img[@id='imageid']";
 
-    private static final String host = "turboimagehost.com";
-    private static final String TITLE_XPATH = "//div[contains(@class,'titleFullS')]/h1";
-    private static final String IMG_XPATH = "//img[@id='uImage']";
+  private final HostService hostService;
+  private final XpathService xpathService;
 
-    public TurboImageHost() {
-        super();
+  @Autowired
+  public TurboImageHost(HostService hostService, XpathService xpathService) {
+    this.hostService = hostService;
+    this.xpathService = xpathService;
+  }
+
+  @Override
+  public String getHost() {
+    return host;
+  }
+
+  @Override
+  public String getLookup() {
+    return host;
+  }
+
+  @Override
+  public HostService.NameUrl getNameAndUrl(final String url, final HttpClientContext context)
+      throws HostException {
+
+    Document doc = hostService.getResponse(url, context).getDocument();
+
+    String title;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", TITLE_XPATH, url));
+      Node titleNode = xpathService.getAsNode(doc, TITLE_XPATH);
+      log.debug(String.format("Resolving name for %s", url));
+      if (titleNode != null) {
+        title = titleNode.getTextContent().trim();
+      } else {
+        title = null;
+      }
+    } catch (XpathException e) {
+      throw new HostException(e);
     }
 
-    @Override
-    public String getHost() {
-        return host;
+    if (title == null || title.isEmpty()) {
+      title = hostService.getDefaultImageName(url);
     }
 
-    @Override
-    public String getLookup() {
-        return host;
-    }
-
-    @Override
-    protected void setNameAndUrl(final String url, final ImageFileData imageFileData, final HttpClientContext context) throws HostException {
-
-        Document doc = getResponse(url, context).getDocument();
-
-        String title;
-        try {
-            logger.debug(String.format("Looking for xpath expression %s in %s", TITLE_XPATH, url));
-            Node titleNode = xpathService.getAsNode(doc, TITLE_XPATH);
-            logger.debug(String.format("Resolving name for %s", url));
-            if (titleNode != null) {
-                title = titleNode.getTextContent().trim();
-            } else {
-                title = null;
-            }
-        } catch (XpathException e) {
-            throw new HostException(e);
-        }
-
-        if (title == null || title.isEmpty()) {
-            title = getDefaultImageName(url);
-        }
-
-        try {
-            Node urlNode = xpathService.getAsNode(doc, IMG_XPATH);
-            imageFileData.setImageUrl(urlNode.getAttributes().getNamedItem("src").getTextContent().trim());
-            imageFileData.setImageName(title);
-        } catch (Exception e) {
-            throw new HostException("Unexpected error occurred", e);
-        }
+    try {
+      Node urlNode = xpathService.getAsNode(doc, IMG_XPATH);
+      return new HostService.NameUrl(
+          title, urlNode.getAttributes().getNamedItem("src").getTextContent().trim());
+    } catch (Exception e) {
+      throw new HostException("Unexpected error occurred", e);
     }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/host/ViprImHost.java

@@ -0,0 +1,70 @@
+package tn.mnlr.vripper.host;
+
+import lombok.extern.slf4j.Slf4j;
+import org.apache.http.client.protocol.HttpClientContext;
+import org.springframework.beans.factory.annotation.Autowired;
+import org.springframework.stereotype.Service;
+import org.w3c.dom.Document;
+import org.w3c.dom.Node;
+import tn.mnlr.vripper.exception.HostException;
+import tn.mnlr.vripper.exception.XpathException;
+import tn.mnlr.vripper.services.HostService;
+import tn.mnlr.vripper.services.XpathService;
+
+import java.util.Optional;
+
+@Service
+@Slf4j
+public class ViprImHost extends Host {
+
+  private static final String IMG_XPATH = "//img[contains(@class, 'img')]";
+  private static final String host = "vipr.im";
+
+  private final HostService hostService;
+  private final XpathService xpathService;
+
+  @Autowired
+  public ViprImHost(HostService hostService, XpathService xpathService) {
+    this.hostService = hostService;
+    this.xpathService = xpathService;
+  }
+
+  @Override
+  public String getHost() {
+    return host;
+  }
+
+  @Override
+  public String getLookup() {
+    return host;
+  }
+
+  @Override
+  public HostService.NameUrl getNameAndUrl(final String url, final HttpClientContext context)
+      throws HostException {
+
+    Document doc = hostService.getResponse(url, context).getDocument();
+
+    Node imgNode;
+    try {
+      log.debug(String.format("Looking for xpath expression %s in %s", IMG_XPATH, url));
+      imgNode = xpathService.getAsNode(doc, IMG_XPATH);
+    } catch (XpathException e) {
+      throw new HostException(e);
+    }
+
+    try {
+      log.debug(String.format("Resolving name and image url for %s", url));
+      String imgTitle =
+          Optional.ofNullable(imgNode.getAttributes().getNamedItem("alt"))
+              .map(Node::getTextContent)
+              .map(String::trim)
+              .orElse(null);
+      String imgUrl = imgNode.getAttributes().getNamedItem("src").getTextContent().trim();
+
+      return new HostService.NameUrl(imgTitle, imgUrl);
+    } catch (Exception e) {
+      throw new HostException("Unexpected error occurred", e);
+    }
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/Management.java

@@ -0,0 +1,79 @@
+package tn.mnlr.vripper.jpa;
+
+import org.springframework.beans.factory.annotation.Value;
+import org.springframework.jdbc.core.JdbcTemplate;
+import org.springframework.scheduling.annotation.EnableScheduling;
+import org.springframework.scheduling.annotation.Scheduled;
+import org.springframework.stereotype.Component;
+import tn.mnlr.vripper.download.DownloadService;
+import tn.mnlr.vripper.services.ThreadPoolService;
+
+import javax.annotation.PostConstruct;
+import javax.annotation.PreDestroy;
+import java.io.File;
+import java.time.LocalDate;
+import java.time.LocalDateTime;
+import java.time.format.DateTimeFormatter;
+import java.util.Optional;
+import java.util.regex.Matcher;
+import java.util.regex.Pattern;
+
+@Component
+@EnableScheduling
+public class Management {
+
+  public static final DateTimeFormatter FORMATTER = DateTimeFormatter.ofPattern("yyyy-MM-dd");
+  private static final Pattern BACKUP_FILE_PATTERN =
+      Pattern.compile("^db_(\\d{4}-\\d{2}-\\d{2})\\.tar\\.gz$");
+
+  private final JdbcTemplate jdbcTemplate;
+  private final String backupFolder;
+  private final ThreadPoolService threadPoolService;
+  private final DownloadService downloadService;
+
+  public Management(
+      JdbcTemplate jdbcTemplate,
+      @Value("${base.dir}") String baseDir,
+      @Value("${base.dir.name}") String baseDirName,
+      ThreadPoolService threadPoolService,
+      DownloadService downloadService) {
+    this.jdbcTemplate = jdbcTemplate;
+    this.threadPoolService = threadPoolService;
+    this.downloadService = downloadService;
+    this.backupFolder = baseDir + File.separator + baseDirName + File.separator + "backup";
+  }
+
+  @PreDestroy
+  public void destroy() {
+
+    try {
+      threadPoolService.destroy();
+      downloadService.destroy();
+      this.jdbcTemplate.execute("SHUTDOWN");
+    } catch (Exception ignored) {
+      Thread.currentThread().interrupt();
+    }
+  }
+
+  @PostConstruct
+  @Scheduled(cron = "0 0 0 ? * *")
+  private void backup() {
+
+    for (File file :
+        Optional.ofNullable(new File(backupFolder).listFiles()).orElse(new File[] {})) {
+      Matcher matcher = BACKUP_FILE_PATTERN.matcher(file.getName());
+      if (matcher.find()) {
+        LocalDate localDate = LocalDate.parse(matcher.group(1), FORMATTER);
+        if (localDate.isEqual(LocalDate.now())) {
+          return;
+        }
+      }
+    }
+
+    // create a backup file
+    File backupFile =
+        new File(
+            backupFolder, String.format("db_%s.tar.gz", LocalDateTime.now().format(FORMATTER)));
+    jdbcTemplate.execute(String.format("BACKUP DATABASE TO '%s' BLOCKING", backupFile.getPath()));
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/domain/DateTimeSerializer.java

@@ -0,0 +1,25 @@
+package tn.mnlr.vripper.jpa.domain;
+
+import com.fasterxml.jackson.core.JsonGenerator;
+import com.fasterxml.jackson.databind.SerializerProvider;
+import com.fasterxml.jackson.databind.ser.std.StdSerializer;
+
+import java.io.IOException;
+import java.time.LocalDateTime;
+import java.time.format.DateTimeFormatter;
+
+public class DateTimeSerializer extends StdSerializer<LocalDateTime> {
+
+  private static final DateTimeFormatter DATE_TIME_FORMATTER =
+      DateTimeFormatter.ofPattern("yyyy/MM/dd HH:mm:ss.SSS");
+
+  protected DateTimeSerializer() {
+    super(LocalDateTime.class);
+  }
+
+  @Override
+  public void serialize(LocalDateTime value, JsonGenerator gen, SerializerProvider provider)
+      throws IOException {
+    gen.writeString(value.format(DATE_TIME_FORMATTER));
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/domain/Image.java

@@ -0,0 +1,66 @@
+package tn.mnlr.vripper.jpa.domain;
+
+import com.fasterxml.jackson.annotation.JsonIgnore;
+import lombok.Getter;
+import lombok.NoArgsConstructor;
+import lombok.Setter;
+import lombok.ToString;
+import tn.mnlr.vripper.host.Host;
+import tn.mnlr.vripper.jpa.domain.enums.Status;
+
+import java.util.Objects;
+
+@Getter
+@Setter
+@ToString
+@NoArgsConstructor
+public class Image {
+
+  @JsonIgnore protected Long id;
+
+  @JsonIgnore private Host host;
+
+  private String url;
+
+  private int index;
+
+  private long current = 0;
+
+  private long total = 0;
+
+  private Status status;
+
+  private String postId;
+
+  @JsonIgnore private Long postIdRef;
+
+  public Image(String postId, String url, Host host, int index) {
+    this.postId = postId;
+    this.url = url;
+    this.host = host;
+    this.index = index;
+    status = Status.STOPPED;
+  }
+
+  public void increase(int read) {
+    current += read;
+  }
+
+  public void init() {
+    current = 0;
+    status = Status.STOPPED;
+  }
+
+  @Override
+  public boolean equals(Object o) {
+    if (this == o) return true;
+    if (o == null || getClass() != o.getClass()) return false;
+    Image image = (Image) o;
+    return Objects.equals(url, image.url);
+  }
+
+  @Override
+  public int hashCode() {
+    return Objects.hash(url);
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/domain/LogEvent.java

@@ -0,0 +1,52 @@
+package tn.mnlr.vripper.jpa.domain;
+
+import com.fasterxml.jackson.databind.annotation.JsonSerialize;
+import lombok.Getter;
+import lombok.NoArgsConstructor;
+import lombok.Setter;
+import lombok.ToString;
+
+import java.time.LocalDateTime;
+
+@Getter
+@Setter
+@ToString
+@NoArgsConstructor
+public class LogEvent {
+
+  private Long id;
+  private Type type;
+  private Status status;
+
+  @JsonSerialize(using = DateTimeSerializer.class)
+  private LocalDateTime time;
+
+  private String message;
+
+  public LogEvent(Type type, Status status, LocalDateTime time, String message) {
+    this.type = type;
+    this.status = status;
+    this.time = time;
+    this.message = message;
+  }
+
+  public enum Type {
+    POST,
+    QUEUED,
+    THANKS,
+    METADATA,
+    SCAN,
+    DOWNLOAD,
+
+    // Below are deprecated events
+    METADATA_CACHE_MISS,
+    QUEUED_CACHE_MISS
+  }
+
+  public enum Status {
+    PENDING,
+    PROCESSING,
+    DONE,
+    ERROR
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/domain/Metadata.java

@@ -0,0 +1,31 @@
+package tn.mnlr.vripper.jpa.domain;
+
+import lombok.Getter;
+import lombok.NoArgsConstructor;
+import lombok.Setter;
+
+import java.util.Collections;
+import java.util.List;
+
+@Getter
+@Setter
+@NoArgsConstructor
+public class Metadata {
+
+  private Long postIdRef;
+
+  private String postId;
+
+  private String postedBy;
+
+  private List<String> resolvedNames = Collections.emptyList();
+
+  public static Metadata from(Metadata metadata) {
+    Metadata copy = new Metadata();
+    copy.postIdRef = metadata.postIdRef;
+    copy.postId = metadata.postId;
+    copy.postedBy = metadata.postedBy;
+    copy.resolvedNames = List.copyOf(metadata.resolvedNames);
+    return copy;
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/domain/Post.java

@@ -0,0 +1,90 @@
+package tn.mnlr.vripper.jpa.domain;
+
+import com.fasterxml.jackson.annotation.JsonIgnore;
+import com.fasterxml.jackson.databind.annotation.JsonSerialize;
+import lombok.Getter;
+import lombok.NoArgsConstructor;
+import lombok.Setter;
+import lombok.ToString;
+import tn.mnlr.vripper.jpa.domain.enums.Status;
+
+import java.time.LocalDateTime;
+import java.util.Collections;
+import java.util.Objects;
+import java.util.Set;
+
+@Getter
+@Setter
+@ToString
+@NoArgsConstructor
+public class Post {
+
+  @JsonIgnore private Long id;
+
+  private Status status;
+
+  private String postId;
+
+  private String threadTitle;
+
+  private String threadId;
+
+  private String title;
+
+  private String url;
+
+  private int done;
+
+  private int total;
+
+  private Set<String> hosts;
+
+  private String forum;
+
+  @JsonIgnore private String securityToken;
+
+  @JsonIgnore private String downloadDirectory;
+
+  private boolean thanked;
+
+  private Set<String> previews = Collections.emptySet();
+
+  private Metadata metadata;
+
+  private int rank = Integer.MAX_VALUE;
+
+  @JsonSerialize(using = DateTimeSerializer.class)
+  private LocalDateTime addedOn;
+
+  public Post(
+      String title,
+      String url,
+      String postId,
+      String threadId,
+      String threadTitle,
+      String forum,
+      String securityToken) {
+    this.title = title;
+    this.url = url;
+    this.postId = postId;
+    this.forum = forum;
+    this.threadId = threadId;
+    this.threadTitle = threadTitle;
+    this.securityToken = securityToken;
+    status = Status.STOPPED;
+    addedOn = LocalDateTime.now();
+  }
+
+  @Override
+  public boolean equals(Object o) {
+    if (this == o) return true;
+    if (o == null || getClass() != o.getClass()) return false;
+    Post post = (Post) o;
+    return Objects.equals(postId, post.postId);
+  }
+
+  @Override
+  public int hashCode() {
+    return Objects.hash(postId);
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/domain/Queued.java

@@ -0,0 +1,56 @@
+package tn.mnlr.vripper.jpa.domain;
+
+import com.fasterxml.jackson.annotation.JsonIgnore;
+import lombok.Getter;
+import lombok.NoArgsConstructor;
+import lombok.Setter;
+import lombok.ToString;
+
+import java.util.Objects;
+
+@Getter
+@Setter
+@NoArgsConstructor
+@ToString
+public class Queued {
+
+  @JsonIgnore private Long id;
+
+  private String link;
+
+  private String threadId;
+
+  private String postId;
+
+  private int total = 0;
+
+  private boolean loading = true;
+
+  public Queued(String link, String threadId, String postId) {
+    this();
+    this.link = link;
+    this.threadId = threadId;
+    this.postId = postId;
+  }
+
+  public void done() {
+    this.loading = false;
+  }
+
+  public void increment() {
+    this.total++;
+  }
+
+  @Override
+  public boolean equals(Object o) {
+    if (this == o) return true;
+    if (o == null || getClass() != o.getClass()) return false;
+    Queued that = (Queued) o;
+    return Objects.equals(threadId, that.threadId);
+  }
+
+  @Override
+  public int hashCode() {
+    return Objects.hash(threadId);
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/domain/enums/Status.java

@@ -0,0 +1,10 @@
+package tn.mnlr.vripper.jpa.domain.enums;
+
+public enum Status {
+  PENDING,
+  DOWNLOADING,
+  COMPLETE,
+  ERROR,
+  STOPPED,
+  PARTIAL
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/repositories/IImageRepository.java

@@ -0,0 +1,32 @@
+package tn.mnlr.vripper.jpa.repositories;
+
+import tn.mnlr.vripper.jpa.domain.Image;
+import tn.mnlr.vripper.jpa.domain.enums.Status;
+
+import java.util.List;
+import java.util.Optional;
+
+public interface IImageRepository extends IRepository {
+
+  Image save(Image image);
+
+  void deleteAllByPostId(String postId);
+
+  List<Image> findByPostId(String postId);
+
+  Integer countError();
+
+  List<Image> findByPostIdAndIsNotCompleted(String postId);
+
+  int stopByPostIdAndIsNotCompleted(String postId);
+
+  List<Image> findByPostIdAndIsError(String postId);
+
+  Optional<Image> findById(Long id);
+
+  int updateStatus(Status status, Long id);
+
+  int updateCurrent(long current, Long id);
+
+  int updateTotal(long total, Long id);
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/repositories/ILogEventRepository.java

@@ -0,0 +1,21 @@
+package tn.mnlr.vripper.jpa.repositories;
+
+import tn.mnlr.vripper.jpa.domain.LogEvent;
+
+import java.util.List;
+import java.util.Optional;
+
+public interface ILogEventRepository extends IRepository {
+
+  LogEvent save(LogEvent logEvent);
+
+  LogEvent update(LogEvent logEvent);
+
+  List<LogEvent> findAll();
+
+  Optional<LogEvent> findById(Long id);
+
+  void delete(Long id);
+
+  void deleteAll();
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/repositories/IMetadataRepository.java

@@ -0,0 +1,14 @@
+package tn.mnlr.vripper.jpa.repositories;
+
+import tn.mnlr.vripper.jpa.domain.Metadata;
+
+import java.util.Optional;
+
+public interface IMetadataRepository extends IRepository {
+
+  Metadata save(Metadata metadata);
+
+  Optional<Metadata> findByPostId(String postId);
+
+  int deleteByPostId(String postId);
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/repositories/IPostRepository.java

@@ -0,0 +1,38 @@
+package tn.mnlr.vripper.jpa.repositories;
+
+import tn.mnlr.vripper.jpa.domain.Post;
+import tn.mnlr.vripper.jpa.domain.enums.Status;
+
+import java.util.List;
+import java.util.Optional;
+
+public interface IPostRepository extends IRepository {
+
+  Post save(Post post);
+
+  Optional<Post> findByPostId(String postId);
+
+  Optional<Post> findById(Long id);
+
+  List<String> findCompleted();
+
+  List<Post> findAll();
+
+  boolean existByPostId(String postId);
+
+  int setDownloadingToStopped();
+
+  int deleteByPostId(String postId);
+
+  int updateStatus(Status status, Long id);
+
+  int updateDone(int done, Long id);
+
+  int updateFolderName(String postFolderName, Long id);
+
+  int updateTitle(String title, Long id);
+
+  int updateThanked(boolean thanked, Long id);
+
+  int updateRank(int rank, Long id);
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/repositories/IQueuedRepository.java

@@ -0,0 +1,20 @@
+package tn.mnlr.vripper.jpa.repositories;
+
+import tn.mnlr.vripper.jpa.domain.Queued;
+
+import java.util.List;
+import java.util.Optional;
+
+public interface IQueuedRepository extends IRepository {
+  Queued save(Queued queued);
+
+  Optional<Queued> findByThreadId(String threadId);
+
+  List<Queued> findAll();
+
+  Optional<Queued> findById(Long id);
+
+  int deleteByThreadId(String threadId);
+
+  void deleteAll();
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/repositories/IRepository.java

@@ -0,0 +1,3 @@
+package tn.mnlr.vripper.jpa.repositories;
+
+public interface IRepository {}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/repositories/impl/ImageRepository.java

@@ -0,0 +1,156 @@
+package tn.mnlr.vripper.jpa.repositories.impl;
+
+import org.springframework.beans.factory.annotation.Autowired;
+import org.springframework.jdbc.core.JdbcTemplate;
+import org.springframework.jdbc.core.RowMapper;
+import org.springframework.stereotype.Service;
+import tn.mnlr.vripper.SpringContext;
+import tn.mnlr.vripper.event.Event;
+import tn.mnlr.vripper.event.EventBus;
+import tn.mnlr.vripper.host.Host;
+import tn.mnlr.vripper.jpa.domain.Image;
+import tn.mnlr.vripper.jpa.domain.enums.Status;
+import tn.mnlr.vripper.jpa.repositories.IImageRepository;
+
+import java.sql.ResultSet;
+import java.sql.SQLException;
+import java.util.List;
+import java.util.Optional;
+
+@Service
+public class ImageRepository implements IImageRepository {
+
+  private final JdbcTemplate jdbcTemplate;
+  private final EventBus eventBus;
+
+  @Autowired
+  public ImageRepository(JdbcTemplate jdbcTemplate, EventBus eventBus) {
+    this.jdbcTemplate = jdbcTemplate;
+    this.eventBus = eventBus;
+  }
+
+  private synchronized Long nextId() {
+    return jdbcTemplate.queryForObject("CALL NEXT VALUE FOR SEQ_IMAGE", Long.class);
+  }
+
+  @Override
+  public Image save(Image image) {
+    long id = nextId();
+    jdbcTemplate.update(
+        "INSERT INTO IMAGE (ID, CURRENT, HOST, INDEX, POST_ID, STATUS, TOTAL, URL, POST_ID_REF) VALUES (?,?,?,?,?,?,?,?,?)",
+        id,
+        image.getCurrent(),
+        image.getHost().getHost(),
+        image.getIndex(),
+        image.getPostId(),
+        image.getStatus().name(),
+        image.getTotal(),
+        image.getUrl(),
+        image.getPostIdRef());
+    image.setId(id);
+    eventBus.publishEvent(Event.wrap(Event.Kind.IMAGE_UPDATE, id));
+    return image;
+  }
+
+  @Override
+  public void deleteAllByPostId(String postId) {
+    jdbcTemplate.update("DELETE FROM IMAGE WHERE POST_ID = ?", postId);
+  }
+
+  @Override
+  public List<Image> findByPostId(String postId) {
+    return jdbcTemplate.query(
+        "SELECT * FROM IMAGE WHERE POST_ID = ?", new ImageRowMapper(), postId);
+  }
+
+  @Override
+  public Integer countError() {
+    return jdbcTemplate.queryForObject(
+        "SELECT COUNT(*) FROM IMAGE AS image WHERE image.STATUS = 'ERROR'", Integer.class);
+  }
+
+  @Override
+  public List<Image> findByPostIdAndIsNotCompleted(String postId) {
+    return jdbcTemplate.query(
+        "SELECT * FROM IMAGE AS image WHERE image.POST_ID = ? AND image.STATUS <> 'COMPLETE'",
+        new ImageRowMapper(),
+        postId);
+  }
+
+  @Override
+  public int stopByPostIdAndIsNotCompleted(String postId) {
+    return jdbcTemplate.update(
+        "UPDATE IMAGE AS image SET image.STATUS = 'STOPPED' WHERE image.POST_ID = ? AND image.STATUS <> 'COMPLETE'",
+        postId);
+  }
+
+  @Override
+  public List<Image> findByPostIdAndIsError(String postId) {
+    return jdbcTemplate.query(
+        "SELECT * FROM IMAGE AS image WHERE image.POST_ID = ? AND image.STATUS = 'ERROR'",
+        new ImageRowMapper(),
+        postId);
+  }
+
+  @Override
+  public Optional<Image> findById(Long id) {
+    List<Image> images =
+        jdbcTemplate.query(
+            "SELECT * FROM IMAGE AS image WHERE image.ID = ?", new ImageRowMapper(), id);
+    if (images.isEmpty()) {
+      return Optional.empty();
+    } else {
+      return Optional.of(images.get(0));
+    }
+  }
+
+  @Override
+  public int updateStatus(Status status, Long id) {
+    int mutationCount =
+        jdbcTemplate.update(
+            "UPDATE IMAGE AS image SET image.STATUS = ? WHERE image.ID = ?", status.name(), id);
+    eventBus.publishEvent(Event.wrap(Event.Kind.IMAGE_UPDATE, id));
+    return mutationCount;
+  }
+
+  @Override
+  public int updateCurrent(long current, Long id) {
+    int mutationCount =
+        jdbcTemplate.update(
+            "UPDATE IMAGE AS image SET image.CURRENT = ? WHERE image.ID = ?", current, id);
+    eventBus.publishEvent(Event.wrap(Event.Kind.IMAGE_UPDATE, id));
+    return mutationCount;
+  }
+
+  @Override
+  public int updateTotal(long total, Long id) {
+    int mutationCount =
+        jdbcTemplate.update(
+            "UPDATE IMAGE AS image SET image.TOTAL = ? WHERE image.ID = ?", total, id);
+    eventBus.publishEvent(Event.wrap(Event.Kind.IMAGE_UPDATE, id));
+    return mutationCount;
+  }
+}
+
+class ImageRowMapper implements RowMapper<Image> {
+
+  @Override
+  public Image mapRow(ResultSet rs, int rowNum) throws SQLException {
+    Image image = new Image();
+    image.setId(rs.getLong("ID"));
+    String host = rs.getString("HOST");
+    image.setHost(
+        SpringContext.getBeansOfType(Host.class).values().stream()
+            .filter(e -> e.getHost().equals(host))
+            .findAny()
+            .orElse(null));
+    image.setUrl(rs.getString("URL"));
+    image.setIndex(rs.getInt("INDEX"));
+    image.setCurrent(rs.getLong("CURRENT"));
+    image.setTotal(rs.getLong("TOTAL"));
+    image.setStatus(Status.valueOf(rs.getString("STATUS")));
+    image.setPostId(rs.getString("POST_ID"));
+    image.setPostIdRef(rs.getLong("POST_ID_REF"));
+    return image;
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/repositories/impl/LogEventRepository.java

@@ -0,0 +1,125 @@
+package tn.mnlr.vripper.jpa.repositories.impl;
+
+import lombok.extern.slf4j.Slf4j;
+import org.springframework.jdbc.core.JdbcTemplate;
+import org.springframework.jdbc.core.RowMapper;
+import org.springframework.lang.NonNull;
+import org.springframework.stereotype.Service;
+import tn.mnlr.vripper.event.Event;
+import tn.mnlr.vripper.event.EventBus;
+import tn.mnlr.vripper.jpa.domain.LogEvent;
+import tn.mnlr.vripper.jpa.repositories.ILogEventRepository;
+import tn.mnlr.vripper.services.SettingsService;
+
+import java.sql.ResultSet;
+import java.sql.SQLException;
+import java.time.LocalDateTime;
+import java.time.format.DateTimeFormatter;
+import java.util.List;
+import java.util.Optional;
+
+@Service
+@Slf4j
+public class LogEventRepository implements ILogEventRepository {
+
+  private final JdbcTemplate jdbcTemplate;
+  private final SettingsService settingsService;
+  private final EventBus eventBus;
+
+  public LogEventRepository(
+      JdbcTemplate jdbcTemplate, SettingsService settingsService, EventBus eventBus) {
+    this.jdbcTemplate = jdbcTemplate;
+    this.settingsService = settingsService;
+    this.eventBus = eventBus;
+  }
+
+  private synchronized Long nextId() {
+    return jdbcTemplate.queryForObject("CALL NEXT VALUE FOR SEQ_EVENT", Long.class);
+  }
+
+  @Override
+  public synchronized LogEvent save(@NonNull LogEvent logEvent) {
+
+    int maxRecords = settingsService.getSettings().getMaxEventLog() - 1;
+
+    Long count = jdbcTemplate.queryForObject("SELECT COUNT(*) FROM EVENT", Long.class);
+    if (count > maxRecords) {
+      List<Long> idList =
+          jdbcTemplate.queryForList(
+              "SELECT ID FROM EVENT ORDER BY TIME ASC LIMIT ?", Long.class, count - maxRecords);
+      idList.forEach(this::delete);
+    }
+
+    long id = nextId();
+    jdbcTemplate.update(
+        "INSERT INTO EVENT (ID, TYPE, STATUS, TIME, MESSAGE) VALUES (?,?,?,?,?)",
+        id,
+        logEvent.getType().name(),
+        logEvent.getStatus().name(),
+        logEvent.getTime().format(DateTimeFormatter.ISO_LOCAL_DATE_TIME),
+        logEvent.getMessage());
+    logEvent.setId(id);
+    eventBus.publishEvent(Event.wrap(Event.Kind.LOG_EVENT_UPDATE, id));
+    return logEvent;
+  }
+
+  @Override
+  public LogEvent update(@NonNull LogEvent logEvent) {
+    if (logEvent.getId() == null) {
+      log.warn("Cannot update entity with null id");
+      return logEvent;
+    }
+
+    jdbcTemplate.update(
+        "UPDATE EVENT SET TYPE = ?, STATUS = ?, TIME = ?, MESSAGE = ? WHERE ID = ?",
+        logEvent.getType().name(),
+        logEvent.getStatus().name(),
+        logEvent.getTime().format(DateTimeFormatter.ISO_LOCAL_DATE_TIME),
+        logEvent.getMessage(),
+        logEvent.getId());
+    eventBus.publishEvent(Event.wrap(Event.Kind.LOG_EVENT_UPDATE, logEvent.getId()));
+    return logEvent;
+  }
+
+  @Override
+  public Optional<LogEvent> findById(Long id) {
+    List<LogEvent> logEvents =
+        jdbcTemplate.query("SELECT * FROM EVENT WHERE ID = ?", new LogEventRowMapper(), id);
+    if (logEvents.isEmpty()) {
+      return Optional.empty();
+    } else {
+      return Optional.of(logEvents.get(0));
+    }
+  }
+
+  @Override
+  public List<LogEvent> findAll() {
+    return jdbcTemplate.query("SELECT * FROM EVENT", new LogEventRowMapper());
+  }
+
+  @Override
+  public void delete(Long id) {
+    jdbcTemplate.update("DELETE FROM EVENT WHERE ID = ?", id);
+    eventBus.publishEvent(Event.wrap(Event.Kind.LOG_EVENT_REMOVE, id));
+  }
+
+  @Override
+  public void deleteAll() {
+    jdbcTemplate.update("DELETE FROM EVENT");
+  }
+}
+
+class LogEventRowMapper implements RowMapper<LogEvent> {
+
+  @Override
+  public LogEvent mapRow(ResultSet rs, int rowNum) throws SQLException {
+    LogEvent logEvent = new LogEvent();
+    logEvent.setId(rs.getLong("ID"));
+    logEvent.setType(LogEvent.Type.valueOf(rs.getString("TYPE")));
+    logEvent.setStatus(LogEvent.Status.valueOf(rs.getString("STATUS")));
+    logEvent.setTime(
+        LocalDateTime.parse(rs.getString("TIME"), DateTimeFormatter.ISO_LOCAL_DATE_TIME));
+    logEvent.setMessage(rs.getString("MESSAGE"));
+    return logEvent;
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/repositories/impl/MetadataRepository.java

@@ -0,0 +1,76 @@
+package tn.mnlr.vripper.jpa.repositories.impl;
+
+import org.springframework.beans.factory.annotation.Autowired;
+import org.springframework.jdbc.core.JdbcTemplate;
+import org.springframework.jdbc.core.RowMapper;
+import org.springframework.stereotype.Service;
+import tn.mnlr.vripper.event.Event;
+import tn.mnlr.vripper.event.EventBus;
+import tn.mnlr.vripper.jpa.domain.Metadata;
+import tn.mnlr.vripper.jpa.repositories.IMetadataRepository;
+
+import java.sql.ResultSet;
+import java.sql.SQLException;
+import java.util.List;
+import java.util.Optional;
+
+@Service
+public class MetadataRepository implements IMetadataRepository {
+
+  private final JdbcTemplate jdbcTemplate;
+  private final EventBus eventBus;
+
+  @Autowired
+  public MetadataRepository(JdbcTemplate jdbcTemplate, EventBus eventBus) {
+    this.jdbcTemplate = jdbcTemplate;
+    this.eventBus = eventBus;
+  }
+
+  @Override
+  public Metadata save(Metadata metadata) {
+    jdbcTemplate.update(
+        "INSERT INTO METADATA (POST_ID_REF, POST_ID, POSTED_BY, RESOLVED_NAMES) VALUES (?,?,?,?)",
+        metadata.getPostIdRef(),
+        metadata.getPostId(),
+        metadata.getPostedBy(),
+        String.join("%sep%", metadata.getResolvedNames()));
+    eventBus.publishEvent(Event.wrap(Event.Kind.METADATA_UPDATE, metadata.getPostIdRef()));
+    return metadata;
+  }
+
+  @Override
+  public Optional<Metadata> findByPostId(String postId) {
+    List<Metadata> metadata =
+        jdbcTemplate.query(
+            "SELECT metadata.* FROM METADATA AS metadata WHERE metadata.POST_ID = ?",
+            new MetadataRowMapper(),
+            postId);
+    if (metadata.isEmpty()) {
+      return Optional.empty();
+    } else {
+      return Optional.of(metadata.get(0));
+    }
+  }
+
+  @Override
+  public int deleteByPostId(String postId) {
+    return jdbcTemplate.update(
+        "DELETE FROM METADATA AS metadata WHERE metadata.POST_ID = ?", postId);
+  }
+}
+
+class MetadataRowMapper implements RowMapper<Metadata> {
+
+  @Override
+  public Metadata mapRow(ResultSet rs, int rowNum) throws SQLException {
+    Metadata metadata = new Metadata();
+    metadata.setPostIdRef(rs.getLong("POST_ID_REF"));
+    metadata.setPostId(rs.getString("POST_ID"));
+    metadata.setPostedBy(rs.getString("POSTED_BY"));
+    String resolvedNames = rs.getString("RESOLVED_NAMES");
+    if (resolvedNames != null && !resolvedNames.isBlank()) {
+      metadata.setResolvedNames(List.of(resolvedNames.split("%sep%")));
+    }
+    return metadata;
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/repositories/impl/PostRepository.java

@@ -0,0 +1,230 @@
+package tn.mnlr.vripper.jpa.repositories.impl;
+
+import org.springframework.beans.factory.annotation.Autowired;
+import org.springframework.jdbc.core.JdbcTemplate;
+import org.springframework.jdbc.core.RowMapper;
+import org.springframework.stereotype.Service;
+import tn.mnlr.vripper.event.Event;
+import tn.mnlr.vripper.event.EventBus;
+import tn.mnlr.vripper.jpa.domain.Metadata;
+import tn.mnlr.vripper.jpa.domain.Post;
+import tn.mnlr.vripper.jpa.domain.enums.Status;
+import tn.mnlr.vripper.jpa.repositories.IPostRepository;
+
+import java.sql.ResultSet;
+import java.sql.SQLException;
+import java.sql.Timestamp;
+import java.util.List;
+import java.util.Optional;
+import java.util.Set;
+
+@Service
+public class PostRepository implements IPostRepository {
+
+  private final JdbcTemplate jdbcTemplate;
+  private final EventBus eventBus;
+
+  @Autowired
+  public PostRepository(JdbcTemplate jdbcTemplate, EventBus eventBus) {
+    this.jdbcTemplate = jdbcTemplate;
+    this.eventBus = eventBus;
+  }
+
+  private synchronized Long nextId() {
+    return jdbcTemplate.queryForObject("CALL NEXT VALUE FOR SEQ_POST", Long.class);
+  }
+
+  @Override
+  public Post save(Post post) {
+    long id = nextId();
+    jdbcTemplate.update(
+        "INSERT INTO POST (ID, DONE, FORUM, HOSTS, POST_FOLDER_NAME, POST_ID, PREVIEWS, SECURITY_TOKEN, STATUS, THANKED, THREAD_ID, THREAD_TITLE, TITLE, TOTAL, URL, ADDED_ON, RANK) VALUES (?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?)",
+        id,
+        post.getDone(),
+        post.getForum(),
+        String.join(";", post.getHosts()),
+        post.getDownloadDirectory(),
+        post.getPostId(),
+        String.join(";", post.getPreviews()),
+        post.getSecurityToken(),
+        post.getStatus().name(),
+        post.isThanked(),
+        post.getThreadId(),
+        post.getThreadTitle(),
+        post.getTitle(),
+        post.getTotal(),
+        post.getUrl(),
+        Timestamp.valueOf(post.getAddedOn()),
+        post.getRank());
+    post.setId(id);
+    eventBus.publishEvent(Event.wrap(Event.Kind.POST_UPDATE, id));
+    return post;
+  }
+
+  @Override
+  public Optional<Post> findByPostId(String postId) {
+    List<Post> posts =
+        jdbcTemplate.query(
+            "SELECT metadata.*,post.* FROM METADATA metadata FULL JOIN POST post ON metadata.POST_ID_REF = post.ID WHERE post.POST_ID = ?",
+            new PostRowMapper(),
+            postId);
+    if (posts.isEmpty()) {
+      return Optional.empty();
+    } else {
+      return Optional.of(posts.get(0));
+    }
+  }
+
+  @Override
+  public List<String> findCompleted() {
+    return jdbcTemplate.query(
+        "SELECT POST_ID FROM POST AS post WHERE status = 'COMPLETE' AND done >= total",
+        ((rs, rowNum) -> rs.getString("POST_ID")));
+  }
+
+  @Override
+  public Optional<Post> findById(Long id) {
+    List<Post> posts =
+        jdbcTemplate.query(
+            "SELECT metadata.*,post.* FROM METADATA metadata FULL JOIN POST post ON metadata.POST_ID_REF = post.ID WHERE post.ID = ?",
+            new PostRowMapper(),
+            id);
+    if (posts.isEmpty()) {
+      return Optional.empty();
+    } else {
+      return Optional.of(posts.get(0));
+    }
+  }
+
+  @Override
+  public List<Post> findAll() {
+    return jdbcTemplate.query(
+        "SELECT metadata.*,post.* FROM METADATA metadata FULL JOIN POST post ON metadata.POST_ID_REF = post.ID",
+        new PostRowMapper());
+  }
+
+  @Override
+  public boolean existByPostId(String postId) {
+    Integer count =
+        jdbcTemplate.queryForObject(
+            "SELECT COUNT(*) FROM POST AS post WHERE post.POST_ID = ?", Integer.class, postId);
+    if (count == null) {
+      return false;
+    } else {
+      return count > 0;
+    }
+  }
+
+  @Override
+  public int setDownloadingToStopped() {
+    return jdbcTemplate.update(
+        "UPDATE POST AS post SET post.STATUS = 'STOPPED' WHERE post.STATUS = 'DOWNLOADING' OR post.STATUS = 'PARTIAL' OR post.STATUS = 'PENDING'");
+  }
+
+  @Override
+  public int deleteByPostId(String postId) {
+    int mutationCount =
+        jdbcTemplate.update("DELETE FROM POST AS post WHERE post.POST_ID = ?", postId);
+    eventBus.publishEvent(Event.wrap(Event.Kind.POST_REMOVE, postId));
+    return mutationCount;
+  }
+
+  @Override
+  public int updateStatus(Status status, Long id) {
+    int mutationCount =
+        jdbcTemplate.update(
+            "UPDATE POST AS post SET post.STATUS = ? WHERE post.ID = ?", status.name(), id);
+    eventBus.publishEvent(Event.wrap(Event.Kind.POST_UPDATE, id));
+    return mutationCount;
+  }
+
+  @Override
+  public int updateDone(int done, Long id) {
+    int mutationCount =
+        jdbcTemplate.update("UPDATE POST AS post SET post.DONE = ? WHERE post.ID = ?", done, id);
+    eventBus.publishEvent(Event.wrap(Event.Kind.POST_UPDATE, id));
+    return mutationCount;
+  }
+
+  @Override
+  public int updateFolderName(String postFolderName, Long id) {
+    int mutationCount =
+        jdbcTemplate.update(
+            "UPDATE POST AS post SET post.POST_FOLDER_NAME = ? WHERE post.ID = ?",
+            postFolderName,
+            id);
+    eventBus.publishEvent(Event.wrap(Event.Kind.POST_UPDATE, id));
+    return mutationCount;
+  }
+
+  @Override
+  public int updateTitle(String title, Long id) {
+    int mutationCount =
+        jdbcTemplate.update("UPDATE POST AS post SET post.TITLE = ? WHERE post.ID = ?", title, id);
+    eventBus.publishEvent(Event.wrap(Event.Kind.POST_UPDATE, id));
+    return mutationCount;
+  }
+
+  @Override
+  public int updateThanked(boolean thanked, Long id) {
+    int mutationCount =
+        jdbcTemplate.update(
+            "UPDATE POST AS post SET post.THANKED = ? WHERE post.ID = ?", thanked, id);
+    eventBus.publishEvent(Event.wrap(Event.Kind.POST_UPDATE, id));
+    return mutationCount;
+  }
+
+  @Override
+  public int updateRank(int rank, Long id) {
+    int mutationCount =
+        jdbcTemplate.update("UPDATE POST AS post SET post.RANK = ? WHERE post.ID = ?", rank, id);
+    eventBus.publishEvent(Event.wrap(Event.Kind.POST_UPDATE, id));
+    return mutationCount;
+  }
+}
+
+class PostRowMapper implements RowMapper<Post> {
+
+  private static final String DELIMITER = ";";
+
+  @Override
+  public Post mapRow(ResultSet rs, int rowNum) throws SQLException {
+
+    Post post = new Post();
+    post.setId(rs.getLong("post.ID"));
+    post.setStatus(Status.valueOf(rs.getString("post.STATUS")));
+    post.setPostId(rs.getString("post.POST_ID"));
+    post.setThreadTitle(rs.getString("post.THREAD_TITLE"));
+    post.setThreadId(rs.getString("post.THREAD_ID"));
+    post.setTitle(rs.getString("post.TITLE"));
+    post.setUrl(rs.getString("post.URL"));
+    post.setDone(rs.getInt("post.DONE"));
+    post.setTotal(rs.getInt("post.TOTAL"));
+    post.setHosts(Set.of(rs.getString("post.HOSTS").split(DELIMITER)));
+    post.setForum(rs.getString("post.FORUM"));
+    post.setSecurityToken(rs.getString("post.SECURITY_TOKEN"));
+    post.setDownloadDirectory(rs.getString("post.POST_FOLDER_NAME"));
+    post.setThanked(rs.getBoolean("post.THANKED"));
+    String previews;
+    if ((previews = rs.getString("post.PREVIEWS")) != null) {
+      post.setPreviews(Set.of(previews.split(DELIMITER)));
+    }
+    post.setAddedOn(rs.getTimestamp("post.ADDED_ON").toLocalDateTime());
+    post.setRank(rs.getInt("post.RANK"));
+
+    Long metadataId = rs.getLong("metadata.POST_ID_REF");
+    if (!rs.wasNull()) {
+      Metadata metadata = new Metadata();
+      metadata.setPostIdRef(metadataId);
+      metadata.setPostId(rs.getString("metadata.POST_ID"));
+      String resolvedNames = rs.getString("metadata.RESOLVED_NAMES");
+      if (resolvedNames != null && !resolvedNames.isBlank()) {
+        metadata.setResolvedNames(List.of(resolvedNames.split("%sep%")));
+      }
+      metadata.setPostedBy(rs.getString("metadata.POSTED_BY"));
+      post.setMetadata(metadata);
+    }
+
+    return post;
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/jpa/repositories/impl/QueuedRepository.java

@@ -0,0 +1,107 @@
+package tn.mnlr.vripper.jpa.repositories.impl;
+
+import org.springframework.beans.factory.annotation.Autowired;
+import org.springframework.jdbc.core.JdbcTemplate;
+import org.springframework.jdbc.core.RowMapper;
+import org.springframework.stereotype.Service;
+import tn.mnlr.vripper.event.Event;
+import tn.mnlr.vripper.event.EventBus;
+import tn.mnlr.vripper.jpa.domain.Queued;
+import tn.mnlr.vripper.jpa.repositories.IQueuedRepository;
+
+import java.sql.ResultSet;
+import java.sql.SQLException;
+import java.util.List;
+import java.util.Optional;
+
+@Service
+public class QueuedRepository implements IQueuedRepository {
+
+  private final JdbcTemplate jdbcTemplate;
+  private final EventBus eventBus;
+
+  @Autowired
+  public QueuedRepository(JdbcTemplate jdbcTemplate, EventBus eventBus) {
+    this.jdbcTemplate = jdbcTemplate;
+    this.eventBus = eventBus;
+  }
+
+  private synchronized Long nextId() {
+    return jdbcTemplate.queryForObject("CALL NEXT VALUE FOR SEQ_QUEUED", Long.class);
+  }
+
+  @Override
+  public Queued save(Queued queued) {
+    long id = nextId();
+    jdbcTemplate.update(
+        "INSERT INTO QUEUED (ID, TOTAL, LINK, LOADING, POST_ID, THREAD_ID) values (?,?,?,?,?,?)",
+        id,
+        queued.getTotal(),
+        queued.getLink(),
+        queued.isLoading(),
+        queued.getPostId(),
+        queued.getThreadId());
+    queued.setId(id);
+    eventBus.publishEvent(Event.wrap(Event.Kind.QUEUED_UPDATE, id));
+    return queued;
+  }
+
+  @Override
+  public Optional<Queued> findByThreadId(String threadId) {
+    List<Queued> queuedList =
+        jdbcTemplate.query(
+            "SELECT * FROM QUEUED AS queued WHERE queued.THREAD_ID = ?",
+            new QueuedRowMapper(),
+            threadId);
+    if (queuedList.isEmpty()) {
+      return Optional.empty();
+    } else {
+      return Optional.of(queuedList.get(0));
+    }
+  }
+
+  @Override
+  public List<Queued> findAll() {
+    return jdbcTemplate.query("SELECT * FROM QUEUED", new QueuedRowMapper());
+  }
+
+  @Override
+  public Optional<Queued> findById(Long id) {
+    List<Queued> queuedList =
+        jdbcTemplate.query(
+            "SELECT * FROM QUEUED AS queued WHERE queued.ID = ?", new QueuedRowMapper(), id);
+    if (queuedList.isEmpty()) {
+      return Optional.empty();
+    } else {
+      return Optional.of(queuedList.get(0));
+    }
+  }
+
+  @Override
+  public int deleteByThreadId(String threadId) {
+    int mutationCount =
+        jdbcTemplate.update("DELETE FROM QUEUED AS queued WHERE THREAD_ID = ?", threadId);
+    eventBus.publishEvent(Event.wrap(Event.Kind.QUEUED_REMOVE, threadId));
+    return mutationCount;
+  }
+
+  @Override
+  public void deleteAll() {
+    jdbcTemplate.update("DELETE FROM QUEUED");
+  }
+}
+
+class QueuedRowMapper implements RowMapper<Queued> {
+
+  @Override
+  public Queued mapRow(ResultSet rs, int rowNum) throws SQLException {
+    Queued queued = new Queued();
+    queued.setId(rs.getLong("ID"));
+    queued.setLink(rs.getString("LINK"));
+    queued.setThreadId(rs.getString("THREAD_ID"));
+    queued.setPostId(rs.getString("POST_ID"));
+    queued.setTotal(rs.getInt("TOTAL"));
+    queued.setLoading(rs.getBoolean("LOADING"));
+    return queued;
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/q/DownloadJob.java

@@ -1,51 +0,0 @@
-package tn.mnlr.vripper.q;
-
-import lombok.Getter;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
-import tn.mnlr.vripper.entities.Image;
-import tn.mnlr.vripper.entities.Post;
-
-import java.util.Objects;
-import java.util.concurrent.Callable;
-
-public class DownloadJob implements Callable<Image> {
-
-    private static final Logger logger = LoggerFactory.getLogger(DownloadJob.class);
-
-    @Getter
-    private final Image image;
-    private final Post post;
-
-    @Getter
-    private final ImageFileData imageFileData = new ImageFileData();
-
-    DownloadJob(Post post, Image image) {
-        this.image = image;
-        this.post = post;
-    }
-
-    @Override
-    public Image call() throws Exception {
-
-        logger.debug(String.format("Starting downloading %s", image.getUrl()));
-        image.setStatus(Image.Status.DOWNLOADING);
-        image.setCurrent(0);
-        image.getHost().download(post, image, imageFileData);
-        image.setStatus(Image.Status.COMPLETE);
-        return image;
-    }
-
-    @Override
-    public boolean equals(Object o) {
-        if (this == o) return true;
-        if (o == null || getClass() != o.getClass()) return false;
-        DownloadJob that = (DownloadJob) o;
-        return image.equals(that.image);
-    }
-
-    @Override
-    public int hashCode() {
-        return Objects.hash(image);
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/q/DownloadQ.java

@@ -1,87 +0,0 @@
-package tn.mnlr.vripper.q;
-
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
-import org.springframework.beans.factory.annotation.Autowired;
-import org.springframework.stereotype.Service;
-import tn.mnlr.vripper.entities.Image;
-import tn.mnlr.vripper.entities.Post;
-import tn.mnlr.vripper.host.Host;
-import tn.mnlr.vripper.services.AppSettingsService;
-import tn.mnlr.vripper.services.AppStateService;
-
-import javax.annotation.PostConstruct;
-import java.util.ArrayList;
-import java.util.Iterator;
-import java.util.List;
-import java.util.Map;
-import java.util.concurrent.BlockingDeque;
-import java.util.concurrent.ConcurrentHashMap;
-import java.util.concurrent.LinkedBlockingDeque;
-
-@Service
-public class DownloadQ {
-
-    private static final Logger logger = LoggerFactory.getLogger(DownloadQ.class);
-
-    private final AppStateService appStateService;
-    private final AppSettingsService appSettingsService;
-    private final List<Host> hosts;
-
-    private final ConcurrentHashMap<Host, BlockingDeque<DownloadJob>> downloadQ = new ConcurrentHashMap<>();
-
-    @Autowired
-    public DownloadQ(AppStateService appStateService, AppSettingsService appSettingsService, List<Host> hosts) {
-        this.appStateService = appStateService;
-        this.appSettingsService = appSettingsService;
-        this.hosts = hosts;
-    }
-
-    @PostConstruct
-    private void init() {
-        hosts.forEach(host -> downloadQ.put(host, new LinkedBlockingDeque<>()));
-    }
-
-    public void put(Post post, Image image) throws InterruptedException {
-        logger.debug(String.format("Enqueuing a job for %s", image.getUrl()));
-        image.init();
-        DownloadJob downloadJob = new DownloadJob(post, image);
-        downloadQ.get(downloadJob.getImage().getHost()).putLast(downloadJob);
-        appStateService.newDownloadJob(downloadJob);
-    }
-
-    public void remove(final DownloadJob downloadJob) {
-        downloadQ.get(downloadJob.getImage().getHost()).remove(downloadJob);
-    }
-
-    public List<DownloadJob> peek() {
-        List<DownloadJob> downloadJobs = new ArrayList<>();
-        if (hosts.size() == 0) {
-            return downloadJobs;
-        }
-        for (Host host : hosts) {
-            Iterator<DownloadJob> it = downloadQ.get(host).iterator();
-            for (int i = 0; i < appSettingsService.getSettings().getMaxThreads(); i++) {
-                DownloadJob downloadJob = it.hasNext() ? it.next() : null;
-                if (downloadJob != null) {
-                    downloadJobs.add(downloadJob);
-                }
-            }
-        }
-        return downloadJobs;
-    }
-
-    public void enqueue(Post post) throws InterruptedException {
-        for (Image image : post.getImages()) {
-            put(post, image);
-        }
-    }
-
-    public int size() {
-        return downloadQ.values().stream().mapToInt(BlockingDeque::size).sum();
-    }
-
-    public Iterable<? extends Map.Entry<Host, BlockingDeque<DownloadJob>>> entries() {
-        return downloadQ.entrySet();
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/q/ExecutionService.java

@@ -1,290 +0,0 @@
-package tn.mnlr.vripper.q;
-
-import lombok.NonNull;
-import net.jodah.failsafe.Failsafe;
-import net.jodah.failsafe.FailsafeException;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
-import org.springframework.beans.factory.annotation.Autowired;
-import org.springframework.stereotype.Service;
-import tn.mnlr.vripper.VripperApplication;
-import tn.mnlr.vripper.entities.Image;
-import tn.mnlr.vripper.entities.Post;
-import tn.mnlr.vripper.host.Host;
-import tn.mnlr.vripper.services.*;
-
-import javax.annotation.PostConstruct;
-import javax.annotation.PreDestroy;
-import java.util.*;
-import java.util.concurrent.*;
-import java.util.concurrent.atomic.AtomicInteger;
-import java.util.stream.Collectors;
-
-@Service
-public class ExecutionService {
-
-    private static final Logger logger = LoggerFactory.getLogger(ExecutionService.class);
-    private static final List<Post.Status> FINISHED = Arrays.asList(Post.Status.ERROR, Post.Status.COMPLETE, Post.Status.STOPPED);
-
-    private final DownloadQ downloadQ;
-    private final AppSettingsService settings;
-    private final AppStateService appStateService;
-    private final AppStateExchange appStateExchange;
-    private final ThumbnailGenerator thumbnailGenerator;
-    private final AppSettingsService appSettingsService;
-    private final CommonExecutor commonExecutor;
-
-    private final int MAX_POOL_SIZE = 12;
-
-    private final ConcurrentHashMap<Host, AtomicInteger> threadCount = new ConcurrentHashMap<>();
-
-    private boolean notPauseQ = true;
-    private ExecutorService executor = Executors.newFixedThreadPool(MAX_POOL_SIZE);
-
-    private Thread executionThread;
-
-    private BlockingQueue<DownloadJob> queue = new LinkedBlockingQueue<>();
-
-    private List<DownloadJob> running = Collections.synchronizedList(new ArrayList<>());
-
-    private Map<String, Future<?>> futures = new ConcurrentHashMap<>();
-    private Thread pollThread;
-
-    @Autowired
-    public ExecutionService(DownloadQ downloadQ, AppSettingsService settings, AppStateService appStateService, AppStateExchange appStateExchange, ThumbnailGenerator thumbnailGenerator, AppSettingsService appSettingsService, CommonExecutor commonExecutor) {
-        this.downloadQ = downloadQ;
-        this.settings = settings;
-        this.appStateService = appStateService;
-        this.appStateExchange = appStateExchange;
-        this.thumbnailGenerator = thumbnailGenerator;
-        this.appSettingsService = appSettingsService;
-        this.commonExecutor = commonExecutor;
-    }
-
-    @PostConstruct
-    private void init() {
-        executionThread = new Thread(this::start, "Executor thread");
-        pollThread = new Thread(this::poll, "Polling thread");
-        pollThread.start();
-        executionThread.start();
-    }
-
-    @PreDestroy
-    private void destroy() throws InterruptedException {
-        logger.info("Shutting down ExecutionService");
-        executionThread.interrupt();
-        pollThread.interrupt();
-        executor.shutdown();
-        appStateExchange.getPosts().keySet().forEach(p -> {
-            logger.debug(String.format("Stopping download jobs for %s", p));
-            this.stopRunning(p);
-        });
-        executor.awaitTermination(10, TimeUnit.SECONDS);
-    }
-
-    private void stopRunning(@NonNull String postId) {
-        List<DownloadJob> data = running
-                .stream()
-                .filter(e -> e.getImage().getPostId().equals(postId))
-                .peek(e -> e.getImage().setStatus(Image.Status.STOPPED))
-                .collect(Collectors.toList());
-        logger.debug(String.format("Interrupting %d jobs for post id %s", data.size(), postId));
-
-        data.forEach(e -> {
-            futures.get(e.getImage().getUrl()).cancel(true);
-            if (e.getImageFileData().getImageRequest() != null) {
-                e.getImageFileData().getImageRequest().abort();
-            }
-            e.getImage().cleanup();
-        });
-    }
-
-
-    public synchronized void stopAll(List<String> posIds) {
-        if (posIds != null) {
-            posIds.forEach(this::stop);
-        } else {
-            appStateExchange.getPosts().values().forEach(p -> this.stop(p.getPostId()));
-        }
-    }
-
-    public synchronized void restartAll(List<String> posIds) {
-        if (posIds != null) {
-            posIds.forEach(this::restart);
-        } else {
-            appStateExchange.getPosts().values().forEach(p -> this.restart(p.getPostId()));
-        }
-    }
-
-    private void restart(@NonNull String postId) {
-        if (appStateService.isRunning(postId)) {
-            logger.warn(String.format("Cannot restart, jobs are currently running for post id %s", postId));
-            return;
-        }
-        Post post = appStateExchange.getPost(postId);
-        List<Image> images = post
-                .getImages()
-                .stream()
-                .filter(e -> !e.getStatus().equals(Image.Status.COMPLETE))
-                .collect(Collectors.toList());
-        if (images.isEmpty()) {
-            return;
-        }
-
-        post.setStatus(Post.Status.PENDING);
-        logger.debug(String.format("Restarting %d jobs for post id %s", images.size(), postId));
-        for (Image image : images) {
-            try {
-                downloadQ.put(post, image);
-            } catch (InterruptedException e) {
-                logger.warn("Thread was interrupted", e);
-                Thread.currentThread().interrupt();
-            }
-        }
-    }
-
-    private void removeScheduled(Image image) {
-        image.setStatus(Image.Status.STOPPED);
-        logger.debug(String.format("Removing scheduled job for %s", image.getUrl()));
-
-        boolean removed = false;
-        main:
-        for (Map.Entry<Host, BlockingDeque<DownloadJob>> entry : downloadQ.entries()) {
-            Iterator<DownloadJob> iterator = entry.getValue().iterator();
-            while (iterator.hasNext()) {
-                DownloadJob next = iterator.next();
-                if (next.getImage().getPostId().equals(image.getPostId())) {
-                    iterator.remove();
-                    appStateService.doneDownloadJob(image);
-                    logger.debug(String.format("Scheduled job for %s is removed", image.getUrl()));
-                    removed = true;
-                    break main;
-                }
-            }
-        }
-
-        if (!removed) {
-            logger.debug(String.format("Job for %s does not exist", image.getUrl()));
-        }
-
-        image.cleanup();
-    }
-
-    private void removeRunning(String postId) {
-        logger.debug(String.format("Interrupting running jobs for post id %s", postId));
-        stopRunning(postId);
-    }
-
-    private void stop(String postId) {
-        try {
-            final Post post = appStateExchange.getPost(postId);
-            if (post == null) {
-                return;
-            }
-            if (FINISHED.contains(post.getStatus())) {
-                return;
-            }
-            notPauseQ = false;
-            post.setStatus(Post.Status.STOPPED);
-            List<Image> images = post
-                    .getImages()
-                    .stream()
-                    .filter(e -> !e.getStatus().equals(Image.Status.COMPLETE))
-                    .collect(Collectors.toList());
-            if (images.isEmpty()) {
-                return;
-            }
-            logger.debug(String.format("Stopping %d jobs for post id %s", images.size(), postId));
-            images.forEach(this::removeScheduled);
-            removeRunning(postId);
-        } finally {
-            notPauseQ = true;
-        }
-    }
-
-    private boolean canRun(Host host) {
-        boolean canRun;
-        AtomicInteger count = threadCount.get(host);
-        if (count == null) {
-            threadCount.put(host, new AtomicInteger(0));
-        }
-        canRun = threadCount.get(host).get() < settings.getSettings().getMaxThreads() && (settings.getSettings().getMaxTotalThreads() == 0 ? threadCount.values().stream().mapToInt(AtomicInteger::get).sum() < MAX_POOL_SIZE : threadCount.values().stream().mapToInt(AtomicInteger::get).sum() < settings.getSettings().getMaxTotalThreads());
-        if (canRun && notPauseQ) {
-            threadCount.get(host).incrementAndGet();
-            return true;
-        }
-        return false;
-    }
-
-    private void poll() {
-        while (!Thread.interrupted()) {
-            try {
-                List<DownloadJob> peek = downloadQ.peek();
-                for (DownloadJob downloadJob : peek) {
-                    if (canRun(downloadJob.getImage().getHost())) {
-                        queue.offer(downloadJob);
-                        downloadQ.remove(downloadJob);
-                    }
-                }
-                synchronized (threadCount) {
-                    threadCount.wait(2_000);
-                }
-            } catch (InterruptedException e) {
-                Thread.currentThread().interrupt();
-                break;
-            }
-        }
-    }
-
-    private void start() {
-        while (!Thread.interrupted()) {
-            try {
-                push(queue.take());
-            } catch (InterruptedException e) {
-                Thread.currentThread().interrupt();
-                break;
-            } catch (Exception e) {
-                logger.error("Execution Service failed", e);
-                break;
-            }
-        }
-    }
-
-    private void push(DownloadJob take) {
-        Runnable task = () -> {
-            running.add(take);
-
-            Failsafe.with(VripperApplication.retryPolicy)
-                    .onFailure(e -> {
-                        if (e.getFailure() instanceof InterruptedException || (e.getFailure() instanceof FailsafeException && e.getFailure().getCause() instanceof InterruptedException)) {
-                            logger.debug("Job successfully interrupted");
-                            return;
-                        }
-                        logger.error(String.format("Failed to download %s after %d tries", take.getImage().getUrl(), e.getAttemptCount()), e.getFailure());
-                        take.getImage().setStatus(Image.Status.ERROR);
-                    })
-                    .onComplete(e -> {
-                        appStateService.doneDownloadJob(take.getImage());
-                        logger.debug(String.format("Finished downloading %s", take.getImage().getUrl()));
-                        if (appSettingsService.getSettings().getViewPhotos()) {
-                            commonExecutor.getGeneralExecutor().submit(
-                                    () -> thumbnailGenerator.getThumbnails()
-                                            .get(new ThumbnailGenerator.CacheKey(take.getImage().getPostId(), take.getImageFileData().getFileName())));
-                        }
-                        threadCount.get(take.getImage().getHost()).decrementAndGet();
-                        running.remove(take);
-                        futures.remove(take.getImage().getUrl());
-                        synchronized (threadCount) {
-                            threadCount.notify();
-                        }
-                    })
-                    .get(take::call);
-        };
-        logger.debug(String.format("Scheduling a job for %s", take.getImage().getUrl()));
-        futures.put(take.getImage().getUrl(), executor.submit(task));
-    }
-
-    public int runningCount() {
-        return running.size();
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/q/ImageFileData.java

@@ -1,16 +0,0 @@
-package tn.mnlr.vripper.q;
-
-import lombok.Getter;
-import lombok.Setter;
-import org.apache.http.client.methods.HttpUriRequest;
-
-@Getter
-@Setter
-public class ImageFileData {
-
-    private String pageUrl;
-    private String imageName;
-    private String fileName;
-    private String imageUrl;
-    private HttpUriRequest imageRequest;
-}

vripper-server/src/main/java/tn/mnlr/vripper/services/AppSettingsService.java

@@ -1,254 +0,0 @@
-package tn.mnlr.vripper.services;
-
-import com.fasterxml.jackson.annotation.JsonInclude;
-import com.fasterxml.jackson.annotation.JsonProperty;
-import com.fasterxml.jackson.databind.DeserializationFeature;
-import com.fasterxml.jackson.databind.ObjectMapper;
-import lombok.Getter;
-import lombok.NoArgsConstructor;
-import lombok.Setter;
-import org.apache.commons.codec.digest.DigestUtils;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
-import org.springframework.beans.factory.annotation.Value;
-import org.springframework.stereotype.Service;
-import tn.mnlr.vripper.SpringContext;
-import tn.mnlr.vripper.exception.ValidationException;
-
-import javax.annotation.PostConstruct;
-import javax.annotation.PreDestroy;
-import java.io.IOException;
-import java.nio.file.Files;
-import java.nio.file.InvalidPathException;
-import java.nio.file.Path;
-import java.nio.file.Paths;
-
-import static java.nio.file.StandardOpenOption.*;
-
-@Service
-@Getter
-@Setter
-public class AppSettingsService {
-
-    private final String MAX_TOTAL_THREADS = "MAX_TOTAL_THREADS";
-    private final String baseDir;
-
-    private final Path configPath;
-    private final Logger logger = LoggerFactory.getLogger(AppSettingsService.class);
-    private final ObjectMapper om = new ObjectMapper();
-
-    private Settings settings = new Settings();
-
-    public AppSettingsService(@Value("${base.dir}") String baseDir) {
-        this.baseDir = baseDir;
-        this.configPath = Paths.get(baseDir, ".vripper", "config.json");
-        om.configure(DeserializationFeature.FAIL_ON_UNKNOWN_PROPERTIES, false);
-    }
-
-    @PostConstruct
-    private void init() {
-        restore();
-    }
-
-    public void newSettings(Settings settings) {
-
-        if (settings.getVLogin()) {
-            if (!this.settings.getVPassword().equals(settings.getVPassword())) {
-                settings.setVPassword(settings.getVPassword());
-            }
-        } else {
-            settings.setVUsername("");
-            settings.setVPassword("");
-            settings.setVThanks(false);
-        }
-        this.settings = settings;
-
-        save();
-    }
-
-    public void restore() {
-        try {
-            settings = om.readValue(configPath.toFile(), Settings.class);
-            try {
-                check(this.settings);
-            } catch (ValidationException e) {
-                logger.error(String.format("Your settings are invalid, either remove %s, or fix it", configPath.toString()), e);
-                SpringContext.close();
-            }
-        } catch (IOException e) {
-            logger.error("Failed restore user settings", e);
-            settings = new Settings();
-        }
-
-        if (settings.getDownloadPath() == null) {
-            settings.setDownloadPath(baseDir);
-        }
-
-        if (settings.getMaxThreads() == null) {
-            settings.setMaxThreads(4);
-        }
-
-        if (settings.getMaxTotalThreads() == null) {
-            settings.setMaxTotalThreads(0);
-        }
-
-        if (settings.getAutoStart() == null) {
-            settings.setAutoStart(true);
-        }
-
-        if (settings.getVLogin() == null) {
-            settings.setVLogin(false);
-        }
-
-        if (settings.getVUsername() == null) {
-            settings.setVUsername("");
-        }
-
-        if (settings.getVPassword() == null) {
-            settings.setVPassword("");
-        }
-
-        if (settings.getVThanks() == null) {
-            settings.setVThanks(false);
-        }
-
-        if (settings.getDesktopClipboard() == null) {
-            settings.setDesktopClipboard(false);
-        }
-
-        if (settings.getForceOrder() == null) {
-            settings.setForceOrder(false);
-        }
-
-        if (settings.getSubLocation() == null) {
-            settings.setSubLocation(false);
-        }
-
-        if (settings.getThreadSubLocation() == null) {
-            settings.setThreadSubLocation(false);
-        }
-
-        if (settings.getClearCompleted() == null) {
-            settings.setClearCompleted(false);
-        }
-
-        if (settings.getDarkTheme() == null) {
-            settings.setDarkTheme(false);
-        }
-
-        if (settings.getViewPhotos() == null) {
-            settings.setViewPhotos(false);
-        }
-
-        if (settings.getNotification() == null) {
-            settings.setNotification(false);
-        }
-
-
-        save();
-    }
-
-    @PreDestroy
-    public void save() {
-        try {
-            // force disable gallery
-            settings.setViewPhotos(false);
-
-            Files.write(configPath, om.writeValueAsBytes(settings), CREATE, WRITE, TRUNCATE_EXISTING, SYNC);
-        } catch (IOException e) {
-            logger.error("Failed to store user settings", e);
-        }
-    }
-
-    public void check(Settings settings) throws ValidationException {
-
-        Path path;
-        try {
-            path = Paths.get(settings.getDownloadPath());
-        } catch (InvalidPathException e) {
-            throw new ValidationException(String.format("%s is invalid", settings.getDownloadPath()));
-        }
-        if (!Files.exists(path)) {
-            throw new ValidationException(String.format("%s does not exist", settings.getDownloadPath()));
-        } else if (!Files.isDirectory(path)) {
-            throw new ValidationException(String.format("%s is not a directory", settings.getDownloadPath()));
-        }
-
-        if (settings.getMaxTotalThreads() < 0 || settings.getMaxTotalThreads() > 12) {
-            throw new ValidationException(String.format("Invalid max global concurrent download settings, values must be in [%d,%d]", 0, 12));
-        }
-
-        if (settings.getMaxThreads() < 1 || settings.getMaxThreads() > 4) {
-            throw new ValidationException(String.format("Invalid max concurrent download settings, values must be in [%d,%d]", 1, 4));
-        }
-    }
-
-    public Theme getTheme() {
-        return new Theme(this.settings.getDarkTheme());
-    }
-
-    public void setTheme(Theme theme) {
-        this.settings.setDarkTheme(theme.darkTheme);
-        save();
-    }
-
-    @Getter
-    @NoArgsConstructor
-    public static class Theme {
-
-        @JsonProperty("darkTheme")
-        private boolean darkTheme;
-
-        Theme(boolean darkTheme) {
-            this.darkTheme = darkTheme;
-        }
-    }
-
-    @Getter
-    @Setter
-    @NoArgsConstructor
-    @JsonInclude(JsonInclude.Include.NON_NULL)
-    public static class Settings {
-
-        @JsonProperty("downloadPath")
-        private String downloadPath;
-        @JsonProperty("maxThreads")
-        private Integer maxThreads;
-        @JsonProperty("maxTotalThreads")
-        private Integer maxTotalThreads;
-        @JsonProperty("autoStart")
-        private Boolean autoStart;
-        @JsonProperty("vLogin")
-        private Boolean vLogin;
-        @JsonProperty("vUsername")
-        private String vUsername;
-        @JsonProperty("vPassword")
-        private String vPassword;
-        @JsonProperty("vThanks")
-        private Boolean vThanks;
-        @JsonProperty("desktopClipboard")
-        private Boolean desktopClipboard;
-        @JsonProperty("forceOrder")
-        private Boolean forceOrder;
-        @JsonProperty("subLocation")
-        private Boolean subLocation;
-        @JsonProperty("threadSubLocation")
-        private Boolean threadSubLocation;
-        @JsonProperty("clearCompleted")
-        private Boolean clearCompleted;
-        @JsonProperty("viewPhotos")
-        private Boolean viewPhotos;
-        @JsonProperty("notification")
-        private Boolean notification;
-        @JsonProperty("darkTheme")
-        private Boolean darkTheme;
-
-        public void setVPassword(String vPassword) {
-            if (vPassword == null || vPassword.isEmpty()) {
-                this.vPassword = "";
-            } else {
-                this.vPassword = DigestUtils.md5Hex(vPassword);
-            }
-        }
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/services/AppStateExchange.java

@@ -1,73 +0,0 @@
-package tn.mnlr.vripper.services;
-
-import io.reactivex.processors.PublishProcessor;
-import org.springframework.stereotype.Service;
-import tn.mnlr.vripper.entities.Image;
-import tn.mnlr.vripper.entities.Post;
-
-import java.util.Arrays;
-import java.util.Map;
-import java.util.concurrent.ConcurrentHashMap;
-import java.util.concurrent.atomic.AtomicInteger;
-
-@Service
-public class AppStateExchange {
-
-    private Map<String, Image> currentImages = new ConcurrentHashMap<>();
-
-    private Map<String, Post> currentPosts = new ConcurrentHashMap<>();
-
-    private Map<String, AtomicInteger> runningPosts = new ConcurrentHashMap<>();
-
-    private Map<String, QueuedVGLink> grabQueue = new ConcurrentHashMap<>();
-
-    private PublishProcessor<QueuedVGLink> liveGrabQueue = PublishProcessor.create();
-
-    private PublishProcessor<Image> liveImageUpdates = PublishProcessor.create();
-
-    private PublishProcessor<Post> livePostsState = PublishProcessor.create();
-
-    public Map<String, AtomicInteger> running() {
-        return runningPosts;
-    }
-
-    public Map<String, Post> getPosts() {
-        return this.currentPosts;
-    }
-
-    public Post getPost(String postId) {
-        return currentPosts.get(postId);
-    }
-
-    public Map<String, Image> getImages() {
-        return currentImages;
-    }
-
-    public PublishProcessor<Image> liveImage() {
-        return liveImageUpdates;
-    }
-
-    public PublishProcessor<Post> livePost() {
-        return livePostsState;
-    }
-
-    public Map<String, QueuedVGLink> getQueue() {
-        return grabQueue;
-    }
-
-    public PublishProcessor<QueuedVGLink> liveQueue() {
-        return liveGrabQueue;
-    }
-
-    public synchronized void restore(Map<String, Post> read) {
-        currentPosts.clear();
-        currentPosts.putAll(read);
-        currentPosts.values().forEach(p -> {
-            if (Arrays.asList(Post.Status.DOWNLOADING, Post.Status.PARTIAL, Post.Status.PENDING).contains(p.getStatus())) {
-                p.setStatus(Post.Status.STOPPED);
-            }
-        });
-        currentImages.clear();
-        read.values().stream().flatMap(e -> e.getImages().stream()).forEach(e -> currentImages.put(e.getUrl(), e));
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/services/AppStateService.java

@@ -1,176 +0,0 @@
-package tn.mnlr.vripper.services;
-
-import lombok.Getter;
-import lombok.NonNull;
-import lombok.Setter;
-import org.springframework.beans.factory.annotation.Autowired;
-import org.springframework.stereotype.Service;
-import tn.mnlr.vripper.entities.Image;
-import tn.mnlr.vripper.entities.Post;
-import tn.mnlr.vripper.q.DownloadJob;
-
-import java.util.List;
-import java.util.Map;
-import java.util.Optional;
-import java.util.concurrent.ConcurrentHashMap;
-import java.util.concurrent.atomic.AtomicInteger;
-import java.util.stream.Collectors;
-
-@Service
-public class AppStateService {
-
-    private final PersistenceService persistenceService;
-    private final AppSettingsService appSettingsService;
-    private final AppStateExchange appStateExchange;
-
-    @Autowired
-    public AppStateService(PersistenceService persistenceService, AppSettingsService appSettingsService, AppStateExchange appStateExchange) {
-        this.appStateExchange = appStateExchange;
-        this.persistenceService = persistenceService;
-        this.appSettingsService = appSettingsService;
-    }
-
-    public synchronized void newQueueLink(QueuedVGLink queuedVGLink) {
-        appStateExchange.getQueue().put(queuedVGLink.getThreadId(), queuedVGLink);
-        appStateExchange.liveQueue().onNext(queuedVGLink);
-    }
-
-    public synchronized void queueLinkUpdated(QueuedVGLink queuedVGLink) {
-        appStateExchange.liveQueue().onNext(queuedVGLink);
-    }
-
-    public synchronized void removeQueueLink(String threadId) {
-        Optional.ofNullable(appStateExchange.getQueue().remove(threadId)).ifPresent(QueuedVGLink::remove);
-    }
-
-    public synchronized boolean newPost(@NonNull Post post) {
-        if (appStateExchange.getPosts().containsKey(post.getPostId())) {
-            return false;
-        } else {
-            appStateExchange.getPosts().put(post.getPostId(), post);
-            appStateExchange.livePost().onNext(post);
-            persistenceService.getProcessor().onNext(appStateExchange.getPosts());
-            return true;
-        }
-    }
-
-    public synchronized void postUpdated(@NonNull Post post) {
-        appStateExchange.livePost().onNext(post);
-        persistenceService.getProcessor().onNext(appStateExchange.getPosts());
-    }
-
-    public boolean newImage(Image image) {
-        if (appStateExchange.getImages().containsKey(image.getUrl())) {
-            return false;
-        } else {
-            appStateExchange.getImages().put(image.getUrl(), image);
-            appStateExchange.liveImage().onNext(image);
-            persistenceService.getProcessor().onNext(appStateExchange.getPosts());
-            return true;
-        }
-    }
-
-    public synchronized void imageUpdated(Image image) {
-
-        persistenceService.getProcessor().onNext(appStateExchange.getPosts());
-        appStateExchange.liveImage().onNext(image);
-
-        if (image.isCompleted()) {
-            Post postState = appStateExchange.getPosts().get(image.getPostId());
-            postState.increase();
-        }
-    }
-
-    public synchronized void newDownloadJob(@NonNull DownloadJob downloadJob) {
-        String postId = downloadJob.getImage().getPostId();
-        checkKeyRunningPosts(postId);
-        appStateExchange.running().get(postId).incrementAndGet();
-    }
-
-    public synchronized void postDownloadingUpdate(@NonNull String postId) {
-        Post post = appStateExchange.getPosts().get(postId);
-        if (!post.getStatus().equals(Post.Status.DOWNLOADING) && !post.getStatus().equals(Post.Status.PARTIAL)) {
-            post.setStatus(Post.Status.DOWNLOADING);
-            appStateExchange.livePost().onNext(post);
-        }
-    }
-
-    public synchronized void doneDownloadJob(@NonNull Image image) {
-        String postId = image.getPostId();
-        int i = appStateExchange.running().get(postId).decrementAndGet();
-        Post post = appStateExchange.getPosts().get(postId);
-        if (image.getStatus().equals(Image.Status.ERROR)) {
-            post.setStatus(Post.Status.PARTIAL);
-        }
-        if (i == 0) {
-            appStateExchange.running().remove(postId);
-            if (post.getImages().stream().map(Image::getStatus).anyMatch(e -> e.equals(Image.Status.ERROR))) {
-                post.setStatus(Post.Status.ERROR);
-            } else {
-                if (!Post.Status.STOPPED.equals(post.getStatus())) {
-                    post.setStatus(Post.Status.COMPLETE);
-                    if (appSettingsService.getSettings().getClearCompleted()) {
-                        remove(image.getPostId());
-                    }
-                }
-            }
-        }
-    }
-
-    public boolean isRunning(String postId) {
-        AtomicInteger runningCount = appStateExchange.running().get(postId);
-        return runningCount != null && runningCount.get() > 0;
-    }
-
-    public synchronized List<String> clearAll() {
-        return this.appStateExchange.getPosts()
-                .values()
-                .stream()
-                .filter(e -> e.getStatus().equals(Post.Status.COMPLETE) && e.getDone().get() >= e.getTotal())
-                .map(Post::getPostId)
-                .peek(this::remove)
-                .collect(Collectors.toList());
-    }
-
-    public synchronized List<String> removeAll(List<String> postIds) {
-        if (postIds != null && !postIds.isEmpty()) {
-            postIds.forEach(this::remove);
-            return postIds;
-        } else {
-            return this.appStateExchange.getPosts()
-                    .values()
-                    .stream()
-                    .map(Post::getPostId)
-                    .peek(this::remove)
-                    .collect(Collectors.toList());
-        }
-    }
-
-    private void checkKeyRunningPosts(@NonNull String key) {
-        if (!appStateExchange.running().containsKey(key)) {
-            appStateExchange.running().put(key, new AtomicInteger(0));
-        }
-    }
-
-    private void remove(@NonNull String postId) {
-        final Post post = appStateExchange.getPosts().get(postId);
-        if (post == null) {
-            return;
-        }
-        post.setRemoved(true);
-        appStateExchange.running().remove(postId);
-        appStateExchange.getPosts().remove(postId);
-        appStateExchange.getImages().entrySet().removeIf(entry -> entry.getValue().getPostId().equals(postId));
-        persistenceService.getProcessor().onNext(appStateExchange.getPosts());
-    }
-
-    @Getter
-    public static class CachedThread {
-
-        private Map<String, Post> posts = new ConcurrentHashMap<>();
-        private AtomicInteger parsed = new AtomicInteger(0);
-
-        @Setter
-        private int total = 0;
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/services/CommonExecutor.java

@@ -1,29 +0,0 @@
-package tn.mnlr.vripper.services;
-
-import io.reactivex.Scheduler;
-import io.reactivex.schedulers.Schedulers;
-import lombok.Getter;
-import org.springframework.stereotype.Service;
-
-import javax.annotation.PreDestroy;
-import java.util.concurrent.ExecutorService;
-import java.util.concurrent.Executors;
-import java.util.concurrent.TimeUnit;
-
-@Service
-public class CommonExecutor {
-    @Getter
-    private final ExecutorService generalExecutor = Executors.newFixedThreadPool(Runtime.getRuntime().availableProcessors());
-    private final ExecutorService schedulerExecutor = Executors.newFixedThreadPool(Runtime.getRuntime().availableProcessors());
-
-    @Getter
-    private final Scheduler scheduler = Schedulers.from(schedulerExecutor);
-
-    @PreDestroy
-    private void destroy() throws InterruptedException {
-        generalExecutor.shutdown();
-        generalExecutor.awaitTermination(10, TimeUnit.SECONDS);
-        schedulerExecutor.shutdown();
-        schedulerExecutor.awaitTermination(10, TimeUnit.SECONDS);
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/services/ConnectionManager.java

@@ -1,73 +0,0 @@
-package tn.mnlr.vripper.services;
-
-import org.apache.http.client.config.CookieSpecs;
-import org.apache.http.client.config.RequestConfig;
-import org.apache.http.client.methods.HttpGet;
-import org.apache.http.client.methods.HttpPost;
-import org.apache.http.impl.client.HttpClientBuilder;
-import org.apache.http.impl.client.HttpClients;
-import org.apache.http.impl.client.LaxRedirectStrategy;
-import org.apache.http.impl.conn.PoolingHttpClientConnectionManager;
-import org.springframework.scheduling.annotation.EnableScheduling;
-import org.springframework.scheduling.annotation.Scheduled;
-import org.springframework.stereotype.Service;
-
-import java.net.URI;
-import java.util.concurrent.TimeUnit;
-
-@Service
-@EnableScheduling
-public class ConnectionManager {
-
-    private ConnectionManager() {
-        buildConnectionPool();
-    }
-
-    private PoolingHttpClientConnectionManager pcm;
-
-    private RequestConfig rc = RequestConfig.custom()
-            .setConnectionRequestTimeout(5_000)
-            .setConnectTimeout(5_000)
-            .setSocketTimeout(5_000)
-            .setCookieSpec(CookieSpecs.STANDARD)
-            .build();
-
-    private void buildConnectionPool() {
-
-        pcm = new PoolingHttpClientConnectionManager();
-        pcm.setMaxTotal(50);
-        pcm.setDefaultMaxPerRoute(4);
-    }
-
-    @Scheduled(fixedDelay = 1000)
-    private void idleConnectionMonitoring() {
-        pcm.closeExpiredConnections();
-        pcm.closeIdleConnections(30, TimeUnit.SECONDS);
-    }
-
-    public HttpClientBuilder getClient() {
-        return HttpClients.custom()
-                .setConnectionManager(pcm)
-                .setRedirectStrategy(new LaxRedirectStrategy())
-                .disableAutomaticRetries()
-                .setDefaultRequestConfig(rc);
-    }
-
-    public HttpGet buildHttpGet(String url) {
-        HttpGet httpGet = new HttpGet(url.replace(" ", "+"));
-        httpGet.addHeader("User-Agent", "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36");
-        return httpGet;
-    }
-
-    public HttpPost buildHttpPost(String url) {
-        HttpPost httpPost = new HttpPost(url.replace(" ", "+"));
-        httpPost.addHeader("User-Agent", "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36");
-        return httpPost;
-    }
-
-    public HttpGet buildHttpGet(URI uri) {
-        HttpGet httpGet = new HttpGet(uri);
-        httpGet.addHeader("User-Agent", "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36");
-        return httpGet;
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/services/ConnectionService.java

@@ -0,0 +1,154 @@
+package tn.mnlr.vripper.services;
+
+import lombok.Getter;
+import lombok.extern.slf4j.Slf4j;
+import net.jodah.failsafe.RetryPolicy;
+import org.apache.http.client.config.CookieSpecs;
+import org.apache.http.client.config.RequestConfig;
+import org.apache.http.client.methods.AbstractExecutionAwareRequest;
+import org.apache.http.client.methods.HttpGet;
+import org.apache.http.client.methods.HttpPost;
+import org.apache.http.client.protocol.HttpClientContext;
+import org.apache.http.impl.client.HttpClientBuilder;
+import org.apache.http.impl.client.HttpClients;
+import org.apache.http.impl.client.LaxRedirectStrategy;
+import org.apache.http.impl.conn.PoolingHttpClientConnectionManager;
+import org.springframework.scheduling.annotation.EnableScheduling;
+import org.springframework.scheduling.annotation.Scheduled;
+import org.springframework.stereotype.Service;
+import reactor.core.Disposable;
+import tn.mnlr.vripper.download.DownloadJob;
+import tn.mnlr.vripper.event.Event;
+import tn.mnlr.vripper.event.EventBus;
+import tn.mnlr.vripper.services.domain.Settings;
+
+import javax.annotation.PreDestroy;
+import java.net.URI;
+import java.time.temporal.ChronoUnit;
+import java.util.List;
+import java.util.concurrent.TimeUnit;
+
+@Service
+@EnableScheduling
+@Slf4j
+public class ConnectionService {
+
+  private final Disposable disposable;
+  private PoolingHttpClientConnectionManager pcm;
+  private RequestConfig rc;
+
+  @Getter private RetryPolicy<Object> retryPolicy;
+
+  private int connectionTimeout;
+  private int maxAttempts;
+
+  public ConnectionService(EventBus eventBus, SettingsService settingsService) {
+    connectionTimeout = settingsService.getSettings().getConnectionTimeout();
+    maxAttempts = settingsService.getSettings().getMaxAttempts();
+    disposable =
+        eventBus
+            .flux()
+            .filter(e -> e.getKind().equals(Event.Kind.SETTINGS_UPDATE))
+            .map(e -> ((Settings) e.getData()))
+            .subscribe(
+                settings -> {
+                  if (connectionTimeout != settings.getConnectionTimeout()) {
+                    connectionTimeout = settings.getConnectionTimeout();
+                    buildRequestConfig();
+                  }
+                  if (maxAttempts != settings.getMaxAttempts()) {
+                    maxAttempts = settings.getMaxAttempts();
+                    buildRetryPolicy();
+                  }
+                });
+
+    buildRequestConfig();
+    buildRetryPolicy();
+    buildConnectionPool();
+  }
+
+  @PreDestroy
+  private void destroy() {
+    disposable.dispose();
+  }
+
+  private void buildRetryPolicy() {
+    retryPolicy =
+        new RetryPolicy<>()
+            .withDelay(2, 5, ChronoUnit.SECONDS)
+            .withMaxAttempts(maxAttempts)
+            .onFailedAttempt(
+                e ->
+                    log.warn(
+                        String.format("#%d tries failed", e.getAttemptCount()),
+                        e.getLastFailure()));
+  }
+
+  private void buildConnectionPool() {
+    pcm = new PoolingHttpClientConnectionManager();
+    pcm.setMaxTotal(Integer.MAX_VALUE);
+    pcm.setDefaultMaxPerRoute(Integer.MAX_VALUE);
+  }
+
+  private void buildRequestConfig() {
+    rc =
+        RequestConfig.custom()
+            .setConnectionRequestTimeout(connectionTimeout * 1000)
+            .setConnectTimeout(connectionTimeout * 1000)
+            .setSocketTimeout(connectionTimeout * 1000)
+            .setCookieSpec(CookieSpecs.STANDARD)
+            .build();
+  }
+
+  @Scheduled(fixedDelay = 5_000)
+  private void idleConnectionMonitoring() {
+    pcm.closeExpiredConnections();
+    pcm.closeIdleConnections(30, TimeUnit.SECONDS);
+  }
+
+  public HttpClientBuilder getClient() {
+    return HttpClients.custom()
+        .setConnectionManager(pcm)
+        .setRedirectStrategy(new LaxRedirectStrategy())
+        .disableAutomaticRetries()
+        .setDefaultRequestConfig(rc);
+  }
+
+  public HttpGet buildHttpGet(String url, final HttpClientContext context) {
+    HttpGet httpGet = new HttpGet(url.replace(" ", "+"));
+    httpGet.addHeader(
+        "User-Agent",
+        "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36");
+    addToContext(context, httpGet);
+    return httpGet;
+  }
+
+  public HttpPost buildHttpPost(String url, final HttpClientContext context) {
+    HttpPost httpPost = new HttpPost(url.replace(" ", "+"));
+    httpPost.addHeader(
+        "User-Agent",
+        "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36");
+    addToContext(context, httpPost);
+    return httpPost;
+  }
+
+  public HttpGet buildHttpGet(URI uri, final HttpClientContext context) {
+    HttpGet httpGet = new HttpGet(uri);
+    httpGet.addHeader(
+        "User-Agent",
+        "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36");
+    addToContext(context, httpGet);
+    return httpGet;
+  }
+
+  public void addToContext(HttpClientContext context, AbstractExecutionAwareRequest request) {
+    if (context != null) {
+      List<AbstractExecutionAwareRequest> requests =
+          (List<AbstractExecutionAwareRequest>)
+              context.getAttribute(DownloadJob.ContextAttributes.OPEN_CONNECTION.toString());
+      if (requests != null) {
+        requests.add(request);
+      }
+    }
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/services/DataService.java

@@ -0,0 +1,244 @@
+package tn.mnlr.vripper.services;
+
+import lombok.NonNull;
+import lombok.extern.slf4j.Slf4j;
+import org.springframework.beans.factory.annotation.Autowired;
+import org.springframework.stereotype.Service;
+import org.springframework.transaction.annotation.Transactional;
+import tn.mnlr.vripper.jpa.domain.*;
+import tn.mnlr.vripper.jpa.domain.enums.Status;
+import tn.mnlr.vripper.jpa.repositories.IImageRepository;
+import tn.mnlr.vripper.jpa.repositories.IMetadataRepository;
+import tn.mnlr.vripper.jpa.repositories.IPostRepository;
+import tn.mnlr.vripper.jpa.repositories.IQueuedRepository;
+import tn.mnlr.vripper.jpa.repositories.impl.LogEventRepository;
+
+import javax.annotation.PostConstruct;
+import java.util.*;
+import java.util.stream.Collectors;
+
+@Service
+@Transactional
+@Slf4j
+public class DataService {
+
+  private final IPostRepository postRepository;
+  private final IImageRepository imageRepository;
+  private final IQueuedRepository queuedRepository;
+  private final IMetadataRepository metadataRepository;
+  private final SettingsService settingsService;
+  private final LogEventRepository eventRepository;
+
+  @Autowired
+  public DataService(
+      IPostRepository postRepository,
+      IImageRepository imageRepository,
+      IQueuedRepository queuedRepository,
+      IMetadataRepository metadataRepository,
+      SettingsService settingsService,
+      LogEventRepository eventRepository) {
+    this.postRepository = postRepository;
+    this.imageRepository = imageRepository;
+    this.queuedRepository = queuedRepository;
+    this.metadataRepository = metadataRepository;
+    this.settingsService = settingsService;
+    this.eventRepository = eventRepository;
+  }
+
+  private void save(Post post) {
+    postRepository.save(post);
+  }
+
+  private void save(Queued queued) {
+    queuedRepository.save(queued);
+  }
+
+  private void save(Image image) {
+    imageRepository.save(image);
+  }
+
+  public boolean exists(String postId) {
+    return postRepository.existByPostId(postId);
+  }
+
+  public void newPost(Post post, Collection<Image> images) {
+    save(post);
+    images.forEach(
+        image -> {
+          image.setPostIdRef(post.getId());
+          save(image);
+        });
+    sortPostsByRank();
+  }
+
+  public synchronized void afterJobFinish(Image image, Post post) {
+    if (image.getStatus().equals(Status.COMPLETE)) {
+      post.setDone(post.getDone() + 1);
+      updatePostDone(post.getDone(), post.getId());
+    } else if (image.getStatus().equals(Status.ERROR)) {
+      post.setStatus(Status.PARTIAL);
+      updatePostStatus(post.getStatus(), post.getId());
+    }
+  }
+
+  private void updatePostDone(int done, Long id) {
+    postRepository.updateDone(done, id);
+  }
+
+  public void updatePostStatus(Status status, Long id) {
+    postRepository.updateStatus(status, id);
+  }
+
+  public void updatePostThanks(boolean thanked, Long id) {
+    postRepository.updateThanked(thanked, id);
+  }
+
+  public void updatePostTitle(String title, Long id) {
+    postRepository.updateTitle(title, id);
+  }
+
+  public void updatePostDownloadDirectory(String postFolderName, Long id) {
+    postRepository.updateFolderName(postFolderName, id);
+  }
+
+  public void updatePostRank(int rank, Long id) {
+    postRepository.updateRank(rank, id);
+  }
+
+  public void finishPost(@NonNull Post post) {
+    if (!imageRepository.findByPostIdAndIsError(post.getPostId()).isEmpty()) {
+      post.setStatus(Status.ERROR);
+      updatePostStatus(post.getStatus(), post.getId());
+    } else {
+      if (post.getDone() < post.getTotal()) {
+        post.setStatus(Status.STOPPED);
+        updatePostStatus(post.getStatus(), post.getId());
+      } else {
+        post.setStatus(Status.COMPLETE);
+        updatePostStatus(post.getStatus(), post.getId());
+        if (settingsService.getSettings().getClearCompleted()) {
+          remove(List.of(post.getPostId()));
+        }
+      }
+    }
+  }
+
+  private void remove(@NonNull final List<String> postIds) {
+    for (String postId : postIds) {
+      imageRepository.deleteAllByPostId(postId);
+      metadataRepository.deleteByPostId(postId);
+      postRepository.deleteByPostId(postId);
+    }
+    sortPostsByRank();
+  }
+
+  public void newQueueLink(@NonNull final Queued queued) {
+    save(queued);
+  }
+
+  public void removeQueueLink(@NonNull final String threadId) {
+    queuedRepository.deleteByThreadId(threadId);
+  }
+
+  public List<String> clearCompleted() {
+    List<String> completed = postRepository.findCompleted();
+    remove(completed);
+    return completed;
+  }
+
+  public void removeAll(final List<String> postIds) {
+
+    remove(
+        Objects.requireNonNullElse(
+            postIds,
+            postRepository.findAll().stream().map(Post::getPostId).collect(Collectors.toList())));
+  }
+
+  public List<Image> findByPostIdAndIsNotCompleted(@NonNull String postId) {
+    return imageRepository.findByPostIdAndIsNotCompleted(postId);
+  }
+
+  public long countErrorImages() {
+    return imageRepository.countError();
+  }
+
+  public List<Image> findImagesByPostId(String postId) {
+    return imageRepository.findByPostId(postId);
+  }
+
+  public List<Post> findAllPosts() {
+    return postRepository.findAll();
+  }
+
+  public Optional<Post> findPostByPostId(String postId) {
+    return postRepository.findByPostId(postId);
+  }
+
+  public void stopImagesByPostIdAndIsNotCompleted(String postId) {
+    imageRepository.stopByPostIdAndIsNotCompleted(postId);
+  }
+
+  public Optional<Queued> findQueuedByThreadId(String threadId) {
+    return queuedRepository.findByThreadId(threadId);
+  }
+
+  public List<Queued> findAllQueued() {
+    return queuedRepository.findAll();
+  }
+
+  public Optional<Post> findById(Long aLong) {
+    return postRepository.findById(aLong);
+  }
+
+  public Optional<Image> findImageById(Long aLong) {
+    return imageRepository.findById(aLong);
+  }
+
+  public Optional<Queued> findQueuedById(Long aLong) {
+    return queuedRepository.findById(aLong);
+  }
+
+  public synchronized void setMetadata(Post post, Metadata metadata) {
+    if (metadataRepository.findByPostId(post.getPostId()).isEmpty()) {
+      metadata.setPostIdRef(post.getId());
+      metadataRepository.save(metadata);
+    }
+  }
+
+  public Optional<Metadata> findMetadataByPostId(String postId) {
+    return metadataRepository.findByPostId(postId);
+  }
+
+  public void updateImageStatus(Status status, Long id) {
+    imageRepository.updateStatus(status, id);
+  }
+
+  public void updateImageCurrent(long current, Long id) {
+    imageRepository.updateCurrent(current, id);
+  }
+
+  public void updateImageTotal(long total, Long id) {
+    imageRepository.updateTotal(total, id);
+  }
+
+  public Optional<LogEvent> findEventById(Long id) {
+    return eventRepository.findById(id);
+  }
+
+  public List<LogEvent> findAllEvents() {
+    return eventRepository.findAll();
+  }
+
+  public void clearQueueLinks() {
+    queuedRepository.deleteAll();
+  }
+
+  public synchronized void sortPostsByRank() {
+    List<Post> posts = findAllPosts();
+    posts.sort(Comparator.comparing(Post::getAddedOn));
+    for (int i = 0; i < posts.size(); i++) {
+      posts.get(i).setRank(i);
+      updatePostRank(i, posts.get(i).getId());
+    }
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/services/DownloadSpeed.java

@@ -1,26 +0,0 @@
-package tn.mnlr.vripper.services;
-
-import lombok.Getter;
-
-@Getter
-public class DownloadSpeed {
-
-    private final String type = "downSpeed";
-    private String speed;
-
-    public DownloadSpeed(long bytes) {
-        speed = formatSI(bytes);
-    }
-
-    private String formatSI(long bytes) {
-        return humanReadableByteCount(bytes, false);
-    }
-
-    private String humanReadableByteCount(long bytes, boolean si) {
-        int unit = si ? 1000 : 1024;
-        if (bytes < unit) return bytes + " B";
-        int exp = (int) (Math.log(bytes) / Math.log(unit));
-        String pre = (si ? "kMGTPE" : "KMGTPE").charAt(exp - 1) + (si ? "" : "i");
-        return String.format("%.1f %sB", bytes / Math.pow(unit, exp), pre);
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/services/DownloadSpeedService.java

@@ -1,10 +1,11 @@
 package tn.mnlr.vripper.services;
 
-import io.reactivex.processors.PublishProcessor;
 import lombok.Getter;
 import org.springframework.scheduling.annotation.EnableScheduling;
 import org.springframework.scheduling.annotation.Scheduled;
 import org.springframework.stereotype.Service;
+import tn.mnlr.vripper.event.Event;
+import tn.mnlr.vripper.event.EventBus;
 
 import java.util.concurrent.atomic.AtomicLong;
 
@@ -12,29 +13,29 @@ import java.util.concurrent.atomic.AtomicLong;
 @EnableScheduling
 public class DownloadSpeedService {
 
-    private AtomicLong read = new AtomicLong(0);
+  private final AtomicLong read = new AtomicLong(0);
+  private final EventBus eventBus;
+  @Getter private long currentValue;
+  private boolean allowWrite = false;
 
-    private long currentValue;
+  public DownloadSpeedService(EventBus eventBus) {
+    this.eventBus = eventBus;
+  }
 
-    @Getter
-    private PublishProcessor<Long> readBytesPerSecond = PublishProcessor.create();
-
-    private boolean allowWrite = false;
-
-    public void increase(long read) {
-        if (allowWrite) {
-            this.read.addAndGet(read);
-        }
+  public void increase(long read) {
+    if (allowWrite) {
+      this.read.addAndGet(read);
     }
+  }
 
-    @Scheduled(fixedDelay = 1000)
-    private void calc() {
-        allowWrite = false;
-        long newValue = read.getAndSet(0);
-        if (newValue != currentValue) {
-            currentValue = newValue;
-            readBytesPerSecond.onNext(currentValue);
-        }
-        allowWrite = true;
+  @Scheduled(fixedDelay = 1000)
+  private void calc() {
+    allowWrite = false;
+    long newValue = read.getAndSet(0);
+    if (newValue != currentValue) {
+      currentValue = newValue;
+      eventBus.publishEvent(Event.wrap(Event.Kind.BYTES_PER_SECOND, currentValue));
     }
+    allowWrite = true;
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/services/GlobalState.java

@@ -1,35 +0,0 @@
-package tn.mnlr.vripper.services;
-
-import lombok.Getter;
-
-import java.util.Objects;
-
-@Getter
-public class GlobalState {
-
-    private final String type = "globalState";
-    private long running;
-    private long queued;
-    private long remaining;
-    private long error;
-
-    GlobalState(long running, long queued, long remaining, long error) {
-        this.running = running;
-        this.queued = queued;
-        this.remaining = remaining;
-        this.error = error;
-    }
-
-    @Override
-    public boolean equals(Object o) {
-        if (this == o) return true;
-        if (o == null || getClass() != o.getClass()) return false;
-        GlobalState that = (GlobalState) o;
-        return running == that.running && queued == that.queued && remaining == that.remaining && error == that.error;
-    }
-
-    @Override
-    public int hashCode() {
-        return Objects.hash(type, running, queued, remaining, error);
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/services/GlobalStateService.java

@@ -1,54 +1,42 @@
 package tn.mnlr.vripper.services;
 
-import io.reactivex.processors.PublishProcessor;
 import lombok.Getter;
 import org.springframework.beans.factory.annotation.Autowired;
 import org.springframework.scheduling.annotation.EnableScheduling;
 import org.springframework.scheduling.annotation.Scheduled;
 import org.springframework.stereotype.Service;
-import tn.mnlr.vripper.entities.Image;
-import tn.mnlr.vripper.q.DownloadQ;
-import tn.mnlr.vripper.q.ExecutionService;
+import tn.mnlr.vripper.download.DownloadService;
+import tn.mnlr.vripper.event.Event;
+import tn.mnlr.vripper.event.EventBus;
+import tn.mnlr.vripper.services.domain.GlobalState;
 
 @Service
 @EnableScheduling
 public class GlobalStateService {
 
-    private final DownloadQ downloadQ;
-    private final ExecutionService executionService;
-    private final AppStateExchange appStateExchange;
+  private final DownloadService downloadService;
+  private final DataService dataService;
+  private final EventBus eventBus;
+  @Getter private GlobalState currentState;
 
-    @Getter
-    private GlobalState currentState;
+  @Autowired
+  public GlobalStateService(
+      DownloadService downloadService, DataService dataService, EventBus eventBus) {
+    this.downloadService = downloadService;
+    this.dataService = dataService;
+    this.eventBus = eventBus;
+  }
 
-    @Getter
-    private PublishProcessor<GlobalState> liveGlobalState = PublishProcessor.create();
-
-    @Autowired
-    public GlobalStateService(DownloadQ downloadQ, ExecutionService executionService, AppStateExchange appStateExchange) {
-        this.downloadQ = downloadQ;
-        this.executionService = executionService;
-        this.appStateExchange = appStateExchange;
-    }
-
-    @Scheduled(fixedDelay = 3000)
-    private void interval() {
-        GlobalState newGlobalState = new GlobalState(
-                executionService.runningCount(),
-                downloadQ.size(),
-                appStateExchange.getImages()
-                        .values()
-                        .stream()
-                        .filter(e -> e.getTotal() == 0 || e.getTotal() != e.getCurrent().get())
-                        .count(),
-                appStateExchange.getImages()
-                        .values()
-                        .stream()
-                        .filter(e -> e.getStatus().equals(Image.Status.ERROR))
-                        .count());
-        if (!newGlobalState.equals(currentState)) {
-            currentState = newGlobalState;
-            liveGlobalState.onNext(currentState);
-        }
+  @Scheduled(fixedDelay = 3000)
+  private void interval() {
+    GlobalState newGlobalState =
+        new GlobalState(
+            downloadService.runningCount(),
+            downloadService.pendingCount(),
+            dataService.countErrorImages());
+    if (!newGlobalState.equals(currentState)) {
+      currentState = newGlobalState;
+      eventBus.publishEvent(Event.wrap(Event.Kind.GLOBAL_STATE, currentState));
     }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/services/HostService.java

@@ -0,0 +1,113 @@
+package tn.mnlr.vripper.services;
+
+import lombok.Getter;
+import lombok.extern.slf4j.Slf4j;
+import org.apache.http.Header;
+import org.apache.http.client.HttpClient;
+import org.apache.http.client.methods.CloseableHttpResponse;
+import org.apache.http.client.methods.HttpGet;
+import org.apache.http.client.protocol.HttpClientContext;
+import org.apache.http.util.EntityUtils;
+import org.springframework.beans.factory.annotation.Autowired;
+import org.springframework.stereotype.Service;
+import org.w3c.dom.Document;
+import tn.mnlr.vripper.exception.HostException;
+import tn.mnlr.vripper.exception.HtmlProcessorException;
+
+import java.io.IOException;
+import java.net.URI;
+import java.net.URISyntaxException;
+
+@Service
+@Slf4j
+public class HostService {
+
+  private final ConnectionService cm;
+  private final HtmlProcessorService htmlProcessorService;
+
+  @Autowired
+  public HostService(ConnectionService cm, HtmlProcessorService htmlProcessorService) {
+    this.cm = cm;
+    this.htmlProcessorService = htmlProcessorService;
+  }
+
+  public Response getResponse(final String url, final HttpClientContext context)
+      throws HostException {
+    String basePage;
+
+    HttpClient client = cm.getClient().build();
+    HttpGet httpGet = cm.buildHttpGet(url, context);
+    Header[] headers;
+    log.debug(String.format("Requesting %s", url));
+    try (CloseableHttpResponse response =
+        (CloseableHttpResponse) client.execute(httpGet, context)) {
+      if (response.getStatusLine().getStatusCode() / 100 != 2) {
+        throw new HostException(
+            String.format(
+                "Unexpected response code: %d", response.getStatusLine().getStatusCode()));
+      }
+      headers = response.getAllHeaders();
+      basePage = EntityUtils.toString(response.getEntity());
+      log.debug(String.format("%s response: %n%s", url, basePage));
+      EntityUtils.consumeQuietly(response.getEntity());
+    } catch (IOException e) {
+      throw new HostException(e);
+    }
+
+    try {
+      log.debug(String.format("Cleaning %s response", url));
+      return new Response(htmlProcessorService.clean(basePage), headers);
+    } catch (HtmlProcessorException e) {
+      throw new HostException(e);
+    }
+  }
+
+  public String appendUri(String uri, String appendQuery) throws URISyntaxException {
+    URI oldUri = new URI(uri);
+
+    String newQuery = oldUri.getQuery();
+    if (newQuery == null) {
+      newQuery = appendQuery;
+    } else {
+      newQuery += "&" + appendQuery;
+    }
+
+    return new URI(
+            oldUri.getScheme(),
+            oldUri.getAuthority(),
+            oldUri.getPath(),
+            newQuery,
+            oldUri.getFragment())
+        .toString();
+  }
+
+  public String getDefaultImageName(final String imgUrl) {
+    String imageTitle = imgUrl.substring(imgUrl.lastIndexOf('/') + 1);
+    log.debug(String.format("Extracting name from url %s: %s", imgUrl, imageTitle));
+    return imgUrl;
+  }
+
+  @Getter
+  public static class Response {
+
+    private final Document document;
+    private final Header[] headers;
+
+    protected Response(Document document, Header[] headers) {
+      this.document = document;
+      this.headers = headers;
+    }
+  }
+
+  @Getter
+  public static class NameUrl {
+
+    private final String name;
+    private final String url;
+
+    public NameUrl(String name, String url) {
+      this.name = name;
+      this.url = url;
+    }
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/services/HtmlProcessorService.java

@@ -11,12 +11,12 @@ import tn.mnlr.vripper.exception.HtmlProcessorException;
 @Service
 public class HtmlProcessorService {
 
-    public Document clean(String htmlContent) throws HtmlProcessorException {
-        try {
-            TagNode clean = new HtmlCleaner().clean(htmlContent);
-            return new DomSerializer(new CleanerProperties()).createDOM(clean);
-        } catch (Exception e) {
-            throw new HtmlProcessorException(e);
-        }
+  public Document clean(String htmlContent) throws HtmlProcessorException {
+    try {
+      TagNode clean = new HtmlCleaner().clean(htmlContent);
+      return new DomSerializer(new CleanerProperties()).createDOM(clean);
+    } catch (Exception e) {
+      throw new HtmlProcessorException(e);
     }
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/services/MetadataService.java

@@ -0,0 +1,50 @@
+package tn.mnlr.vripper.services;
+
+import lombok.extern.slf4j.Slf4j;
+import org.springframework.stereotype.Service;
+import tn.mnlr.vripper.jpa.domain.Post;
+import tn.mnlr.vripper.tasks.MetadataRunnable;
+
+import java.util.ArrayList;
+import java.util.List;
+import java.util.Map;
+import java.util.concurrent.ConcurrentHashMap;
+
+@Slf4j
+@Service
+public class MetadataService {
+
+  private final Map<String, MetadataRunnable> fetchingMetadata = new ConcurrentHashMap<>();
+  private final ThreadPoolService threadPoolService;
+
+  public MetadataService(ThreadPoolService threadPoolService) {
+    this.threadPoolService = threadPoolService;
+  }
+
+  public void startFetchingMetadata(Post post) {
+    MetadataRunnable runnable = new MetadataRunnable(post);
+    threadPoolService.getGeneralExecutor().submit(runnable);
+    fetchingMetadata.put(post.getPostId(), runnable);
+  }
+
+  public void stopFetchingMetadata(List<String> postIds) {
+    List<MetadataRunnable> stopping = new ArrayList<>();
+
+    for (Map.Entry<String, MetadataRunnable> entry : this.fetchingMetadata.entrySet()) {
+      if (postIds.contains(entry.getKey())) {
+        stopping.add(entry.getValue());
+        entry.getValue().stop();
+      }
+    }
+
+    while (!stopping.isEmpty()) {
+      stopping.removeIf(MetadataRunnable::isFinished);
+      try {
+        Thread.sleep(100);
+      } catch (InterruptedException e) {
+        Thread.currentThread().interrupt();
+      }
+    }
+    postIds.forEach(fetchingMetadata::remove);
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/services/PathService.java

@@ -1,119 +1,126 @@
 package tn.mnlr.vripper.services;
 
+import lombok.Getter;
 import lombok.NonNull;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
-import org.springframework.beans.factory.annotation.Autowired;
+import lombok.extern.slf4j.Slf4j;
 import org.springframework.stereotype.Service;
-import tn.mnlr.vripper.entities.Post;
+import tn.mnlr.vripper.exception.RenameException;
+import tn.mnlr.vripper.jpa.domain.Post;
+import tn.mnlr.vripper.services.domain.Settings;
 
 import java.io.File;
 import java.io.IOException;
 import java.nio.file.Files;
-import java.nio.file.Paths;
 import java.nio.file.StandardCopyOption;
-import java.util.Arrays;
-import java.util.List;
-import java.util.Objects;
-import java.util.Optional;
-import java.util.stream.Collectors;
+import java.util.concurrent.locks.ReentrantLock;
 
 @Service
+@Slf4j
 public class PathService {
 
-    private static final Logger logger = LoggerFactory.getLogger(PathService.class);
+  private final DataService dataService;
 
-    private final AppSettingsService appSettingsService;
+  @Getter private final ReentrantLock directoryAccess = new ReentrantLock();
 
-    private final CommonExecutor commonExecutor;
+  public PathService(DataService dataService) {
+    this.dataService = dataService;
+  }
 
-    private final int MAX_DELETE_ATTEMPTS = 180;
+  public final File calcDownloadDirectory(Post post, Settings settings) {
+    return new File(settings.getDownloadPath(), post.getDownloadDirectory());
+  }
 
-    @Autowired
-    public PathService(AppSettingsService appSettingsService, CommonExecutor commonExecutor) {
-        this.appSettingsService = appSettingsService;
-        this.commonExecutor = commonExecutor;
+  private File getRootFolder(
+      @NonNull String forum, @NonNull String threadTitle, Settings settings) {
+    File sourceFolder =
+        settings.getSubLocation()
+            ? new File(settings.getDownloadPath(), sanitize(forum))
+            : new File(settings.getDownloadPath());
+    return settings.getThreadSubLocation() ? new File(sourceFolder, threadTitle) : sourceFolder;
+  }
+
+  public final void createDefaultPostFolder(Post post, Settings settings) {
+    File downloadDirectory = getRootFolder(post.getForum(), post.getThreadTitle(), settings);
+    downloadDirectory =
+        new File(
+            downloadDirectory,
+            settings.getAppendPostId()
+                ? sanitize(post.getTitle()) + "_" + post.getPostId()
+                : sanitize(post.getTitle()));
+    downloadDirectory = makeDir(downloadDirectory);
+    post.setDownloadDirectory(
+        downloadDirectory.getAbsolutePath().replace(settings.getDownloadPath(), ""));
+    dataService.updatePostDownloadDirectory(post.getDownloadDirectory(), post.getId());
+  }
+
+  public final void rename(@NonNull String postId, @NonNull String altName, Settings settings)
+      throws RenameException {
+    Post post = dataService.findPostByPostId(postId).orElseThrow();
+    if (altName.equals(post.getTitle())) {
+      return;
     }
 
-    public final File getDownloadDestinationFolder(Post post) {
-        return _getDownloadDestinationFolder(post.getForum(), post.getThreadTitle(), post.getPostFolderName());
+    // Download have not started yet
+    if (post.getDownloadDirectory() == null) {
+      post.setTitle(altName);
+      dataService.updatePostTitle(post.getTitle(), post.getId());
+      return;
     }
 
-    private File _getDownloadDestinationFolder(@NonNull String forum, @NonNull String threadTitle, @NonNull String title) {
-        File sourceFolder = appSettingsService.getSettings().getSubLocation() ? new File(appSettingsService.getSettings().getDownloadPath(), sanitize(forum)) : new File(appSettingsService.getSettings().getDownloadPath());
-        sourceFolder = appSettingsService.getSettings().getThreadSubLocation() ? new File(sourceFolder, threadTitle) : sourceFolder;
-        return new File(sourceFolder, title);
+    File newDownloadDirectory = getRootFolder(post.getForum(), post.getThreadTitle(), settings);
+    newDownloadDirectory = new File(newDownloadDirectory, sanitize(altName));
+    File currentDownloadDirectory = calcDownloadDirectory(post, settings);
+    try {
+      directoryAccess.lock();
+      Files.move(
+          currentDownloadDirectory.toPath(),
+          newDownloadDirectory.toPath(),
+          StandardCopyOption.ATOMIC_MOVE);
+      post.setDownloadDirectory(
+          newDownloadDirectory.getAbsolutePath().replace(settings.getDownloadPath(), ""));
+      dataService.updatePostDownloadDirectory(post.getDownloadDirectory(), post.getId());
+
+      post.setTitle(altName);
+      dataService.updatePostTitle(post.getTitle(), post.getId());
+    } catch (IOException e) {
+      throw new RenameException(
+          String.format(
+              "Failed to move files from %s to %s", currentDownloadDirectory, newDownloadDirectory),
+          e);
+    } finally {
+      directoryAccess.unlock();
+    }
+  }
+
+  private File makeDir(@NonNull final File sourceFolder) {
+    int counter = 1;
+    File folder = sourceFolder;
+
+    while (folder.exists()) {
+      folder = new File(sourceFolder.toString() + '.' + counter++);
     }
 
-    public synchronized final void createDefaultPostFolder(Post post) {
-        File sourceFolder = _getDownloadDestinationFolder(post.getForum(), post.getThreadTitle(), sanitize(post.getTitle()));
-        File destFolder = makeDirs(sourceFolder);
-        post.setPostFolderName(destFolder.getName());
+    if (!folder.mkdirs()) {
+      throw new RuntimeException(String.format("Failed to create the folder %s", sourceFolder));
     }
 
-    public synchronized final void rename(Post post, String altName) {
-        post.setTitle(altName);
-        if (post.getPostFolderName() == null) {
-            return;
-        }
-        File newDestFolder = makeDirs(_getDownloadDestinationFolder(post.getForum(), post.getThreadTitle(), sanitize(altName)));
-        File currentDesFolder = getDownloadDestinationFolder(post);
-        post.setPostFolderName(newDestFolder.getName());
+    return folder;
+  }
 
-        List<File> files = Optional.ofNullable(currentDesFolder.listFiles()).stream().flatMap(Arrays::stream).filter(e -> !e.getName().endsWith(".tmp")).collect(Collectors.toList());
-        for (File f : files) {
-            try {
-                Files.move(f.toPath(), Paths.get(newDestFolder.toString(), f.toPath().getFileName().toString()), StandardCopyOption.ATOMIC_MOVE, StandardCopyOption.REPLACE_EXISTING);
-            } catch (IOException e) {
-                logger.error(String.format("Failed to move files from %s to %s", currentDesFolder.toString(), newDestFolder.toString()), e);
-                return;
-            }
-        }
+  private String sanitize(final String folderName) {
+    String sanitizedFolderName =
+        folderName.replaceAll("\\.|\\\\|/|\\||:|\\?|\\*|\"|<|>|\\p{Cntrl}", "_");
+    log.debug(String.format("%s sanitized to %s", folderName, sanitizedFolderName));
+    return sanitizedFolderName;
+  }
 
-        commonExecutor.getGeneralExecutor().submit(() -> {
-            int attemptCount = 0;
-            while (Objects.requireNonNull(currentDesFolder.listFiles()).length != 0 && attemptCount < MAX_DELETE_ATTEMPTS) {
-                try {
-                    attemptCount++;
-                    Thread.sleep(1000);
-                } catch (InterruptedException e) {
-                    Thread.currentThread().interrupt();
-                }
-            }
-            if (!currentDesFolder.delete()) {
-                logger.warn(String.format("Failed to remove %s", currentDesFolder.toString()));
-            }
-        });
-    }
-
-    private synchronized File makeDirs(@NonNull final File sourceFolder) {
-        int counter = 1;
-        File folder = sourceFolder;
-
-        while (folder.exists()) {
-            folder = new File(sourceFolder.toString() + '.' + counter++);
-        }
-
-        if (!folder.mkdirs()) {
-            throw new RuntimeException(String.format("Failed to create the folder %s", sourceFolder.toString()));
-        }
-
-        return folder;
-    }
-
-    private String sanitize(final String folderName) {
-        String sanitizedFolderName = folderName.replaceAll("\\.|\\\\|/|\\||:|\\?|\\*|\"|<|>|\\p{Cntrl}", "_");
-        logger.debug(String.format("%s sanitized to %s", folderName, sanitizedFolderName));
-        return sanitizedFolderName;
-    }
-
-    /**
-     * Will sanitize the image name and remove extension
-     *
-     * @param imageName path string
-     * @return Sanitized local path string
-     */
-    public final String formatImageFileName(String imageName) {
-        return sanitize(imageName);
-    }
+  /**
+   * Will sanitize the image name and remove extension
+   *
+   * @param imageName path string
+   * @return Sanitized local path string
+   */
+  public final String formatImageFileName(String imageName) {
+    return sanitize(imageName);
+  }
 }

vripper-server/src/main/java/tn/mnlr/vripper/services/PersistenceService.java

@@ -1,146 +0,0 @@
-package tn.mnlr.vripper.services;
-
-import com.fasterxml.jackson.databind.ObjectMapper;
-import io.reactivex.disposables.Disposable;
-import io.reactivex.processors.PublishProcessor;
-import lombok.Getter;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
-import org.springframework.beans.factory.annotation.Autowired;
-import org.springframework.beans.factory.annotation.Value;
-import org.springframework.stereotype.Service;
-import tn.mnlr.vripper.EventListenerBean;
-import tn.mnlr.vripper.SpringContext;
-import tn.mnlr.vripper.entities.Image;
-import tn.mnlr.vripper.entities.Post;
-import tn.mnlr.vripper.entities.mixin.persistance.ImagePersistanceMixin;
-import tn.mnlr.vripper.entities.mixin.persistance.PostPersistanceMixin;
-
-import javax.annotation.PostConstruct;
-import javax.annotation.PreDestroy;
-import java.io.File;
-import java.io.FileWriter;
-import java.io.IOException;
-import java.io.PrintWriter;
-import java.nio.charset.StandardCharsets;
-import java.nio.file.Files;
-import java.nio.file.Paths;
-import java.util.Date;
-import java.util.HashMap;
-import java.util.Map;
-import java.util.concurrent.TimeUnit;
-
-@Service
-public class PersistenceService {
-
-    private static final Logger logger = LoggerFactory.getLogger(PersistenceService.class);
-
-    private final AppStateExchange appStateExchange;
-
-    @Value("${base.dir}")
-    private String baseDir;
-
-    @Getter
-    private String dataPath;
-
-    private ObjectMapper om;
-
-    private Disposable subscription;
-
-    @Getter
-    private PublishProcessor<Map<String, Post>> processor = PublishProcessor.create();
-
-    @Autowired
-    private PersistenceService(AppStateExchange appStateExchange) {
-        this.appStateExchange = appStateExchange;
-        om = new ObjectMapper();
-        om.addMixIn(Image.class, ImagePersistanceMixin.class);
-        om.addMixIn(Post.class, PostPersistanceMixin.class);
-        subscription = processor
-                .onBackpressureBuffer()
-                .buffer(1, TimeUnit.SECONDS)
-                .filter(e -> !e.isEmpty())
-                .doOnNext(e -> this.persist(e.get(0)))
-                .subscribe();
-    }
-
-    @PostConstruct
-    public void init() {
-        dataPath = baseDir + File.separator + ".vripper" + File.separator + "data.json";
-        File dataFile = new File(dataPath);
-        if (!dataFile.exists()) {
-            try {
-                if (dataFile.getParentFile().mkdirs()) {
-                    logger.debug(String.format("%s is created", dataFile.getParentFile().toString()));
-                }
-                if (!dataFile.getParentFile().isDirectory() || !dataFile.getParentFile().canWrite()) {
-                    logger.error(String.format("Unable to write in %s", dataFile.getParent()));
-                    SpringContext.close();
-                }
-
-                if (dataFile.createNewFile()) {
-                    logger.debug("Data file successfully created");
-                    try (FileWriter fw = new FileWriter(dataFile)) {
-                        fw.write("{}");
-                    }
-                } else {
-                    logger.warn("Data file already exists");
-                }
-            } catch (IOException e) {
-                logger.error("Unable to create data file", e);
-                SpringContext.close();
-            }
-        }
-    }
-
-    @PreDestroy
-    public void preDestroy() {
-        this.subscription.dispose();
-        logger.info(String.format("Destroying %s", PersistenceService.class.getSimpleName()));
-        logger.info("Persisting data before destroying");
-        if (EventListenerBean.isInit()) {
-            this.persist(appStateExchange.getPosts());
-        }
-    }
-
-    private void persist(Map<String, Post> currentPosts) {
-
-        try (PrintWriter out = new PrintWriter(dataPath, StandardCharsets.UTF_8)) {
-            out.print(om.writeValueAsString(currentPosts));
-        } catch (IOException e) {
-            logger.error("Failed to persist app state", e);
-        }
-    }
-
-    private Map<String, Post> read(String content) {
-
-        try {
-            return om.readValue(content, om.getTypeFactory().constructMapType(HashMap.class, String.class, Post.class));
-        } catch (IOException e) {
-            logger.error("Failed to read app state", e);
-            long timestamp = new Date().getTime();
-            logger.warn(String.format("trying to rename old data file from %s to %s", dataPath, dataPath + "." + timestamp + ".old"));
-            try {
-                Files.move(new File(dataPath).toPath(), new File(dataPath + "." + timestamp + ".old").toPath());
-            } catch (IOException ex) {
-                logger.error(String.format("Failed to rename %s to %s", dataPath, dataPath + ".old"));
-                SpringContext.close();
-            }
-        }
-
-        return new HashMap<>();
-    }
-
-    public void restore() {
-
-        String jsonContent = null;
-        try {
-            jsonContent = String.join("", Files.readAllLines(Paths.get(dataPath), StandardCharsets.UTF_8));
-        } catch (Exception e) {
-            logger.error("data file cannot be read, previous state cannot be restored", e);
-            SpringContext.close();
-        }
-
-        appStateExchange.restore(read(jsonContent));
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/services/PostParser.java

@@ -1,60 +0,0 @@
-package tn.mnlr.vripper.services;
-
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
-import org.springframework.beans.factory.annotation.Autowired;
-import org.springframework.stereotype.Service;
-import tn.mnlr.vripper.entities.Post;
-import tn.mnlr.vripper.exception.PostParseException;
-import tn.mnlr.vripper.q.DownloadQ;
-
-@Service
-public class PostParser {
-
-    private static final Logger logger = LoggerFactory.getLogger(PostParser.class);
-
-    static final String VR_API = "https://vipergirls.to/vr.php";
-
-    private final AppStateExchange appStateExchange;
-    private final AppSettingsService appSettingsService;
-    private final DownloadQ downloadQ;
-
-    @Autowired
-    public PostParser(AppStateExchange appStateExchange, AppSettingsService appSettingsService, DownloadQ downloadQ) {
-        this.appStateExchange = appStateExchange;
-        this.appSettingsService = appSettingsService;
-        this.downloadQ = downloadQ;
-    }
-
-    public synchronized void addPost(String postId, String threadId) throws PostParseException {
-
-        if (appStateExchange.getPosts().containsKey(postId)) {
-            logger.warn(String.format("skipping %s, already loaded", postId));
-            return;
-        }
-
-        VRPostParser vrPostParser = new VRPostParser(threadId, postId);
-        Post post = vrPostParser.parse();
-
-        if (appSettingsService.getSettings().getAutoStart()) {
-            logger.debug("Auto start downloads option is enabled");
-            logger.debug(String.format("Starting to enqueue %d jobs for %s", post.getImages().size(), post.getUrl()));
-            post.setStatus(Post.Status.PENDING);
-            try {
-                downloadQ.enqueue(post);
-            } catch (InterruptedException e) {
-                logger.warn("Interruption was caught");
-                Thread.currentThread().interrupt();
-                return;
-            }
-            logger.debug(String.format("Done enqueuing jobs for %s", post.getUrl()));
-        } else {
-            post.setStatus(Post.Status.STOPPED);
-            logger.debug("Auto start downloads option is disabled");
-        }
-    }
-
-    public VRThreadParser createVRThreadParser(QueuedVGLink queuedVGLink) {
-        return new VRThreadParser(queuedVGLink);
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/services/PostService.java

@@ -0,0 +1,73 @@
+package tn.mnlr.vripper.services;
+
+import com.github.benmanes.caffeine.cache.Caffeine;
+import com.github.benmanes.caffeine.cache.LoadingCache;
+import lombok.extern.slf4j.Slf4j;
+import org.springframework.beans.factory.annotation.Autowired;
+import org.springframework.stereotype.Service;
+import reactor.core.Disposable;
+import tn.mnlr.vripper.event.Event;
+import tn.mnlr.vripper.event.EventBus;
+import tn.mnlr.vripper.jpa.domain.Queued;
+import tn.mnlr.vripper.services.domain.MultiPostScanParser;
+import tn.mnlr.vripper.services.domain.MultiPostScanResult;
+import tn.mnlr.vripper.tasks.AddPostRunnable;
+import tn.mnlr.vripper.tasks.AddQueuedRunnable;
+
+import javax.annotation.PreDestroy;
+import java.util.List;
+import java.util.concurrent.ExecutionException;
+import java.util.concurrent.TimeUnit;
+
+@Service
+@Slf4j
+public class PostService {
+
+  private final DataService dataService;
+  private final ThreadPoolService threadPoolService;
+  private final LoadingCache<Queued, MultiPostScanResult> cache;
+  private final Disposable disposable;
+
+  @Autowired
+  public PostService(
+      DataService dataService, ThreadPoolService threadPoolService, EventBus eventBus) {
+    this.dataService = dataService;
+    this.threadPoolService = threadPoolService;
+    cache =
+        Caffeine.newBuilder()
+            .expireAfterWrite(5, TimeUnit.MINUTES)
+            .build(multiPostItem -> new MultiPostScanParser(multiPostItem).parse());
+    disposable =
+        eventBus
+            .flux()
+            .filter(e -> e.getKind().equals(Event.Kind.SETTINGS_UPDATE))
+            .subscribe(e -> this.cache.invalidateAll());
+  }
+
+  @PreDestroy
+  private void destroy() {
+    if (disposable != null) {
+      disposable.dispose();
+    }
+  }
+
+  public void processMultiPost(List<Queued> queuedList) {
+    for (Queued queued : queuedList) {
+      if (queued.getPostId() != null) {
+        threadPoolService
+            .getGeneralExecutor()
+            .submit(new AddPostRunnable(queued.getPostId(), queued.getThreadId()));
+      } else {
+        threadPoolService.getGeneralExecutor().submit(new AddQueuedRunnable(queued));
+      }
+    }
+  }
+
+  public MultiPostScanResult get(Queued queued) throws ExecutionException {
+    return cache.get(queued);
+  }
+
+  public void remove(String threadId) {
+    dataService.removeQueueLink(threadId);
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/services/QueuedVGLink.java

@@ -1,64 +0,0 @@
-package tn.mnlr.vripper.services;
-
-import lombok.Getter;
-import lombok.ToString;
-import tn.mnlr.vripper.SpringContext;
-
-import java.util.Objects;
-
-@ToString
-@Getter
-public class QueuedVGLink {
-
-    private final String type = "grabQueue";
-
-    private final AppStateService appStateService;
-
-    private final String link;
-    private final String threadId;
-    private final String postId;
-
-    private int count = 0;
-    private boolean loading = true;
-    private boolean removed = false;
-
-
-    public QueuedVGLink(String link, String threadId, String postId) {
-        this.appStateService = SpringContext.getBean(AppStateService.class);
-        this.link = link;
-        this.threadId = threadId;
-        this.postId = postId;
-    }
-
-    public void done() {
-        this.loading = false;
-        this.appStateService.queueLinkUpdated(this);
-    }
-
-    public void increment() {
-        this.count++;
-        this.appStateService.queueLinkUpdated(this);
-    }
-
-    public void setCount(int count) {
-        this.count = count;
-    }
-
-    public void remove() {
-        this.removed = true;
-        appStateService.queueLinkUpdated(this);
-    }
-
-    @Override
-    public boolean equals(Object o) {
-        if (this == o) return true;
-        if (o == null || getClass() != o.getClass()) return false;
-        QueuedVGLink that = (QueuedVGLink) o;
-        return Objects.equals(threadId, that.threadId);
-    }
-
-    @Override
-    public int hashCode() {
-        return Objects.hash(threadId);
-    }
-}

vripper-server/src/main/java/tn/mnlr/vripper/services/SettingsService.java

@@ -0,0 +1,305 @@
+package tn.mnlr.vripper.services;
+
+import com.fasterxml.jackson.annotation.JsonProperty;
+import com.fasterxml.jackson.core.type.TypeReference;
+import com.fasterxml.jackson.databind.DeserializationFeature;
+import com.fasterxml.jackson.databind.ObjectMapper;
+import lombok.Getter;
+import lombok.NoArgsConstructor;
+import lombok.Setter;
+import lombok.extern.slf4j.Slf4j;
+import org.apache.commons.codec.digest.DigestUtils;
+import org.springframework.beans.factory.annotation.Value;
+import org.springframework.core.io.Resource;
+import org.springframework.stereotype.Service;
+import tn.mnlr.vripper.SpringContext;
+import tn.mnlr.vripper.event.Event;
+import tn.mnlr.vripper.event.EventBus;
+import tn.mnlr.vripper.exception.ValidationException;
+import tn.mnlr.vripper.services.domain.Settings;
+
+import javax.annotation.PostConstruct;
+import javax.annotation.PreDestroy;
+import java.io.FileWriter;
+import java.io.IOException;
+import java.io.InputStream;
+import java.nio.file.Files;
+import java.nio.file.InvalidPathException;
+import java.nio.file.Path;
+import java.nio.file.Paths;
+import java.util.ArrayList;
+import java.util.HashSet;
+import java.util.List;
+import java.util.Set;
+
+import static java.nio.file.StandardOpenOption.*;
+
+@Service
+@Setter
+@Slf4j
+public class SettingsService {
+
+  private final Path configPath;
+  private final Path customProxiesPath;
+  private final ObjectMapper om = new ObjectMapper();
+
+  private final Set<String> proxies = new HashSet<>();
+
+  private final EventBus eventBus;
+
+  @Getter private Settings settings = new Settings();
+
+  @Value("classpath:proxies.json")
+  private Resource defaultProxies;
+
+  public SettingsService(
+      @Value("${base.dir}") String baseDir,
+      @Value("${base.dir.name}") String baseDirName,
+      EventBus eventBus) {
+    this.eventBus = eventBus;
+    this.configPath = Paths.get(baseDir, baseDirName, "config.json");
+    this.customProxiesPath = Paths.get(baseDir, baseDirName, "proxies.json");
+    om.configure(DeserializationFeature.FAIL_ON_UNKNOWN_PROPERTIES, false);
+  }
+
+  @PostConstruct
+  private void init() {
+    loadViperProxies();
+    restore();
+    eventBus.publishEvent(Event.wrap(Event.Kind.SETTINGS_UPDATE, settings));
+  }
+
+  private void loadViperProxies() {
+    try (InputStream defaultProxiesIs = defaultProxies.getInputStream()) {
+      List<String> defaultProxies = om.readValue(defaultProxiesIs, new TypeReference<>() {});
+      List<String> customProxies = new ArrayList<>();
+      if (customProxiesPath.toFile().exists() && customProxiesPath.toFile().isFile()) {
+        customProxies = om.readValue(customProxiesPath.toFile(), new TypeReference<>() {});
+      } else {
+        if (!customProxiesPath.toFile().createNewFile()) {
+          log.warn("Unable to create " + customProxiesPath.toFile().getAbsolutePath());
+        } else {
+          try (FileWriter fw = new FileWriter(customProxiesPath.toFile())) {
+            fw.append("[]").append(System.lineSeparator());
+            fw.flush();
+          } catch (IOException e) {
+            log.warn("Unable to create " + customProxiesPath.toFile().getAbsolutePath(), e);
+          }
+        }
+      }
+      proxies.addAll(customProxies);
+      proxies.addAll(defaultProxies);
+    } catch (IOException e) {
+      log.error("Failed to load vipergirls proxies list", e);
+    }
+    proxies.add("https://vipergirls.to");
+  }
+
+  public List<String> getProxies() {
+    return new ArrayList<>(proxies);
+  }
+
+  public void newSettings(Settings settings) {
+
+    if (settings.getVLogin() != null && settings.getVLogin()) {
+      if (!this.settings.getVPassword().equals(settings.getVPassword())) {
+        settings.setVPassword(DigestUtils.md5Hex(settings.getVPassword()));
+      }
+    } else {
+      settings.setVUsername("");
+      settings.setVPassword("");
+      settings.setVThanks(false);
+      settings.setVLogin(false);
+    }
+    this.settings = settings;
+
+    save();
+    eventBus.publishEvent(Event.wrap(Event.Kind.SETTINGS_UPDATE, settings));
+  }
+
+  public void restore() {
+    try {
+      if (configPath.toFile().exists()) {
+        settings = om.readValue(configPath.toFile(), Settings.class);
+      }
+    } catch (IOException e) {
+      log.error("Failed restore user settings", e);
+      settings = new Settings();
+    }
+
+    if (settings.getDownloadPath() == null) {
+      settings.setDownloadPath(System.getProperty("user.home"));
+    }
+
+    if (settings.getMaxThreads() == null) {
+      settings.setMaxThreads(4);
+    }
+
+    if (settings.getMaxTotalThreads() == null) {
+      settings.setMaxTotalThreads(0);
+    }
+
+    if (settings.getAutoStart() == null) {
+      settings.setAutoStart(true);
+    }
+
+    if (settings.getVLogin() == null) {
+      settings.setVLogin(false);
+    }
+
+    if (settings.getVUsername() == null) {
+      settings.setVUsername("");
+    }
+
+    if (settings.getVPassword() == null) {
+      settings.setVPassword("");
+    }
+
+    if (settings.getVThanks() == null) {
+      settings.setVThanks(false);
+    }
+
+    if (settings.getDesktopClipboard() == null) {
+      settings.setDesktopClipboard(false);
+    }
+
+    if (settings.getForceOrder() == null) {
+      settings.setForceOrder(false);
+    }
+
+    if (settings.getSubLocation() == null) {
+      settings.setSubLocation(false);
+    }
+
+    if (settings.getThreadSubLocation() == null) {
+      settings.setThreadSubLocation(false);
+    }
+
+    if (settings.getClearCompleted() == null) {
+      settings.setClearCompleted(false);
+    }
+
+    if (settings.getDarkTheme() == null) {
+      settings.setDarkTheme(false);
+    }
+
+    if (settings.getAppendPostId() == null) {
+      settings.setAppendPostId(true);
+    }
+
+    if (settings.getLeaveThanksOnStart() == null) {
+      settings.setLeaveThanksOnStart(false);
+    }
+
+    if (settings.getConnectionTimeout() == null) {
+      settings.setConnectionTimeout(30);
+    }
+
+    if (settings.getMaxAttempts() == null) {
+      settings.setMaxAttempts(5);
+    }
+
+    if (settings.getVProxy() == null || !proxies.contains(settings.getVProxy())) {
+      settings.setVProxy("https://vipergirls.to");
+    }
+
+    if (settings.getMaxEventLog() == null) {
+      settings.setMaxEventLog(1000);
+    }
+
+    try {
+      check(this.settings);
+    } catch (ValidationException e) {
+      log.error(
+          String.format("Your settings are invalid, either remove %s, or fix it", configPath), e);
+      SpringContext.close();
+    }
+
+    save();
+  }
+
+  public void save() {
+    try {
+      Files.write(
+          configPath, om.writeValueAsBytes(settings), CREATE, WRITE, TRUNCATE_EXISTING, SYNC);
+    } catch (IOException e) {
+      log.error("Failed to store user settings", e);
+    }
+  }
+
+  @PreDestroy
+  private void destroy() {
+    save();
+  }
+
+  public void check(Settings settings) throws ValidationException {
+
+    Path path;
+    try {
+      path = Paths.get(settings.getDownloadPath());
+    } catch (InvalidPathException e) {
+      throw new ValidationException(String.format("%s is invalid", settings.getDownloadPath()));
+    }
+    if (!Files.exists(path)) {
+      throw new ValidationException(String.format("%s does not exist", settings.getDownloadPath()));
+    } else if (!Files.isDirectory(path)) {
+      throw new ValidationException(
+          String.format("%s is not a directory", settings.getDownloadPath()));
+    }
+
+    if (settings.getMaxTotalThreads() < 0 || settings.getMaxTotalThreads() > 12) {
+      throw new ValidationException(
+          String.format(
+              "Invalid max global concurrent download settings, values must be in [%d,%d]", 0, 12));
+    }
+
+    if (settings.getMaxThreads() < 1 || settings.getMaxThreads() > 4) {
+      throw new ValidationException(
+          String.format(
+              "Invalid max concurrent download settings, values must be in [%d,%d]", 1, 4));
+    }
+
+    if (settings.getConnectionTimeout() < 1 || settings.getConnectionTimeout() > 300) {
+      throw new ValidationException(
+          String.format("Invalid connection timeout settings, values must be in [%d,%d]", 1, 300));
+    }
+
+    if (settings.getMaxAttempts() < 1 || settings.getMaxAttempts() > 10) {
+      throw new ValidationException(
+          String.format("Invalid maximum attempts settings, values must be in [%d,%d]", 1, 10));
+    }
+
+    if (settings.getMaxEventLog() < 100 || settings.getMaxEventLog() > 10_000) {
+      throw new ValidationException(
+          String.format(
+              "Invalid maximum event log record settings, values must be in [%d,%d]", 100, 10_000));
+    }
+
+    if (!settings.getVThanks()
+        && settings.getLeaveThanksOnStart() != null
+        && settings.getLeaveThanksOnStart()) {
+      throw new ValidationException("Invalid value, leave thanks must be checked");
+    }
+  }
+
+  public Theme getTheme() {
+    return new Theme(this.settings.getDarkTheme());
+  }
+
+  public void setTheme(Theme theme) {
+    this.settings.setDarkTheme(theme.darkTheme);
+    save();
+  }
+
+  @Getter
+  @NoArgsConstructor
+  public static class Theme {
+
+    @JsonProperty("darkTheme")
+    private boolean darkTheme;
+
+    Theme(boolean darkTheme) {
+      this.darkTheme = darkTheme;
+    }
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/services/ThreadPoolService.java

@@ -0,0 +1,20 @@
+package tn.mnlr.vripper.services;
+
+import lombok.Getter;
+import org.springframework.stereotype.Service;
+
+import java.util.concurrent.ExecutorService;
+import java.util.concurrent.Executors;
+import java.util.concurrent.TimeUnit;
+
+@Service
+public class ThreadPoolService {
+  @Getter
+  private final ExecutorService generalExecutor =
+      Executors.newFixedThreadPool(Runtime.getRuntime().availableProcessors());
+
+  public void destroy() throws Exception {
+    generalExecutor.shutdown();
+    generalExecutor.awaitTermination(5, TimeUnit.SECONDS);
+  }
+}

vripper-server/src/main/java/tn/mnlr/vripper/services/ThumbnailGenerator.java

@@ -1,173 +0,0 @@
-package tn.mnlr.vripper.services;
-
-import com.google.common.cache.CacheBuilder;
-import com.google.common.cache.CacheLoader;
-import com.google.common.cache.LoadingCache;
-import com.google.common.cache.Weigher;
-import lombok.Getter;
-import lombok.NoArgsConstructor;
-import lombok.Setter;
-import org.imgscalr.Scalr;
-import org.springframework.beans.factory.annotation.Autowired;
-import org.springframework.beans.factory.annotation.Value;
-import org.springframework.stereotype.Service;
-import org.springframework.util.FileSystemUtils;
-import tn.mnlr.vripper.entities.Post;
-
-import javax.annotation.PostConstruct;
-import javax.imageio.ImageIO;
-import java.awt.image.BufferedImage;
-import java.io.File;
-import java.io.IOException;
-import java.nio.file.FileVisitResult;
-import java.nio.file.Files;
-import java.nio.file.Path;
-import java.nio.file.SimpleFileVisitor;
-import java.nio.file.attribute.BasicFileAttributes;
-import java.time.Duration;
-import java.util.Objects;
-import java.util.Optional;
-import java.util.concurrent.atomic.AtomicLong;
-
-@Service
-public class ThumbnailGenerator {
-
-    @Getter
-    private LoadingCache<CacheKey, byte[]> thumbnails;
-
-    @Value("${base.dir}")
-    private String baseDir;
-
-    private final PathService pathService;
-    private final AppStateExchange appStateExchange;
-
-    @Getter
-    private File cacheFolder;
-    CacheLoader<CacheKey, byte[]> loader = new CacheLoader<>() {
-        @Override
-        public byte[] load(CacheKey key) throws Exception {
-            Post post = appStateExchange.getPost(key.getPostId());
-            File destinationFolder = pathService.getDownloadDestinationFolder(post);
-            if (!destinationFolder.exists() || !destinationFolder.isDirectory()) {
-                return null;
-            }
-            return Files.readAllBytes(generateThumbnail(new File(destinationFolder, key.getImgName()), key.getPostId()).toPath());
-        }
-    };
-
-    @Autowired
-    public ThumbnailGenerator(PathService pathService, AppStateExchange appStateExchange) {
-        this.pathService = pathService;
-        this.appStateExchange = appStateExchange;
-    }
-
-    @PostConstruct
-    private void init() throws Exception {
-        cacheFolder = new File(baseDir + File.separator + ".vripper" + File.separator + "cache");
-        cacheFolder.mkdirs();
-        if (!cacheFolder.exists()) {
-            throw new Exception(String.format("%s could not be created", cacheFolder.toString()));
-        }
-        thumbnails = CacheBuilder.newBuilder()
-                .expireAfterAccess(Duration.ofMinutes(30))
-                .weigher((Weigher<CacheKey, byte[]>) (k, v) -> v.length)
-                .maximumWeight(104_857_600)
-                .build(loader);
-    }
-
-    public void clearCache() {
-        thumbnails.invalidateAll();
-        for (File file : Optional.ofNullable(cacheFolder.listFiles()).orElse(new File[]{})) {
-            FileSystemUtils.deleteRecursively(file);
-        }
-    }
-
-    public long cacheSize() {
-
-        final AtomicLong size = new AtomicLong(0);
-
-        try {
-            Files.walkFileTree(cacheFolder.toPath(), new SimpleFileVisitor<>() {
-                @Override
-                public FileVisitResult visitFile(Path file, BasicFileAttributes attrs) {
-
-                    size.addAndGet(attrs.size());
-                    return FileVisitResult.CONTINUE;
-                }
-
-                @Override
-                public FileVisitResult visitFileFailed(Path file, IOException exc) {
-
-                    System.out.println("skipped: " + file + " (" + exc + ")");
-                    // Skip folders that can't be traversed
-                    return FileVisitResult.CONTINUE;
-                }
-
-                @Override
-                public FileVisitResult postVisitDirectory(Path dir, IOException exc) {
-
-                    if (exc != null)
-                        System.out.println("had trouble traversing: " + dir + " (" + exc + ")");
-                    else
-                        size.addAndGet(dir.toFile().length());
-                    // Ignore errors traversing a folder
-                    return FileVisitResult.CONTINUE;
-                }
-            });
-        } catch (IOException e) {
-            throw new AssertionError("walkFileTree will not throw IOException if the FileVisitor does not");
-        }
-
-        return size.get();
-    }
-
-    private File generateThumbnail(File inputFile, String postId) throws Exception {
-        if (!inputFile.exists()) {
-            throw new Exception(String.format("Input file %s does not exist", inputFile.toString()));
-        }
-        File postsCacheFolder = new File(cacheFolder, postId);
-        postsCacheFolder.mkdirs();
-        if (!postsCacheFolder.exists()) {
-            throw new Exception(String.format("%s could not be created", postsCacheFolder.toString()));
-        }
-
-        File thumbFile = new File(postsCacheFolder, inputFile.getName());
-        if (thumbFile.exists()) {
-            return thumbFile;
-        }
-
-        BufferedImage image = ImageIO.read(inputFile);
-        BufferedImage resize = Scalr.resize(image, 350, 350);
-        ImageIO.write(resize, "jpg", thumbFile);
-        image.flush();
-        resize.flush();
-        return thumbFile;
-    }
-
-    @Getter
-    @Setter
-    @NoArgsConstructor
-    public static class CacheKey {
-        private String postId;
-        private String imgName;
-
-        public CacheKey(String postId, String imgName) {
-            this.postId = postId;
-            this.imgName = imgName;
-        }
-
-        @Override
-        public boolean equals(Object o) {
-            if (this == o) return true;
-            if (o == null || getClass() != o.getClass()) return false;
-            CacheKey cacheKey = (CacheKey) o;
-            return Objects.equals(postId, cacheKey.postId) &&
-                    Objects.equals(imgName, cacheKey.imgName);
-        }
-
-        @Override
-        public int hashCode() {
-            return Objects.hash(postId, imgName);
-        }
-    }
-}