Commit Graph

138 Commits

Author SHA1 Message Date
carnivuth
2e2e4d65d0 linted code 2026-01-29 23:23:52 +01:00
carnivuth
7e74896dfd refactor form for blocklist download 2026-01-29 23:23:52 +01:00
carnivuth
cadf77da44 added endpoint for blocklist download api 2026-01-29 23:22:39 +01:00
carnivuth
639ce9c132 added firewall strategy pattern 2026-01-29 23:22:39 +01:00
carnivuth
04549cc57c added api endpoint to list public malicious ips 2026-01-29 23:22:39 +01:00
Lorenzo Venerandi
b253828cd7 Feat/release 1.0.0 (#63)
* Feat: update Kubernetes manifests for Krawl deployment and improve resource labels

* Feat: update version to 1.0.0 in Helm chart and related files; add timezone to README

* Feat: enhance configuration options for handling malicious IPs and update dashboard secret path

* Fix: standardize boolean value handling in environment configuration
2026-01-29 14:32:10 +01:00
Lorenzo Venerandi
d3caa99ecc Fix/export malicious ip file creation (#62)
* Fix: update EXPORTS_DIR path to ensure correct directory structure

* Fix: remove unused imports and honeypot access check from export task
2026-01-29 13:54:07 +01:00
Lorenzo Venerandi
a778262701 Fix: update EXPORTS_DIR path to ensure correct directory structure (#61) 2026-01-29 12:52:48 +01:00
Lorenzo Venerandi
e93bcb959a Doc/updated documentation (#60)
* added documentation, updated repo pointer in the dashboard, added dashboard link highlighting and mionor fixes

* added doc

* added logo to dashboard

* Fixed dashboard attack chart

* Enhance fake data generation with varied request counts for better visualization

* Add automatic migrations and support for latitude/longitude in IP stats

* Update Helm chart version to 0.2.2 and add timezone configuration option

---------

Co-authored-by: BlessedRebuS <patrick.difa@gmail.com>
2026-01-29 11:55:06 +01:00
Lorenzo Venerandi
39d9d62247 Feat/attack map improvement (#58)
* Enhance geolocation functionality and improve unenriched IP retrieval logic

* Refactor test_insert_fake_ips.py to enhance geolocation data handling and improve IP data structure

* Refactor code for improved readability and consistency in database and geolocation utilities
2026-01-27 17:32:38 +01:00
Lorenzo Venerandi
5aca684df9 Feat/attack map improvement (#57)
* feat: enhance IP reputation management with city data and geolocation integration

* feat: enhance dashboard with city coordinates and improved marker handling

* feat: update chart version to 0.2.1 in Chart.yaml, README.md, and values.yaml

* feat: update logo format and size in README.md

* feat: improve location display logic in dashboard for attackers and IPs
2026-01-27 16:56:34 +01:00
Lorenzo Venerandi
8c76f6c847 Feat/deployment update (#56)
* feat: update analyzer thresholds and add crawl configuration options

* feat: update Helm chart version and add README for installation instructions

* feat: update installation instructions in README and add Docker support

* feat: update deployment manifests and configuration for improved service handling and analyzer settings

* feat: add API endpoint for paginated IP retrieval and enhance dashboard visualization with category filters

* feat: update configuration for Krawl service to use external config file

* feat: refactor code for improved readability and consistency across multiple files

* feat: remove Flake8, Pylint, and test steps from PR checks workflow
2026-01-26 12:36:22 +01:00
Lorenzo Venerandi
130e81ad64 Feat/dashboard improvements (#55)
* fixed external ip resoultion

* added dashboard logic division, filtering capabilities, geoip map, attacker stats

* refactor: replace print statements with applogger for error logging in DatabaseManager

* feat: add click listeners for IP cells in dashboard tables to fetch and display stats

---------

Co-authored-by: BlessedRebuS <patrick.difa@gmail.com>
2026-01-25 22:50:27 +01:00
Patrick Di Fazio
c7fe588bc4 fixed external ip resoultion (#54) 2026-01-25 01:19:30 +01:00
Lorenzo Venerandi
10b1930a60 Merge pull request #53 from BlessedRebuS/feat/ip-log-improvements
added ip logging memory improvements, added local ip and public ip ex…
2026-01-24 23:38:52 +01:00
BlessedRebuS
14d616fae3 added ip logging memory improvements, added local ip and public ip exlusion 2026-01-24 23:28:10 +01:00
Longhi Matteo
02e2aee950 Merge pull request #51 from BlessedRebuS/fix/env-config-override
Add logging for environment variable overrides in config
2026-01-23 22:29:04 +01:00
Lorenzo Venerandi
4addf41a5b Add logging for environment variable overrides in config 2026-01-23 22:26:14 +01:00
Longhi Matteo
6ffe2ac2e4 Merge pull request #49 from BlessedRebuS/feat/helm
Upgrade helm with new configuration values
2026-01-23 22:07:54 +01:00
Lorenzo Venerandi
3341b8a1b9 fixed workflow check 2026-01-23 22:03:47 +01:00
Lorenzo Venerandi
4450d3a4e3 Linted code iwht black tool 2026-01-23 22:00:21 +01:00
Lorenzo Venerandi
25384585d9 Bump chart version to 0.1.5 and app version to 0.1.7 2026-01-23 21:51:20 +01:00
Lorenzo Venerandi
5ce4ab1955 Add analyzer configuration parameters to configmap and values files 2026-01-23 21:50:45 +01:00
leonardobambini
4e4c370b72 added site depth limit mechanism (#48)
* added site depth limit mechanism

* modified max pages limit and ban duration seconds

---------

Co-authored-by: Leonardo Bambini <lbambini@Leonardos-MacBook-Air.local>
Co-authored-by: BlessedRebuS <patrick.difa@gmail.com>
2026-01-23 21:33:32 +01:00
Lorenzo Venerandi
223883a781 Configuration override from environment variable (#47)
* Add environment variable override for config fields

Introduces functions to override configuration fields from environment variables, allowing dynamic configuration without modifying YAML files. The environment variable names are generated from field names, and type conversion is handled for int, float, and tuple fields.

* update chart version to 0.1.4

* Update README.md to enhance environment variable configuration details and improve overall clarity
2026-01-23 17:34:23 +01:00
Lorenzo Venerandi
e1444e44ee Merge pull request #44 from BlessedRebuS/fix/dashboard
Fix/dashboard
2026-01-22 15:10:11 +01:00
Lorenzo Venerandi
aaaf1d35d6 Fixed docker build and helm package workflows (invalid tagging) (#46)
* feat: update Helm and Docker workflows to extract chart name and version, and improve tagging logic

* fix: add github-actions-ci branch to workflow triggers for Docker and Helm packaging

* fix: add helm-package-push.yml to workflow paths for triggering on changes

* fix: improve appVersion extraction in Docker workflow and add error handling

* fix: enhance appVersion extraction with debugging output and error message

* fix: improve error handling for appVersion extraction in Docker and Helm workflows

* fix: simplify chart info extraction in Helm workflow and remove error handling

* fix: update chart info extraction to use awk for improved parsing

* fix: streamline chart info extraction in Helm workflow by removing unnecessary step and directly parsing values

* fix: remove newline characters from chart version and name extraction in Helm workflow

* Fix newline

* Update helm-package-push.yml

* Removed claude brainrot

* Update helm-package-push.yml
2026-01-22 13:02:18 +01:00
Patrick Di Fazio
b42bfdffaa Merge pull request #45 from BlessedRebuS/github-actions-ci
GitHub actions CI and helm version alignment
2026-01-22 11:30:13 +01:00
Lorenzo Venerandi
9b74a7844d fix: update Bandit security check to use txt output and improve HIGH severity detection 2026-01-22 11:24:41 +01:00
Lorenzo Venerandi
28a8880c0a fix: add error handling to Bandit security check commands 2026-01-22 11:22:03 +01:00
Lorenzo Venerandi
dcfdb23b0c feat: enhance Bandit security check to enforce HIGH severity issue detection 2026-01-22 11:20:46 +01:00
Lorenzo Venerandi
bea9489a12 feat: update Helm chart version and appVersion to 0.1.3 and 1.0.6 respectively 2026-01-22 11:13:35 +01:00
Lorenzo Venerandi
261a7b26b9 feat: add GitHub Actions workflows for PR checks and security scans 2026-01-22 11:10:04 +01:00
Lorenzo Venerandi
143b301bcb feat: add Kubernetes validation workflow for pull requests 2026-01-22 10:57:28 +01:00
Lorenzo Venerandi
2ff6bb34b2 feat: add GitHub Actions workflow for packaging and pushing Helm charts 2026-01-22 10:51:11 +01:00
Lorenzo Venerandi
adbbe4d4ea feat: add GitHub Actions workflow for building and pushing Docker images 2026-01-22 10:39:09 +01:00
Patrick Di Fazio
ac936978da Merge branch 'dev' into fix/dashboard 2026-01-17 23:09:14 +01:00
Patrick Di Fazio
fa8403c5a9 Merge pull request #42 from BlessedRebuS/feat/task-optimization
Optimize scheduled tasks to reduce unnecessary processing
2026-01-17 23:06:30 +01:00
BlessedRebuS
6f07ab8409 Removed old Dockerfile, added volume name 2026-01-17 23:05:47 +01:00
BlessedRebuS
59d99484e9 fixed dashboard alignment 2026-01-17 22:43:42 +01:00
Patrick Di Fazio
2dd35234c0 fixed dashboard alignment 2026-01-17 22:41:19 +01:00
carnivuth
00b222b754 added development docker compose file 2026-01-17 18:12:41 +01:00
carnivuth
8deabe8ce0 added direnv file 2026-01-17 18:06:27 +01:00
carnivuth
9d9a718aec feat:removed manual timezone management, delegate timezone configuration to execution environment
removed code that manages timezone setup from config file, krawl now
obeys to the environment configuration
2026-01-17 18:06:09 +01:00
Phillip Tarrant
541b5d0f1b Optimize scheduled tasks to reduce unnecessary processing
- Add conditional execution to export-malicious-ips task: only runs
    when honeypot was accessed in last 5 minutes
  - Add since_minutes parameter to get_access_logs() for time filtering
  - Optimize analyze-ips task to only process IPs with activity in the
    last minute, fetching full history per-IP instead of all logs
  - Exclude RFC1918 private addresses and non-routable IPs from IP
    reputation enrichment (10.x, 172.16-31.x, 192.168.x, 127.x, 169.254.x)
2026-01-15 13:30:35 -06:00
Patrick Di Fazio
554bd486da Merge pull request #39 from luismco/logo
Adds SVG logo
2026-01-14 13:51:22 +01:00
Luís Oliveira
f5e403a5f4 Rename krawl.svg to krawl-svg.svg 2026-01-14 12:19:30 +00:00
Luís Oliveira
d39d33c337 Adds SVG logo 2026-01-14 12:19:01 +00:00
Patrick Di Fazio
323aa0d15d Merge pull request #36 from BlessedRebuS/bug/db-locked-fix
Bug/db locked fix
2026-01-10 22:31:03 +01:00
Phillip Tarrant
72a213387e fixing requirements file to versioned pull for request 2026-01-10 15:17:16 -06:00