Commit Graph

128 Commits

Author SHA1 Message Date
carnivuth
e4cf4702eb added api endpoint to list public malicious ips 2026-01-27 00:09:27 +01:00
Lorenzo Venerandi
8c76f6c847 Feat/deployment update (#56)
* feat: update analyzer thresholds and add crawl configuration options

* feat: update Helm chart version and add README for installation instructions

* feat: update installation instructions in README and add Docker support

* feat: update deployment manifests and configuration for improved service handling and analyzer settings

* feat: add API endpoint for paginated IP retrieval and enhance dashboard visualization with category filters

* feat: update configuration for Krawl service to use external config file

* feat: refactor code for improved readability and consistency across multiple files

* feat: remove Flake8, Pylint, and test steps from PR checks workflow
2026-01-26 12:36:22 +01:00
Lorenzo Venerandi
130e81ad64 Feat/dashboard improvements (#55)
* fixed external ip resoultion

* added dashboard logic division, filtering capabilities, geoip map, attacker stats

* refactor: replace print statements with applogger for error logging in DatabaseManager

* feat: add click listeners for IP cells in dashboard tables to fetch and display stats

---------

Co-authored-by: BlessedRebuS <patrick.difa@gmail.com>
2026-01-25 22:50:27 +01:00
Patrick Di Fazio
c7fe588bc4 fixed external ip resoultion (#54) 2026-01-25 01:19:30 +01:00
Lorenzo Venerandi
10b1930a60 Merge pull request #53 from BlessedRebuS/feat/ip-log-improvements
added ip logging memory improvements, added local ip and public ip ex…
2026-01-24 23:38:52 +01:00
BlessedRebuS
14d616fae3 added ip logging memory improvements, added local ip and public ip exlusion 2026-01-24 23:28:10 +01:00
Longhi Matteo
02e2aee950 Merge pull request #51 from BlessedRebuS/fix/env-config-override
Add logging for environment variable overrides in config
2026-01-23 22:29:04 +01:00
Lorenzo Venerandi
4addf41a5b Add logging for environment variable overrides in config 2026-01-23 22:26:14 +01:00
Longhi Matteo
6ffe2ac2e4 Merge pull request #49 from BlessedRebuS/feat/helm
Upgrade helm with new configuration values
2026-01-23 22:07:54 +01:00
Lorenzo Venerandi
3341b8a1b9 fixed workflow check 2026-01-23 22:03:47 +01:00
Lorenzo Venerandi
4450d3a4e3 Linted code iwht black tool 2026-01-23 22:00:21 +01:00
Lorenzo Venerandi
25384585d9 Bump chart version to 0.1.5 and app version to 0.1.7 2026-01-23 21:51:20 +01:00
Lorenzo Venerandi
5ce4ab1955 Add analyzer configuration parameters to configmap and values files 2026-01-23 21:50:45 +01:00
leonardobambini
4e4c370b72 added site depth limit mechanism (#48)
* added site depth limit mechanism

* modified max pages limit and ban duration seconds

---------

Co-authored-by: Leonardo Bambini <lbambini@Leonardos-MacBook-Air.local>
Co-authored-by: BlessedRebuS <patrick.difa@gmail.com>
2026-01-23 21:33:32 +01:00
Lorenzo Venerandi
223883a781 Configuration override from environment variable (#47)
* Add environment variable override for config fields

Introduces functions to override configuration fields from environment variables, allowing dynamic configuration without modifying YAML files. The environment variable names are generated from field names, and type conversion is handled for int, float, and tuple fields.

* update chart version to 0.1.4

* Update README.md to enhance environment variable configuration details and improve overall clarity
2026-01-23 17:34:23 +01:00
Lorenzo Venerandi
e1444e44ee Merge pull request #44 from BlessedRebuS/fix/dashboard
Fix/dashboard
2026-01-22 15:10:11 +01:00
Lorenzo Venerandi
aaaf1d35d6 Fixed docker build and helm package workflows (invalid tagging) (#46)
* feat: update Helm and Docker workflows to extract chart name and version, and improve tagging logic

* fix: add github-actions-ci branch to workflow triggers for Docker and Helm packaging

* fix: add helm-package-push.yml to workflow paths for triggering on changes

* fix: improve appVersion extraction in Docker workflow and add error handling

* fix: enhance appVersion extraction with debugging output and error message

* fix: improve error handling for appVersion extraction in Docker and Helm workflows

* fix: simplify chart info extraction in Helm workflow and remove error handling

* fix: update chart info extraction to use awk for improved parsing

* fix: streamline chart info extraction in Helm workflow by removing unnecessary step and directly parsing values

* fix: remove newline characters from chart version and name extraction in Helm workflow

* Fix newline

* Update helm-package-push.yml

* Removed claude brainrot

* Update helm-package-push.yml
2026-01-22 13:02:18 +01:00
Patrick Di Fazio
b42bfdffaa Merge pull request #45 from BlessedRebuS/github-actions-ci
GitHub actions CI and helm version alignment
2026-01-22 11:30:13 +01:00
Lorenzo Venerandi
9b74a7844d fix: update Bandit security check to use txt output and improve HIGH severity detection 2026-01-22 11:24:41 +01:00
Lorenzo Venerandi
28a8880c0a fix: add error handling to Bandit security check commands 2026-01-22 11:22:03 +01:00
Lorenzo Venerandi
dcfdb23b0c feat: enhance Bandit security check to enforce HIGH severity issue detection 2026-01-22 11:20:46 +01:00
Lorenzo Venerandi
bea9489a12 feat: update Helm chart version and appVersion to 0.1.3 and 1.0.6 respectively 2026-01-22 11:13:35 +01:00
Lorenzo Venerandi
261a7b26b9 feat: add GitHub Actions workflows for PR checks and security scans 2026-01-22 11:10:04 +01:00
Lorenzo Venerandi
143b301bcb feat: add Kubernetes validation workflow for pull requests 2026-01-22 10:57:28 +01:00
Lorenzo Venerandi
2ff6bb34b2 feat: add GitHub Actions workflow for packaging and pushing Helm charts 2026-01-22 10:51:11 +01:00
Lorenzo Venerandi
adbbe4d4ea feat: add GitHub Actions workflow for building and pushing Docker images 2026-01-22 10:39:09 +01:00
Patrick Di Fazio
ac936978da Merge branch 'dev' into fix/dashboard 2026-01-17 23:09:14 +01:00
Patrick Di Fazio
fa8403c5a9 Merge pull request #42 from BlessedRebuS/feat/task-optimization
Optimize scheduled tasks to reduce unnecessary processing
2026-01-17 23:06:30 +01:00
BlessedRebuS
6f07ab8409 Removed old Dockerfile, added volume name 2026-01-17 23:05:47 +01:00
BlessedRebuS
59d99484e9 fixed dashboard alignment 2026-01-17 22:43:42 +01:00
Patrick Di Fazio
2dd35234c0 fixed dashboard alignment 2026-01-17 22:41:19 +01:00
carnivuth
00b222b754 added development docker compose file 2026-01-17 18:12:41 +01:00
carnivuth
8deabe8ce0 added direnv file 2026-01-17 18:06:27 +01:00
carnivuth
9d9a718aec feat:removed manual timezone management, delegate timezone configuration to execution environment
removed code that manages timezone setup from config file, krawl now
obeys to the environment configuration
2026-01-17 18:06:09 +01:00
Phillip Tarrant
541b5d0f1b Optimize scheduled tasks to reduce unnecessary processing
- Add conditional execution to export-malicious-ips task: only runs
    when honeypot was accessed in last 5 minutes
  - Add since_minutes parameter to get_access_logs() for time filtering
  - Optimize analyze-ips task to only process IPs with activity in the
    last minute, fetching full history per-IP instead of all logs
  - Exclude RFC1918 private addresses and non-routable IPs from IP
    reputation enrichment (10.x, 172.16-31.x, 192.168.x, 127.x, 169.254.x)
2026-01-15 13:30:35 -06:00
Patrick Di Fazio
554bd486da Merge pull request #39 from luismco/logo
Adds SVG logo
2026-01-14 13:51:22 +01:00
Luís Oliveira
f5e403a5f4 Rename krawl.svg to krawl-svg.svg 2026-01-14 12:19:30 +00:00
Luís Oliveira
d39d33c337 Adds SVG logo 2026-01-14 12:19:01 +00:00
Patrick Di Fazio
323aa0d15d Merge pull request #36 from BlessedRebuS/bug/db-locked-fix
Bug/db locked fix
2026-01-10 22:31:03 +01:00
Phillip Tarrant
72a213387e fixing requirements file to versioned pull for request 2026-01-10 15:17:16 -06:00
Phillip Tarrant
66d970ef92 Merge pull request #35 from BlessedRebuS/fix/requirements
added requests
2026-01-10 15:15:22 -06:00
Phillip Tarrant
0e0639ba8b adding requests to requirements 2026-01-10 15:14:17 -06:00
Phillip Tarrant
f7b9ee54e3 Fix SQLite "database is locked" errors in fetch_ip_rep task
- Add missing session.commit() and cleanup to update_ip_rep_infos() **bugfix**
  - Enable SQLite WAL mode and 30s busy timeout for better concurrency **race condition prevention**
  - Add get_unenriched_ips() method to only fetch IPs needing enrichment **don't enrich what's already done*
  - Rewrite fetch_ip_rep task to process only unenriched IPs (limit 50) **API kindness**
  - Change task frequency from every 1 minute to every 5 minutes **API kindness**
  - Add request timeout (10s) and proper error handling **can update to longer if needed**
2026-01-10 14:59:15 -06:00
Patrick Di Fazio
5d25fb9d6b added requests 2026-01-10 21:37:16 +01:00
Phillip Tarrant
edaafb0263 Merge pull request #34 from BlessedRebuS/feat/scoring-alogorithm
Feat/scoring alogorithm
2026-01-10 13:30:18 -06:00
Patrick Di Fazio
c65dca850c restored port 2026-01-10 20:06:33 +01:00
Patrick Di Fazio
c2dbcf588c added iprep to the dashboard, fixed bugs 2026-01-10 20:00:33 +01:00
Leonardo Bambini
77196952d1 made ip analysis and ip rep info fetch a scheduled task 2026-01-10 14:53:31 +01:00
Patrick Di Fazio
5a57c0774f Merge pull request #30 from BlessedRebuS/feat/background-tasks
Feat/background tasks
2026-01-09 20:39:38 +01:00
Patrick Di Fazio
431a42aa0a removed exports 2026-01-09 20:39:25 +01:00