Malin/krawl.es
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
241 Commits 1 Branch 0 Tags
8c81dccc3bdac5ab883e0c8be22f1ea7f0e87851
Commit Graph

18 Commits

Author SHA1 Message Date
carnivuth
d8220b2429 added parameter in config file to disable backup job 2026-02-22 16:01:39 +01:00
carnivuth
17b657744b set default port to 5000 2026-02-15 18:07:39 +01:00
Patrick Di Fazio
771174c6a9 added raw request handling, enanched attack detection for GET and POSTS, templatized suspicioius activity to fetch from wordlists.json, aligned helm to load new wordlist config, added migration scripts from 1.0.0 to new krawl versions, removed old and unused functions, added test scripts 2026-02-08 16:02:18 +01:00
carnivuth
7621932602 added task dump krawl data and adjusted configuration files 2026-02-05 17:26:06 +01:00
carnivuth
35c8a90013 addd exports path configuration variable and default values, restored old filename 2026-02-02 14:19:40 +01:00
Lorenzo Venerandi
b253828cd7 Feat/release 1.0.0 (#63) 
* Feat: update Kubernetes manifests for Krawl deployment and improve resource labels

* Feat: update version to 1.0.0 in Helm chart and related files; add timezone to README

* Feat: enhance configuration options for handling malicious IPs and update dashboard secret path

* Fix: standardize boolean value handling in environment configuration
 2026-01-29 14:32:10 +01:00
Lorenzo Venerandi
e93bcb959a Doc/updated documentation (#60) 
* added documentation, updated repo pointer in the dashboard, added dashboard link highlighting and mionor fixes

* added doc

* added logo to dashboard

* Fixed dashboard attack chart

* Enhance fake data generation with varied request counts for better visualization

* Add automatic migrations and support for latitude/longitude in IP stats

* Update Helm chart version to 0.2.2 and add timezone configuration option

---------

Co-authored-by: BlessedRebuS <patrick.difa@gmail.com>
 2026-01-29 11:55:06 +01:00
Lorenzo Venerandi
8c76f6c847 Feat/deployment update (#56) 
* feat: update analyzer thresholds and add crawl configuration options

* feat: update Helm chart version and add README for installation instructions

* feat: update installation instructions in README and add Docker support

* feat: update deployment manifests and configuration for improved service handling and analyzer settings

* feat: add API endpoint for paginated IP retrieval and enhance dashboard visualization with category filters

* feat: update configuration for Krawl service to use external config file

* feat: refactor code for improved readability and consistency across multiple files

* feat: remove Flake8, Pylint, and test steps from PR checks workflow
 2026-01-26 12:36:22 +01:00
carnivuth
9d9a718aec feat:removed manual timezone management, delegate timezone configuration to execution environment 
removed code that manages timezone setup from config file, krawl now
obeys to the environment configuration
 2026-01-17 18:06:09 +01:00
Patrick Di Fazio
c65dca850c restored port 2026-01-10 20:06:33 +01:00
Patrick Di Fazio
c2dbcf588c added iprep to the dashboard, fixed bugs 2026-01-10 20:00:33 +01:00
Patrick Di Fazio
b61461d028 fixed categorization visualization, fixed date in the dashboard, fixed attack regex detection 2026-01-08 19:20:22 +01:00
Phillip Tarrant
b6c3710ca3 Merge branch 'dev' into feat/scoring-alogorithm 2026-01-07 11:43:58 -06:00
Patrick Di Fazio
4478c60956 added krawl homepage to templates 2026-01-05 17:07:10 +01:00
Leonardo Bambini
bf02fdb351 modified default analyzer values 2026-01-05 10:01:51 +01:00
Leonardo Bambini
ff98a77e1a parametrized into config.yaml + bug fix 2026-01-04 22:20:10 +01:00
Phillip Tarrant
4c490e30cb fixing dashboard to ensure starts with forward slash, put back the server_header option to allow pinning 2026-01-03 13:56:16 -06:00
Phillip Tarrant
d458eb471d Migrate configuration from environment variables to YAML file 
- Add YAML-based configuration loaded from config.yaml (CONFIG_LOCATION env var)
  - Add PyYAML dependency and install requirements in Dockerfile
  - Replace Config.from_env() with get_config() singleton pattern
  - Remove server_header from config (now randomized from wordlists only)
  - Update docker-compose.yaml to mount config.yaml read-only
  - Update Helm chart: restructure values.yaml, generate config.yaml in ConfigMap
  - Update Kubernetes manifests: ConfigMap now contains config.yaml, deployments mount it
  - Remove Helm secret.yaml (dashboard path now auto-generated in config.yaml)
 2026-01-02 13:39:54 -06:00