13 Commits
Author SHA1 Message Date
Violin 6b2bc26af3 fix(benchmark): seed engage brief, close phase-skip loophole, evidence-backed coverage 2026-08-11 17:09:35 +01:00
Violin 48a4f214d6 feat(guard): add receipt integrity verifier, fail-closed state parsers, and guard runtime tests 2026-08-10 08:54:56 +01:00
Violin 4b21dce94a feat: harden benchmark evaluation and guard runtime 2026-08-08 13:29:11 +01:00
3b21e0a92a feat: Automated Benchmark Runner and Evaluation Framework (#68)
* fix: bump distribution version to 3.0.1

* feat(benchmark): introduce benchmark runner engine, Docker containerization, and calibration datasets

* Fix URL/path scope exclusions and update duck-store template

- Modified targets.py to ensure that excluding a specific URL or path does not result in the entire host being blocked. Implemented a strict command payload check for excluded endpoints.

- Updated duck-store benchmark scope template to explicitly block the /vulnerabilities endpoint (which leaks intentional challenges) while allowing access to endpoint documentation.

* fix: correct scope.yaml indentation and refine guard blocking messages

* fix: resolve ModuleNotFoundError when score.py is executed directly

---------

Co-authored-by: Dan <dan@strategicautomation.local>
2026-08-08 13:29:11 +01:00
Violin 6860f30876 style: format code with ruff 2026-07-26 17:11:10 +01:00
Violin 1e04f565b0 feat(guard): replace custom shell regexes with bashlex AST parsing 2026-07-26 17:11:05 +01:00
Violin 06a60afa47 feat(guard): upgrade IP/CIDR scope policy arithmetic to netaddr IPSet and yarl URL parsing 2026-07-26 17:10:27 +01:00
Violin 7ee714a6ce fix(guard): resolve file path resolution and bootstrap issues 2026-07-26 16:03:02 +01:00
Violin 58be36d628 refactor(guard): flatten resolve_target nesting from depth 5 to 2 via strategy helpers 2026-07-25 14:26:53 +01:00
Violin b274364118 feat: implement violin_guard plugin for secure pentest execution, target policy enforcement, and workflow orchestration 2026-07-25 14:13:38 +01:00
Violin 5873cf9ddd fix CodeQL quality findings (v2.0.6) 2026-07-19 00:03:08 +01:00
Violin 22560d57b4 block secondary-only primary targets (#2) 2026-07-18 23:19:50 +01:00
Violin 5870509fdb feat: implement violin_guard plugin for centralized command execution auditing, terminal policy enforcement, and history tracking. 2026-07-17 20:14:20 +01:00