9fa9ac25a4
feat: add workflow eval framework ( #32 )
...
* feat: add workflow eval framework
Add workflow evaluation scenarios, rubrics, schemas, and runner scripts for installed Truthmark workflows.
Move research notes under docs/research and migrate tests from Vitest to node:test.
* Potential fix for pull request finding 'CodeQL / Replacement of a substring with itself'
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
---------
Co-authored-by: MerlinH <merlinh221@gmail.com >
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2026-06-30 20:57:55 +10:00
e9cd67f0b5
refactor: remove semantic repository index ( #17 )
...
* docs: replace legacy truth path references
* feat: fold contextpack into workflow status
* refactor: remove semantic repository index
* fix: remove vulnerable frontmatter dependency
* feat: broaden truth sync write authorization
* test: restore workflow state regression coverage
---------
Co-authored-by: MerlinH <merlinh221@gmail.com >
2026-06-16 11:03:04 +10:00
a083b703fa
feat: add Truthmark health scorecard and bounded workflow contracts ( #13 )
...
* feat: add OpenSpec-driven workflow state
* docs: plan generated playbooks workflow contract
* feat: add truth health scorecard
Release Truthmark 2.1.0 with check JSON scorecard output.
Archive the completed OpenSpec pass 4 scorecard change and update generated truth surfaces.
* fix: unblock truthmark scorecard review
- restore and update coverage for scorecard/evidence/workflow behavior
- make truthmark-sync select a cheap local base when --base is omitted
- report malformed evidence YAML blocks as diagnostics instead of throwing
* fix: tighten workflow boundaries
* fix: fail closed when sync has no comparison base
* fix: tighten truth health review coverage
- only parse fenced YAML evidence blocks with top-level evidence markers
- convert coverage fixtures to valid v2 config and assert non-vacuous diagnostics
- update Truthmark truth docs for source traceability and workflow-state tests
* docs: clarify source traceability diagnostics
* docs: harden optional CLI workflow boundary
* docs: clarify product boundary is repo-local
* fix: bound truthmark workflow fallback behavior
- make live workflow preflight use the one-call instructions contract
- keep missing-CLI fallback bounded for Sync, Document, Structure, and Realize
- add routing and generated-surface coverage plus refreshed host surfaces
* test: cover no-cli workflow fallback bounds
- assert route-first fallback wording in generated workflow surfaces
- clarify progressive-disclosure support files are conditional
- align overview docs with bounded no-CLI behavior
* docs: route workflow eval coverage
* fix: remove workflow instructions preflight
* fix: remove stale workflow preflight wording
* fix: remove generic workflow validation blocks
* fix: avoid duplicated markdown context JSON
* fix: keep workflow status manifest-only
* docs: align truth docs with v2 hierarchy
---------
Co-authored-by: MerlinH <merlinh221@gmail.com >
2026-06-13 04:09:45 +10:00
MerlinH and GitHub
caced773f5
1.2.4 strengthen truth workflow ownership and evidence gates ( #3 )
...
* refactor(truthmark): parameterize truth agent paths with routing config
* 1.2.4 truth flow research
* Context and workflow optimization
2026-05-15 08:58:31 +10:00
