mirror of
https://github.com/merlinhu1/truthmark.git
synced 2026-08-25 07:53:25 +02:00
Merlin's CatGitHubCopilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>MerlinHCopilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>* feat: add workflow eval framework Add workflow evaluation scenarios, rubrics, schemas, and runner scripts for installed Truthmark workflows. Move research notes under docs/research and migrate tests from Vitest to node:test. * Potential fix for pull request finding 'CodeQL / Replacement of a substring with itself' Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com> --------- Co-authored-by: MerlinH <merlinh221@gmail.com> Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
22 lines
567 B
YAML
22 lines
567 B
YAML
id: implement-truth-without-doc-edits
|
|
workflow: truthmark-realize
|
|
priority: high
|
|
manual_only: true
|
|
summary: Truth Realize should change code without editing truth docs.
|
|
fixture: fixture
|
|
prompt: prompt.md
|
|
expected: expected.yaml
|
|
requires:
|
|
generated_surfaces: false
|
|
truthmark_config: true
|
|
git_repo: true
|
|
grading:
|
|
deterministic:
|
|
- changed-files
|
|
- write-boundary
|
|
- report-presence
|
|
llm_judges:
|
|
- workflow-eval-framwork/judges/trace-grader.md
|
|
- workflow-eval-framwork/judges/diff-grader.md
|
|
- workflow-eval-framwork/judges/report-grader.md
|