Add OpenClaw local and Mac mini setup skill

2026-08-22 12:49:53 +02:00 · 2026-02-21 09:54:14 -05:00
parent 2639af6531
commit b3be11e88e
17 changed files with 672 additions and 0 deletions
@@ -0,0 +1,39 @@
+---
+name: agent-evals
+description: Build automated evaluation suites for AI agents using golden datasets, rubrics, and regression gates.
+license: MIT
+metadata:
+  author: devops-skills
+  version: "1.0"
+---
+
+# Agent Evals
+
+Create repeatable checks so agent behavior improves safely over time.
+
+## Evaluation Layers
+
+- Unit evals: prompt-level correctness
+- Tool evals: API/tool call decision quality
+- End-to-end evals: realistic multi-step tasks
+- Safety evals: prompt injection and data leak resistance
+
+## CI/CD Integration
+
+```bash
+# Example eval pipeline steps
+make evals-smoke
+make evals-regression
+make evals-safety
+```
+
+## Best Practices
+
+- Version datasets with expected outputs.
+- Track pass rates and score drift over time.
+- Block deploys on critical safety regressions.
+
+## Related Skills
+
+- [github-actions](../../ci-cd/github-actions/) - Eval automation in CI
+- [ai-agent-security](../../../security/ai/ai-agent-security/) - Security-focused eval cases