Files
Julius Brussee 6c3e2f6147 Add benchmarks suite and update README
Add a benchmarks directory with prompts.json, requirements.txt, results/.gitkeep, and run.py to measure Claude output token counts (normal vs caveman) using the Anthropic client. run.py supports dry-run, multiple trials, saving JSON results, computing stats, and optionally updating the README benchmark table; it reads the caveman SKILL.md for the system prompt. Also add .gitignore entries and expand README.md with badges, a Benchmarks section, sample table, and usage instructions.
2026-04-05 19:25:25 +02:00

56 lines
2.6 KiB
JSON

{
"version": 1,
"prompts": [
{
"id": "react-rerender",
"category": "debugging",
"prompt": "Why is my React component re-rendering on every state update even though the props haven't changed? I'm passing an object as a prop."
},
{
"id": "auth-middleware-fix",
"category": "bugfix",
"prompt": "My Express auth middleware is letting expired JWT tokens through. The expiry check uses Date.now() compared to the token's exp field. What's wrong and how do I fix it?"
},
{
"id": "postgres-pool",
"category": "setup",
"prompt": "How do I set up a PostgreSQL connection pool in Node.js with proper timeout and error handling configuration?"
},
{
"id": "git-rebase-merge",
"category": "explanation",
"prompt": "Explain the difference between git rebase and git merge. When should I use each one and what are the tradeoffs?"
},
{
"id": "async-refactor",
"category": "refactor",
"prompt": "Refactor this callback-based Node.js function to use async/await:\n\nfunction getUser(id, callback) {\n db.query('SELECT * FROM users WHERE id = ?', [id], function(err, rows) {\n if (err) return callback(err);\n if (!rows.length) return callback(new Error('Not found'));\n callback(null, rows[0]);\n });\n}"
},
{
"id": "microservices-monolith",
"category": "architecture",
"prompt": "We have a monolithic Django app that's getting slow. The team is debating microservices. What are the key factors to consider before splitting up the monolith?"
},
{
"id": "pr-security-review",
"category": "code-review",
"prompt": "Review this Express route handler for security issues:\n\napp.get('/api/users/:id', (req, res) => {\n const query = `SELECT * FROM users WHERE id = ${req.params.id}`;\n db.query(query).then(user => res.json(user));\n});"
},
{
"id": "docker-multi-stage",
"category": "devops",
"prompt": "Write a multi-stage Dockerfile for a Node.js TypeScript application that minimizes the final image size. The app uses npm and needs to compile TypeScript before running."
},
{
"id": "race-condition-debug",
"category": "debugging",
"prompt": "My Node.js API endpoint that increments a counter in PostgreSQL sometimes returns the same value for concurrent requests. How do I fix this race condition?"
},
{
"id": "error-boundary",
"category": "implementation",
"prompt": "Implement a React error boundary component that catches render errors, shows a fallback UI with a retry button, and logs the error details."
}
]
}