mirror of
https://github.com/rennf93/roboco.git
synced 2026-08-03 07:23:24 +02:00
* fix(gateway): push the branch before QA handoff so reviewers see the latest commits The commit content tool commits locally without pushing; only open_pr pushed the branch. On the first submission that was fine, but a fix committed while addressing needs_revision never reached origin (open_pr is skipped once the PR exists), so QA — which reviews the remote PR branch — re-reviewed the stale remote and re-failed the task on every cycle, a loop that never converged. i_am_done now pushes the task branch (idempotent; a no-op when nothing is unpushed) as part of the shared submit gate, covering both the normal and resume-from-verifying paths. A push failure blocks the handoff with a clear remediation rather than parking the task in awaiting_qa with commits that exist only in the developer's local workspace. * fix(orchestrator): don't reap a stale claim while the agent's container is alive The stale-claim reaper released any claimed/in_progress task whose last_heartbeat_at exceeded the TTL. The heartbeat only updates on certain gateway calls, so a developer deep in a long edit/test cycle outran the TTL and had its claim reaped mid-work — churning the task and risking a double spawn against the still-running container. The reaper now skips a task whose assignee still holds a live (ACTIVE) agent instance, trusting container liveness — the ground truth — over the heartbeat proxy. The check is defensive on missing fields so a heartbeat-only caller (and the reaper's existing unit tests) behave exactly as before. * fix(gateway): refuse to unblock a task while a dependency is unfinished A PM unblock on a dependency-gated task moved it straight to in_progress, overriding the dependency — letting a dependent proceed without its upstream's work (e.g. a frontend task built before its UX design lands). A dependency block is meant to clear on its own via _unblock_dependents the moment the upstream reaches a terminal state. unblock now refuses while any dependency is still non-terminal, returning a clear remediation that the block resolves automatically. Manual unblock remains available for genuine, non-dependency blockers. * fix(gateway): release a dependency-blocked claim to pending instead of looping A task that reached claimed/in_progress with an unfinished dependency was left in that state when the claim guard rejected, so the orchestrator's respawn loop kept reviving its assignee — which could make no progress — burning work for nothing. The claim guard now releases such a task back to pending. claimed -> blocked is not a legal transition, so pending — held by the dispatch dependency filter — is the lifecycle-correct resting state: the respawn loop ignores pending tasks, and _unblock_dependents re-dispatches it once the upstream reaches a terminal state. release_dependency_blocked_claim shares a _force_unclaim_to_pending core with unclaim_for_reaper so both record a truthful work-session abandon reason. * feat(security): warn at startup in header-trust mode + document the auth posture When ROBOCO_AGENT_AUTH_REQUIRED is not enabled the API accepts the X-Agent-Id / X-Agent-Role headers without a signed token, so any client that can reach it may act as any role (including 'ceo'). The API now logs a clear warning at startup in this mode, and the README gains a Security section documenting the auth posture and how to harden it. Acceptable only on a trusted private network — do not expose the API to untrusted networks. * fix(workspace): scope the refresh fetch to current + default branch ensure_workspace's healthy short-circuit ran an all-refs 'git fetch origin' to keep every origin/<branch> ref current. On a monorepo with many accumulated feature/* branches that exceeds the refresh timeout, the fetch silently fails, and the workspace keeps a stale base — so an agent builds on an out-of-date branch. The refresh now fetches only the workspace's current branch and the repo's default branch (resolved via origin/HEAD), with --no-tags --prune: it transfers near-nothing and can't time out. Readers need their own branch and the default; the integration branch is refreshed at branch-creation time. * fix(git): refresh a dependency-blocked task's branch off the current integration tip A cross-cell dependent (e.g. a frontend task waiting on the UX design) was branched off a base captured before its upstream merged into the integration branch, and the branch was never re-synced — so the agent built on a stale snapshot with none of the upstream's work. Two changes close the gap: - release_dependency_blocked_claim now clears branch_name, so the re-claim (after the dependency clears) re-runs branch creation. - create_branch, when the branch is already on disk with no commits of its own, resets it onto the freshly-pulled base — the dependent now builds on the current integration tip. A branch carrying real commits is left untouched, so no work is discarded; the cell->leaf cascade carries the upstream down to the dev branch automatically. * refactor(gateway): drop the sibling-sequence claim guard Sibling sequence no longer gates a claim. Cross-cell ordering is enforced by task dependencies — a cell task that depends on another is held until its upstream reaches a terminal state, a stronger, status-aware gate than the sequence-number check. That check was dormant in practice anyway: every fan-out child carries sequence 0, on which the guard short-circuited. `sequence` stays a sibling-ordering / dispatch-priority field (list_pending ordering and the panel). Removes sibling_sequence_guard and its _earlier_blocking_sibling helper, the now-unused skip_sequence parameter threaded through the claim verbs, and the sibling fetch that fed it. * feat(gateway): sort a cross-cell dependent after its upstream When the frontend cell task is wired to depend on its UX/UI sibling, set its sequence to the upstream's sequence + 1 so it sorts after the design it waits on — list_pending ordering and the panel now show UX ahead of the implementation it gates, in either delegation order. Adds TaskService.set_sequence (the sibling-ordering field is a service write; it carries no claim-gating semantics — dependencies gate claims). * feat(gateway): make the backend cell depend on UX too UX/UI design defines the screens and API contracts both implementation cells build against, so the backend cell — not just the frontend — waits on the UX/UI cell task in a product fan-out and sorts after it. Wires in either delegation order: a backend task delegated after UX gets the dependency directly; a UX task delegated after a still-pending backend sibling retro-wires it. Mirrors the existing frontend wiring (_depend_backend_on_ux and _depend_pending_backends_on_ux). Backend is held by the same dependency gate, so it costs no extra dispatch churn. * fix(websocket): forward notification acks instead of logging them incomplete The bridge handler serves both notification.sent and notification.acked, but acked events carry `agent_id` (the acking agent) rather than `recipient_id`, so every acknowledgement tripped the missing-field guard and logged "Incomplete notification event" instead of reaching the panel. Accept either field as the recipient. * feat(api): hint the full UUID when a truncated task id fails validation Agents copy the 8-character task prefix the system shows them (the commit prefix, task summaries) and send it as task_id, which fails UUID validation with an opaque "invalid length" 422 and wastes a call. The request-validation handler now detects a task_id UUID error and attaches a `remediate` hint telling the agent to retry with the full 36-character UUID from its task envelope. * fix(audit): record the blocked transition when a task is escalated Escalation sets a task to blocked by writing task.status directly, which bypassed the validated transition helper and so never emitted a task.blocked audit row — the lifecycle moved but the Auditor saw nothing. Extract the audit emit from the central transition helper into _emit_status_transition_audit and call it from the escalate path, capturing the prior status and outgoing owner before reassignment so the row is attributed correctly. * fix(docs): stop doubling the docs path so design specs index into RAG The documenter sometimes hands a doc path already rooted at docs/, and joining it onto DOCS_BASE_PATH (/app/docs) produced /app/docs/docs/..., so the file was never found and the spec never indexed — the frontend cell could not retrieve the UX design over RAG. Normalize the path before joining: trust an absolute path, otherwise strip a single redundant leading docs/ segment. * feat(security): let the control panel authenticate in secure mode With ROBOCO_AGENT_AUTH_REQUIRED=true every request must carry a valid HMAC token, which locked the human control panel out — it sends role headers but no token. nginx, the only trusted hop between the browser and the API, now injects the CEO token on /api and /ws, so the browser never holds the signing secret. The injected value is just the existing per-agent token issued for the CEO identity (issue_panel_token), so the token-verification path is unchanged. An empty value (dev/header-trust mode) renders to no header. `make panel-token` prints the value; set it as ROBOCO_PANEL_AGENT_TOKEN in .env before enabling secure mode. .env.example and the README Security section document the flow. * chore(compose): consolidate the two compose files into one docker-compose.yml and docker-compose.yaml had diverged: .yml — the file Docker actually uses — carried ROBOCO_PUBLIC_BASE_URL but was missing the /app/manifests bind-mount, while .yaml had the manifests mount but not the base URL. Merge the union into docker-compose.yml and delete the duplicate so there is one source of truth and no "multiple config files" warning. This activates the manifests mount in the deployed file: without it the orchestrator writes per-agent tool manifests to its ephemeral container fs, they never reach the host for the daemon to bind-mount, and agents fall back to all-verbs registration. Drop the stale .yaml reference from the config.py docstring, the labeler, and the CI path filters. --------- Co-authored-by: Renn F <rennf93@users.noreply.github.com>
259 lines
9.4 KiB
Markdown
259 lines
9.4 KiB
Markdown
# RoboCo
|
||
|
||
AI Agents Company - A virtual organization of 18 AI agents + 1 human CEO, designed to operate as a complete software development workforce.
|
||
|
||
<p align="center">
|
||
<img src="run.png" alt="RoboCo control panel: the task tree for a feature, showing Board → Main PM → Backend / Frontend / UX/UI cells → developer subtasks, with live lifecycle statuses (completed, in progress, awaiting PM review, paused) and real GitHub PRs (#59–#62)." width="100%">
|
||
</p>
|
||
|
||
> [!WARNING]
|
||
> **RoboCo is early-stage, work-in-progress software (v0).** It's under active
|
||
> development, runs in a homelab, and *will* have rough edges, breaking changes,
|
||
> and bugs. It is **not production-ready** and the API/database schema are not
|
||
> stable yet. Treat it as a working prototype to explore and build on — please
|
||
> don't expose it to the public internet as-is. Issues and PRs very welcome.
|
||
|
||
## Overview
|
||
|
||
RoboCo implements a structured organizational hierarchy with formal communication protocols, task management, and quality controls. The system enables a single human (CEO) to orchestrate complex multi-project development at scale.
|
||
|
||
```
|
||
CEO (Renzo - Human)
|
||
│
|
||
└── Board (3 agents)
|
||
├── Product Owner
|
||
├── Head of Marketing
|
||
└── Auditor (silent observer, reports to CEO)
|
||
│
|
||
└── Main PM (coordinates all cells)
|
||
│
|
||
├── Backend Cell (5 agents: 2 Devs, 1 QA, 1 PM, 1 Documenter)
|
||
├── Frontend Cell (5 agents: 2 Devs, 1 QA, 1 PM, 1 Documenter)
|
||
└── UX/UI Cell (4 agents: 1 Dev, 1 QA, 1 PM, 1 Documenter)
|
||
```
|
||
|
||
## Project Structure
|
||
|
||
```
|
||
roboco/
|
||
├── roboco/ # Main Python package
|
||
│ ├── api/ # FastAPI routes & schemas
|
||
│ │ ├── routes/ # API endpoints (tasks, git, agents, etc.)
|
||
│ │ └── schemas/ # Pydantic request/response models
|
||
│ ├── services/ # Business logic services
|
||
│ │ ├── task.py # Task lifecycle management
|
||
│ │ ├── workspace.py # Multi-agent workspace management
|
||
│ │ ├── messaging.py # Agent communication
|
||
│ │ └── optimal_brain/ # RAG/Knowledge base (piragi)
|
||
│ ├── models/ # Pydantic domain models
|
||
│ ├── db/ # SQLAlchemy ORM & migrations
|
||
│ ├── enforcement/ # Task lifecycle state machine
|
||
│ ├── runtime/ # Orchestrator for agent spawning
|
||
│ ├── agents/ # Agent base classes
|
||
│ ├── mcp/ # MCP server implementations
|
||
│ └── config.py # Application configuration
|
||
├── agents/
|
||
│ ├── blueprints/ # Agent system prompts (18 agents)
|
||
│ └── prompts/identities/ # Agent identity files
|
||
├── docs/
|
||
│ ├── architecture/ # Architecture documentation
|
||
│ └── workflows/ # Workflow documentation
|
||
├── alembic/ # Database migrations
|
||
├── CLAUDE.md # Claude Code guidance
|
||
└── docker-compose.yml # Local development stack
|
||
```
|
||
|
||
## Quick Start
|
||
|
||
```bash
|
||
# Install dependencies
|
||
uv sync
|
||
|
||
# Start PostgreSQL and Redis (Docker)
|
||
docker compose up -d
|
||
|
||
# Run database migrations
|
||
uv run alembic upgrade head
|
||
|
||
# Start the API server
|
||
uv run python -m roboco.cli
|
||
|
||
# Or just the API without orchestrator
|
||
uv run uvicorn roboco.api:app --reload --host 0.0.0.0 --port 8000
|
||
```
|
||
|
||
## Configuration
|
||
|
||
Key environment variables (see `roboco/config.py` for all options):
|
||
|
||
```bash
|
||
# API Server
|
||
ROBOCO_HOST=0.0.0.0
|
||
ROBOCO_PORT=8000
|
||
|
||
# Database
|
||
ROBOCO_DATABASE_HOST=localhost
|
||
ROBOCO_DATABASE_PORT=5432
|
||
ROBOCO_DATABASE_NAME=roboco
|
||
|
||
# Workspaces (Multi-Agent Git)
|
||
ROBOCO_WORKSPACES_ROOT=/data/workspaces
|
||
ROBOCO_WORKSPACE_AUTO_CLONE=true
|
||
|
||
# RAG/LLM
|
||
ROBOCO_LOCAL_LLM_BASE_URL=http://roboco-ollama:11434/v1
|
||
ROBOCO_LOCAL_LLM_MODEL=glm-5:cloud
|
||
```
|
||
|
||
## Multi-Agent Workspace Structure
|
||
|
||
Each agent gets their own git clone for parallel development:
|
||
|
||
```
|
||
{ROBOCO_WORKSPACES_ROOT}/
|
||
└── {project-slug}/
|
||
└── {team}/
|
||
└── {agent-slug}/
|
||
└── [git repository]
|
||
|
||
Example:
|
||
/data/workspaces/roboco/backend/be-dev-1/
|
||
/data/workspaces/roboco/backend/be-dev-2/
|
||
```
|
||
|
||
## Task Lifecycle
|
||
|
||
```
|
||
backlog → pending → claimed → in_progress → verifying → awaiting_qa
|
||
↓ ↓ ↓ ↓
|
||
cancelled blocked needs_revision awaiting_documentation
|
||
paused ↓
|
||
awaiting_pm_review
|
||
↓
|
||
awaiting_ceo_approval
|
||
↓
|
||
completed
|
||
```
|
||
|
||
## API Endpoints
|
||
|
||
| Route Group | Description |
|
||
|-------------|-------------|
|
||
| `/api/v1/tasks` | Task CRUD, lifecycle, claiming |
|
||
| `/api/v1/agents` | Agent management |
|
||
| `/api/v1/git` | Git operations (status, commit, push, PR) |
|
||
| `/api/v1/test` | Test/lint/format/build commands |
|
||
| `/api/v1/sessions` | Communication sessions |
|
||
| `/api/v1/messages` | Agent messages |
|
||
| `/api/v1/projects` | Project (repo) management |
|
||
| `/api/v1/work-sessions` | Git work session tracking |
|
||
| `/api/v1/optimal` | RAG/Knowledge base queries |
|
||
| `/api/v1/journals` | Agent journals/reflections |
|
||
|
||
## Development
|
||
|
||
```bash
|
||
# Install dev dependencies
|
||
uv sync --all-extras
|
||
|
||
# Run tests
|
||
uv run pytest
|
||
|
||
# Format and lint
|
||
uv run ruff format .
|
||
uv run ruff check .
|
||
uv run mypy roboco/
|
||
|
||
# Type checking
|
||
uv run mypy roboco/
|
||
```
|
||
|
||
## Core Principles
|
||
|
||
1. **Everything is a task** - All work is tracked and documented
|
||
2. **No work without a task** - Create task record first
|
||
3. **No task without acceptance criteria** - How do we know it's done?
|
||
4. **No closure without documentation** - Future agents need context
|
||
5. **Communication is constant** - Stream reasoning, log everything
|
||
6. **The Auditor sees all** - Quality monitored silently
|
||
7. **CEO approves major changes** - Human-in-the-loop for critical decisions
|
||
|
||
## Technology Stack
|
||
|
||
| Layer | Technology |
|
||
|-------|------------|
|
||
| API Framework | FastAPI |
|
||
| Database | PostgreSQL + SQLAlchemy (async) |
|
||
| Vector Store | pgvector (via piragi) |
|
||
| Cache/Queue | Redis |
|
||
| RAG Library | piragi |
|
||
| Embeddings | qwen3-embedding:0.6b (sentence-transformers) |
|
||
| Local LLM | Ollama (glm-5:cloud) |
|
||
| Cloud LLM | Claude API (Anthropic) |
|
||
| Package Manager | uv |
|
||
|
||
## Status
|
||
|
||
**Core Infrastructure** (Complete)
|
||
- [x] Data models (Pydantic)
|
||
- [x] Database ORM (SQLAlchemy async)
|
||
- [x] Task lifecycle state machine
|
||
- [x] Multi-agent workspace management
|
||
- [x] Agent blueprints (18 agents)
|
||
- [x] Messaging API
|
||
- [x] Task API with full lifecycle
|
||
- [x] Git operations API
|
||
- [x] Test/CI operations API
|
||
- [x] RAG/Knowledge base (piragi + pgvector)
|
||
- [x] Agent orchestrator
|
||
- [x] CEO approval workflow
|
||
|
||
**In Progress**
|
||
- [x] Frontend panel (vendored under `panel/`, served through nginx on :3000)
|
||
- [ ] Full agent autonomy testing
|
||
|
||
## Security
|
||
|
||
> [!IMPORTANT]
|
||
> **Do not expose RoboCo to the public internet as-is.** It is designed to run
|
||
> on a trusted private network (homelab / LAN).
|
||
|
||
**Agent authentication.** Requests identify the caller with `X-Agent-Id` /
|
||
`X-Agent-Role` headers. The orchestrator issues each spawned agent an HMAC token
|
||
(`X-Agent-Token`, signed with `ROBOCO_AGENT_AUTH_SECRET`) that binds its id, role
|
||
and team. Token enforcement is gated by `ROBOCO_AGENT_AUTH_REQUIRED`:
|
||
|
||
- **`ROBOCO_AGENT_AUTH_REQUIRED` unset/false (default):** *header-trust mode* —
|
||
the role headers are accepted without a token, so any client that can reach the
|
||
API may claim any role (including `ceo`). The API logs a warning at startup in
|
||
this mode. Acceptable only on a trusted network.
|
||
- **`ROBOCO_AGENT_AUTH_REQUIRED=true`:** every request must carry a valid token;
|
||
an agent cannot spoof another agent's role. The control panel keeps working
|
||
because **nginx** — the only trusted hop between the browser and the API —
|
||
injects the CEO token (`X-Agent-Token`) on `/api` and `/ws`, so the browser
|
||
never holds the signing secret. Generate that token with `make panel-token`
|
||
and set it as `ROBOCO_PANEL_AGENT_TOKEN` in `.env` before enabling secure mode.
|
||
|
||
**Secrets** (the Fernet `ROBOCO_ENCRYPTION_KEY`, GitHub PATs) live encrypted in
|
||
the database and in gitignored env files — never in the repo. Per-project git
|
||
tokens are Fernet-encrypted at rest and never returned by the API.
|
||
|
||
## License
|
||
|
||
Copyright (c) 2026 Renzo Franceschini
|
||
|
||
RoboCo is licensed under the **GNU Affero General Public License v3.0**
|
||
(AGPL-3.0). See [`LICENSE`](./LICENSE) for the full text.
|
||
|
||
The AGPL's network-use clause (section 13) means that if you run a modified
|
||
version of RoboCo as a network service, you must make your modified source
|
||
available to its users. This keeps the project open while preventing closed,
|
||
hosted re-distributions.
|
||
|
||
## Contributing
|
||
|
||
Contributions are welcome. All contributors must sign the Contributor License
|
||
Agreement ([`CLA.md`](./CLA.md)) — this is automated on your first pull
|
||
request. See [`CONTRIBUTING.md`](./CONTRIBUTING.md) for the workflow and why
|
||
the CLA exists.
|