mirror of
https://github.com/rennf93/roboco.git
synced 2026-08-03 07:23:24 +02:00
* fix(panel): cap dialog height and pin footer so actions stay reachable
Shared DialogContent now caps at max-h-[85vh] with overflow-y-auto, and the
footer is sticky to the bottom. Long content (e.g. a pasted change-request
note) no longer pushes the submit/cancel buttons past the viewport — the body
scrolls while the actions stay visible. No-op on dialogs that already fit.
* feat(notifications): suppress duplicate same-purpose notifications at send
A notification is not created when an unacknowledged one with the same purpose
— same sender, same type, same task, overlapping recipients — already exists.
Body text is not compared, so rewording cannot defeat it; a different type,
task, sender, or an already-acked recipient all still send through. Stops
agents that loop re-issuing the same signal from piling up unread that
soft-blocks the recipient's idle path.
* fix(gateway): stop board/PM lifecycle verbs from 500-crashing
Two unguarded crashes that wedged the org in respawn/escalate loops:
- escalate_to_ceo dereferenced None.status when the verb runner declined the
escalation (task not in awaiting_pm_review — e.g. a board agent escalating a
blocked task). It now returns a clean invalid_state. The message/remediate
build moved to a helper so the function stays within the complexity gate.
- The coordination-root git ops (pr_target, pr_merge, PR update, branch-token
resolve) called UUID(str(task.project_id)) directly, which raised on a
coordination/integration task (project_id is None — 'badly formed hexadecimal
UUID string'). They now resolve through _project_for_task, which falls back to
the product's repo for project-less roots.
* refactor(intake): split out _block_to_chunk per-block classifier
Extract the per-block classification from _blocks_to_chunks so each function
stays within the xenon cyclomatic-complexity gate (was rank C). Behaviour is
unchanged — verified by the existing intake_driver tests.
* feat(gateway): make the i_am_idle unread soft-block satisfiable
The soft-block on unread A2A / @mentions had no clearing path, so once those
briefing fields populated an agent could never idle — a whole-org deadlock.
Keep the guard (it is correct) and add the missing clear paths:
- New read_messages content verb (schema -> route -> handler ->
a2a.mark_all_read -> MCP tool -> role do_tools): bulk-zeroes the caller's
unread A2A and stamps read_at. The idle hint now points to it.
- list_unread_mentions returns UNACKED MENTION-type notifications (each @mention
already raises one via messaging._notify_mentions) instead of raw,
unconditional mentions, so they clear via the existing notify_ack. No schema
migration needed.
The soft-block is now satisfiable: A2A via read_messages, mentions and
notifications via notify_ack.
* fix(tests): repair notification-dedup db.scalar mocks + prompter agent seeding
The notification send-dedup added a db.scalar() purpose-lookup to
_create_notification; the two hand-rolled _FakeDb test stubs (test_notification,
test_a2a_priority_tristate) had no scalar() method → AttributeError. Add
scalar() returning None (no duplicate) so creation proceeds.
Separately, the prompter '& Start' route tests assign the draft to a fixed
product-owner / main-pm AGENT_UUID but only seeded system + CEO, so the
assigned_to FK failed in isolation (and main-pm flaked in the full suite). Seed
both via idempotent merge() in _seed_project_and_ceo.
* fix(git): gitignore .pnpm-store + flag GH001 push rejection as permanent
A dev once committed the ~115 MB pnpm store → GitHub GH001 (>100 MB) pre-receive
reject → open_pr retry-loop. Two root fixes:
- Add .pnpm-store/ to .gitignore — an ignored dir can't be staged by any git add.
- push() restates a GH001 / file-size rejection as an unmistakable PERMANENT
error pointing at i_am_blocked, so the agent stops blind-retrying a push that
can never succeed (it otherwise mis-reads the raw output as a transient timeout).
The per-verb retry cap (open_pr: 5) already bounded the burn; this ends it.
* fix(gateway): accept a PM decision note as satisfying the complete/submit_up reflect gate
A cell/main PM that wrote a fresh decision but no separate reflect note bounced
on the reflect tracing-gate indefinitely (re-confirmed live: cell PMs looped on
cell_pm_complete -> journal:reflect until reaped, burning tokens — worse because
each respawn resets the per-verb retry cap). For a PM closing/submitting a task
the decision note already documents the close; the separate reflect is the
redundant artifact weak-model PMs forget. Accept a fresh decision as satisfying
reflect for complete + submit_up — the gate still requires a decision +
substantive notes, so the close stays documented.
NOTE (enforcement tradeoff, flagged for CEO review): this intentionally relaxes
the PM complete/submit_up gate. It does NOT touch the developer i_am_done gate.
* feat(gateway): refuse i_am_idle when a PM still owns a task awaiting its review
A cell/main PM once tried to 'send work back' by DMing the developer and going
idle — but a DM changes no task state, so the task stayed awaiting_pm_review and
the orchestrator just re-dispatched the PM in a loop. i_am_idle now refuses (like
the pending-assignment guard) when a PM owns an awaiting_pm_review task, with a
clear remediation: complete() to finish, or reassign()/delegate() to route it
back. PM-only; devs/QA/doc unaffected. Pairs with the reflect-gate relaxation so
the PM can actually complete instead of looping.
* feat(gateway): push a prior-work handoff digest into task-scoped briefings
A freshly spawned or respawned agent previously started cold on every
lifecycle hand-off: the prior worker's PR, commits, acceptance status and
journal highlights lived in task evidence but were pull-on-demand, so each
new role agent re-explored the codebase from scratch — wasted tokens and
fragile context loss across respawns.
build_task_handoff() composes a compact, DB-only digest (no git diff) and
_briefing_for() now attaches it to context_briefing whenever the caller
already holds the task row. The digest is built only from a passed-in task,
so there are zero extra fetches: every resumption entry point (give_me_work
and pm_give_me_work, i_will_work_on, i_will_plan, triage/triage_all,
i_am_done, submit_up, escalate_up, complete) threads the loaded task, while
id-only correction/rejection paths cleanly omit it.
Every field is type-guarded so a partial row never leaks a non-serialisable
value into the envelope.
* docs(prompts): tell agents to resume from the briefing handoff before re-exploring
The base prompt described the success envelope but never told agents to act
on context_briefing, so a respawned or hand-off agent would re-scan the
whole repo and re-derive the plan even when the briefing already carried the
prior worker's PR, commits, acceptance status and journal highlights.
Adds a 'Resume from your briefing' section that walks each task_handoff
field and instructs the agent to continue from it — and to read the unread
A2A / mention / notification lists, which are messages addressed to them.
Pairs with the gateway change that now pushes task_handoff into every
task-scoped briefing.
* feat(tasks): remember cleared dependencies so the unblock briefing can surface them
When an upstream dependency completed, _unblock_dependents removed its id from
the dependent's dependency_ids to let it be claimed — destroying the only
record of which upstream task had just landed. The revived dependent then
re-discovered that work from cold.
Adds tasks.completed_dependency_ids (Alembic 026, uuid[] default '{}'):
_unblock_dependents now appends the cleared id there instead of only dropping
it, and the briefing handoff digest surfaces it so the agent picking the task
back up knows its blocker cleared because that upstream work shipped. The base
prompt documents the field.
Migration round-trip verified against postgres (upgrade adds the column,
downgrade drops it).
* docs(prompts): instruct PMs to split oversized tasks into per-concern subtasks
A subtask carrying a long acceptance list or spanning multiple layers/files
drove repeated QA failures and a PM revision loop — QA can't pass a partial,
and the dev keeps re-touching unrelated parts. Nothing in the PM prompts told
them to decompose by size/concern.
cell_pm gets a 'Sizing' rule: one subtask = one focused concern with ~2-4
criteria and its own dev->QA pass; decompose anything larger before
delegating, sequencing with dependencies. main_pm gets a matching reminder to
scope each cell's slice to that cell's layer rather than handing a cell a
cross-layer monolith that just pushes the problem down a level.
* fix(gateway): mirror the task= kwarg on ChoreographerHelpers helper signatures
The handoff-digest change added a keyword-only task= parameter to
_briefing_for and _build_tracing_gap in _impl, but the ChoreographerHelpers
base that the role mixins inherit still declared the old signatures, so the
composed Choreographer had two incompatible base definitions (mypy [misc]).
Sync the base declarations to match.
* fix(tasks): keep the owner on a substitute-out so the task isn't orphaned
build_substitute_update unconditionally nulled assigned_to, so any
substitute that routes to PENDING (max_retries, low_context, out_of_scope_*)
— the path a verb hitting repeated 500s or its retry limit takes — left the
task pending AND unassigned. The dispatcher only respawns a pending task when
it has an owner, so the task went dormant: no agent ever picked it back up.
Keep the task with its current owner instead. A substitute-out is almost
always a transient stall, so the task re-dispatches to the SAME agent, which
resumes from the briefing handoff. Only the task_complete -> PM-review handoff
changes owner (unchanged).
* feat(a2a): suppress duplicate unread A2A messages at send
A respawned or retrying agent could re-emit the same DM, stacking identical
copies on the recipient's inbox and re-bumping the unread count — noise that
the recipient then has to clear. The notification path already dedups; A2A did
not.
send_chat_message now suppresses a send when an identical message from the
same sender is still unread in the conversation, keyed on (conversation,
sender, message_kind, content). Genuinely different messages are never
collapsed (verified: distinct content still produces distinct rows), so this
avoids the earlier per-pair over-suppression. No migration.
* fix(panel): default the notifications view to Unread, not All
Landing on the All tab buried new notifications under everything already
seen — the most-reported annoyance. The Unread tab is the actionable view, so
make it the default; the All/Pending tabs are one click away.
* fix(panel): show clone progress during intake prep instead of a frozen pill
The first clone of a repo can take a few minutes, during which the intake
form showed only a static 'Preparing the agent…' button — indistinguishable
from a hang. Add a progress region while preparing: an elapsed timer, a
saturating progress bar (approaches but never reaches 100% until the agent
actually answers), and staged copy (spinning up → cloning → first-clone-takes-
a-while → reading the codebase) so the wait reads as work, not a freeze.
* feat(docs): index workspace-authored docs that never reached the RAG store
Docs written through roboco_docs_write land at /app/docs on the orchestrator
and index fine. But a documenter can also write docs with Edit/Write directly
in its own clone (README, CHANGELOG, workspace markdown); those resolve to a
/app/docs path that doesn't exist on the orchestrator, so the indexer reads
nothing and the docs never become searchable — a cross-container miss with no
shared mount to bridge it.
On docs completion, capture each listed doc's committed content out of the
branch (new GitService.read_file_at_branch, via git show) and write it
server-side under /app/docs before indexing, so workspace-authored docs reach
RAG too. Docs already present server-side are skipped; absolute paths and
unreadable/uncommitted files are passed over best-effort.
* feat(prompter): survive a browser reload by reconnecting to the live intake chat
The intake chat lived entirely in React state, so a page reload wiped it and
dropped the human back to the scope form — even though the agent container
outlives the page. Now the chat persists a small TTL'd slice (session id,
messages, scope, draft) to localStorage and, on mount, reconnects: it asks the
new GET /live/{id}/status whether the session is still running and, if so,
restores the history and reopens the SSE stream; if dead or expired it clears
and shows the form. A full reload doesn't run React effect cleanup, so the
navigate-away reap never fires on refresh and the session stays up.
Backend adds the status endpoint + PrompterLiveRegistry.is_alive; localStorage
is cleared on confirm, start-another, and SPA navigate-away.
* chore: remove internal session-bookkeeping refs from code comments (part 1)
Strip leaked task/finding numbers, Wave/Phase/cluster/audit labels from
docstrings and comments across services, foundation policy, runtime, mcp,
api schemas, and agent_sdk — they mean nothing to a repo reader and expose
process internals. Wording preserved; only the labels dropped. Done by hand,
one comment at a time (no scripted rewrite). _impl.py follows separately.
* chore: remove internal session-bookkeeping refs from code comments (part 2)
Finishes the manual scrub: the choreographer _impl.py docstrings/comments plus
the remaining dogfood-run ('smoke-N') labels across runtime, mcp, foundation,
api schemas, services, and agent factories. Reworded to describe the bug or
behaviour in plain words; every label dropped. The repo source is now free of
task/finding numbers, Wave/Phase/cluster/audit/smoke labels. By hand, one
comment at a time.
---------
Co-authored-by: Renn F <rennf93@users.noreply.github.com>
626 lines
20 KiB
Python
626 lines
20 KiB
Python
"""Unit tests for PrompterService.
|
|
|
|
Tests the service layer logic with mocked LLM calls. Uses an in-memory
|
|
async session (via conftest fixtures) for DB-backed tests.
|
|
"""
|
|
|
|
from __future__ import annotations
|
|
|
|
import json
|
|
from typing import Any
|
|
from unittest.mock import AsyncMock, patch
|
|
from uuid import UUID, uuid4
|
|
|
|
import pytest
|
|
from roboco.db.tables import (
|
|
AgentTable,
|
|
ProductTable,
|
|
ProjectTable,
|
|
TaskTable,
|
|
)
|
|
from roboco.models.base import (
|
|
AgentRole,
|
|
AgentStatus,
|
|
Complexity,
|
|
TaskNature,
|
|
TaskStatus,
|
|
TaskType,
|
|
Team,
|
|
)
|
|
from roboco.seeds.initial_data import AGENT_UUIDS
|
|
from roboco.services.base import NotFoundError, ServiceError, ValidationError
|
|
from roboco.services.prompter import (
|
|
PrompterService,
|
|
_build_chat_prompt,
|
|
_build_draft_prompt,
|
|
_build_reasoning,
|
|
compose_description,
|
|
derive_scale,
|
|
get_prompter_service,
|
|
parse_readiness,
|
|
)
|
|
|
|
# =============================================================================
|
|
# Pure function tests (no DB)
|
|
# =============================================================================
|
|
|
|
|
|
def test_parse_readiness_extracts_and_strips_tag() -> None:
|
|
content = (
|
|
"Here is my question about scope.\n\n"
|
|
'```roboco-meta\n{"covered": ["objective", "scope"], '
|
|
'"ready": true, "scale": "multi"}\n```'
|
|
)
|
|
clean, tag = parse_readiness(content)
|
|
assert clean == "Here is my question about scope."
|
|
assert tag is not None
|
|
assert tag.ready is True
|
|
assert tag.scale == "multi"
|
|
assert tag.covered == ["objective", "scope"]
|
|
# The control block must not leak into the user-visible text.
|
|
assert "roboco-meta" not in clean
|
|
|
|
|
|
def test_parse_readiness_absent_block_is_not_ready() -> None:
|
|
clean, tag = parse_readiness("Just a plain reply, no control block.")
|
|
assert clean == "Just a plain reply, no control block."
|
|
assert tag is None
|
|
|
|
|
|
def test_parse_readiness_malformed_json_is_graceful() -> None:
|
|
content = "Reply text.\n```roboco-meta\n{not valid json]\n```"
|
|
clean, tag = parse_readiness(content)
|
|
assert "roboco-meta" not in clean
|
|
assert clean == "Reply text."
|
|
assert tag is None
|
|
|
|
|
|
def test_parse_readiness_uses_last_block() -> None:
|
|
content = (
|
|
'```roboco-meta\n{"ready": false, "scale": "single"}\n```\n'
|
|
"Final answer.\n"
|
|
'```roboco-meta\n{"ready": true, "scale": "multi"}\n```'
|
|
)
|
|
clean, tag = parse_readiness(content)
|
|
assert tag is not None
|
|
assert tag.ready is True
|
|
assert tag.scale == "multi"
|
|
assert "roboco-meta" not in clean
|
|
|
|
|
|
def test_derive_scale_single_vs_multi() -> None:
|
|
assert derive_scale([{"team": "backend"}]) == "single"
|
|
assert derive_scale([{"team": "backend"}, {"team": "frontend"}]) == "multi"
|
|
# Non-cell teams (e.g. main_pm) do not count toward cell breadth.
|
|
assert derive_scale([{"team": "backend"}, {"team": "main_pm"}]) == "single"
|
|
assert derive_scale([]) == "single"
|
|
|
|
|
|
def test_compose_description_single_cell_markdown() -> None:
|
|
draft = {
|
|
"objective": "Let humans track token usage.",
|
|
"what_this_builds": ["A usage panel on the Metrics page"],
|
|
"the_work": [
|
|
{
|
|
"team": "frontend",
|
|
"summary": "Render the usage panel",
|
|
"items": ["Add the chart", "Wire the API"],
|
|
}
|
|
],
|
|
"notes": ["Reuse the existing Metrics layout"],
|
|
"acceptance_criteria": ["Panel shows totals", "Panel filters by range"],
|
|
}
|
|
md = compose_description(draft)
|
|
assert "## Objective" in md
|
|
assert "## What This Builds" in md
|
|
assert "## The Work" in md
|
|
assert "**Frontend** — Render the usage panel" in md
|
|
assert "## Notes" in md
|
|
assert "## Success Criteria" in md
|
|
assert "- Panel shows totals" in md
|
|
# Single-cell tasks get no board-led lead line.
|
|
assert "Board-led" not in md
|
|
|
|
|
|
def test_compose_description_multi_cell_has_board_led_lead() -> None:
|
|
draft = {
|
|
"objective": "Ship the Prompter.",
|
|
"the_work": [
|
|
{"team": "backend", "summary": "Chat endpoint", "items": []},
|
|
{"team": "frontend", "summary": "Chat UI", "items": []},
|
|
{"team": "ux_ui", "summary": "Interaction design", "items": []},
|
|
],
|
|
"acceptance_criteria": ["It works end to end"],
|
|
}
|
|
md = compose_description(draft)
|
|
assert "Board-led" in md
|
|
assert "**Backend**" in md
|
|
assert "**UX/UI**" in md
|
|
|
|
|
|
def test_compose_description_falls_back_to_provided_description() -> None:
|
|
# Sparse structured fields → fall back to a model-provided description.
|
|
draft = {"description": "A perfectly adequate fallback description here."}
|
|
md = compose_description(draft)
|
|
assert md == "A perfectly adequate fallback description here."
|
|
|
|
|
|
def test_lead_cell_team_prefers_the_work_cell() -> None:
|
|
draft = {"the_work": [{"team": "frontend"}], "team": "backend"}
|
|
assert PrompterService._lead_cell_team(draft, default=Team.BACKEND) is Team.FRONTEND
|
|
# Empty the_work falls back to the provided default.
|
|
assert PrompterService._lead_cell_team({}, default=Team.BACKEND) is Team.BACKEND
|
|
|
|
|
|
def test_lead_cell_team_skips_invalid_cell_names() -> None:
|
|
# An off-enum cell name is skipped, not raised on; falls through to a valid one.
|
|
draft = {"the_work": [{"team": "nonsense"}, {"team": "frontend"}]}
|
|
assert PrompterService._lead_cell_team(draft, default=Team.BACKEND) is Team.FRONTEND
|
|
|
|
|
|
def test_coerce_draft_enums_defaults_invalid_values() -> None:
|
|
# Regression: the LLM emits off-enum values (e.g. task_type="feature"). The
|
|
# confirm must coerce to defaults, never raise — a bad enum guess must not
|
|
# 400 the launch and force the agent to self-correct in-chat.
|
|
draft = {
|
|
"team": "backend",
|
|
"task_type": "feature", # not a valid TaskType
|
|
"nature": "bogus", # not a valid TaskNature
|
|
"estimated_complexity": "enormous", # not a valid Complexity
|
|
}
|
|
team, task_type, nature, complexity = PrompterService._coerce_draft_enums(draft)
|
|
assert team is Team.BACKEND
|
|
assert task_type is TaskType.CODE
|
|
assert nature is TaskNature.TECHNICAL
|
|
assert complexity is Complexity.MEDIUM
|
|
|
|
|
|
def test_coerce_priority_maps_words_clamps_and_defaults() -> None:
|
|
# Regression: priority is the one non-enum field the agent guesses, and it
|
|
# guesses a word ("high") as often as a number — int("high") used to 500.
|
|
# word/number -> expected priority int (0=urgent .. 3=low).
|
|
cases: dict[object, int] = {
|
|
"urgent": 0,
|
|
"high": 1,
|
|
"medium": 2,
|
|
"low": 3,
|
|
1: 1,
|
|
"3": 3,
|
|
99: 3, # clamped into range
|
|
"nonsense": 2, # unrecognized -> default medium
|
|
None: 2, # missing -> default medium
|
|
}
|
|
for value, expected in cases.items():
|
|
assert PrompterService._coerce_priority(value) == expected
|
|
|
|
|
|
def test_coerce_draft_enums_keeps_valid_and_derives_missing_team() -> None:
|
|
# Valid values pass through; a missing team is derived from the_work.
|
|
draft = {
|
|
"task_type": "documentation",
|
|
"nature": "technical",
|
|
"estimated_complexity": "medium",
|
|
"the_work": [{"team": "frontend"}],
|
|
}
|
|
team, task_type, nature, complexity = PrompterService._coerce_draft_enums(draft)
|
|
assert team is Team.FRONTEND
|
|
assert task_type is TaskType.DOCUMENTATION
|
|
assert nature is TaskNature.TECHNICAL
|
|
assert complexity is Complexity.MEDIUM
|
|
|
|
|
|
def test_build_chat_prompt_basic() -> None:
|
|
messages = [
|
|
{"role": "user", "content": "I need a feature"},
|
|
{"role": "assistant", "content": "Tell me more"},
|
|
]
|
|
prompt = _build_chat_prompt(messages, None)
|
|
assert "user: I need a feature" in prompt
|
|
assert "assistant: Tell me more" in prompt
|
|
assert "Continue the conversation" in prompt
|
|
|
|
|
|
def test_build_chat_prompt_with_context() -> None:
|
|
messages = [{"role": "user", "content": "hello"}]
|
|
prompt = _build_chat_prompt(messages, {"team": "backend"})
|
|
assert "Context:" in prompt
|
|
assert "team: backend" in prompt
|
|
|
|
|
|
def test_build_draft_prompt() -> None:
|
|
messages = [{"role": "user", "content": "I need a login page"}]
|
|
prompt = _build_draft_prompt(messages, None)
|
|
assert "valid JSON" in prompt
|
|
assert "user: I need a login page" in prompt
|
|
|
|
|
|
def test_build_reasoning() -> None:
|
|
messages = [{"role": "user", "content": "Hello"}] * 3
|
|
draft = {"title": "My Task", "team": "backend", "estimated_complexity": "medium"}
|
|
reasoning = _build_reasoning(messages, draft)
|
|
assert "My Task" in reasoning
|
|
assert "backend" in reasoning
|
|
assert "medium" in reasoning
|
|
assert "3 messages" in reasoning
|
|
|
|
|
|
# =============================================================================
|
|
# Factory
|
|
# =============================================================================
|
|
|
|
|
|
def test_get_prompter_service_no_db() -> None:
|
|
service = get_prompter_service()
|
|
assert isinstance(service, PrompterService)
|
|
assert service._db is None
|
|
|
|
|
|
def test_get_prompter_service_raises_without_db_for_session_methods() -> None:
|
|
service = get_prompter_service()
|
|
with pytest.raises(ServiceError, match="DB session"):
|
|
_ = service._session
|
|
|
|
|
|
# =============================================================================
|
|
# Stateless chat / draft (with mocked LLM)
|
|
# =============================================================================
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_chat_success_with_mock_llm() -> None:
|
|
service = get_prompter_service()
|
|
|
|
with patch.object(
|
|
service,
|
|
"_create_message",
|
|
new_callable=AsyncMock,
|
|
return_value="Great, let's continue!",
|
|
):
|
|
result = await service.chat(
|
|
messages=[{"role": "user", "content": "I need a feature"}]
|
|
)
|
|
|
|
assert result["message"] == "Great, let's continue!"
|
|
assert result["draft_ready"] is False
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_chat_draft_ready_signal() -> None:
|
|
service = get_prompter_service()
|
|
|
|
reply = (
|
|
"Got it — I have what I need.\n\n"
|
|
'```roboco-meta\n{"covered": ["objective", "scope", "surface", '
|
|
'"acceptance"], "ready": true, "scale": "single"}\n```'
|
|
)
|
|
with patch.object(
|
|
service,
|
|
"_create_message",
|
|
new_callable=AsyncMock,
|
|
return_value=reply,
|
|
):
|
|
result = await service.chat(
|
|
messages=[{"role": "user", "content": "I need a feature"}]
|
|
)
|
|
|
|
assert result["draft_ready"] is True
|
|
assert result["scale"] == "single"
|
|
# The control block is stripped from the user-visible reply.
|
|
assert "roboco-meta" not in result["message"]
|
|
assert result["message"] == "Got it — I have what I need."
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_chat_raises_on_empty_response() -> None:
|
|
service = get_prompter_service()
|
|
|
|
with (
|
|
patch.object(
|
|
service, "_create_message", new_callable=AsyncMock, return_value=""
|
|
),
|
|
pytest.raises(ServiceError, match="LLM returned empty content"),
|
|
):
|
|
await service.chat(messages=[{"role": "user", "content": "Hello"}])
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_chat_raises_on_llm_error() -> None:
|
|
service = get_prompter_service()
|
|
|
|
with (
|
|
patch.object(
|
|
service,
|
|
"_create_message",
|
|
new_callable=AsyncMock,
|
|
side_effect=Exception("API unavailable"),
|
|
),
|
|
pytest.raises(ServiceError, match="LLM chat failed"),
|
|
):
|
|
await service.chat(messages=[{"role": "user", "content": "Hello"}])
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_draft_success_with_mock_llm() -> None:
|
|
service = get_prompter_service()
|
|
|
|
draft_data = {
|
|
"title": "Add login",
|
|
"description": "Implement login functionality with JWT tokens",
|
|
"acceptance_criteria": ["User can log in"],
|
|
"team": "backend",
|
|
"task_type": "code",
|
|
"nature": "technical",
|
|
"estimated_complexity": "medium",
|
|
}
|
|
|
|
with patch.object(
|
|
service,
|
|
"_create_message",
|
|
new_callable=AsyncMock,
|
|
return_value=json.dumps(draft_data),
|
|
):
|
|
result = await service.draft(
|
|
messages=[{"role": "user", "content": "I need a login feature"}]
|
|
)
|
|
|
|
assert result["draft"]["title"] == "Add login"
|
|
assert result["draft"]["source"] == "prompter"
|
|
assert result["draft"]["confirmed_by_human"] is False
|
|
assert "reasoning" in result
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_draft_raises_on_invalid_json() -> None:
|
|
service = get_prompter_service()
|
|
|
|
with (
|
|
patch.object(
|
|
service,
|
|
"_create_message",
|
|
new_callable=AsyncMock,
|
|
return_value="Not JSON at all",
|
|
),
|
|
pytest.raises(ValidationError, match="not valid JSON"),
|
|
):
|
|
await service.draft(messages=[{"role": "user", "content": "Hello"}])
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_draft_raises_on_llm_error() -> None:
|
|
service = get_prompter_service()
|
|
|
|
with (
|
|
patch.object(
|
|
service,
|
|
"_create_message",
|
|
new_callable=AsyncMock,
|
|
side_effect=Exception("API unavailable"),
|
|
),
|
|
pytest.raises(ServiceError, match="LLM draft generation failed"),
|
|
):
|
|
await service.draft(messages=[{"role": "user", "content": "Hello"}])
|
|
|
|
|
|
# =============================================================================
|
|
# Session-based: create_session (DB-backed via conftest)
|
|
# =============================================================================
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_create_session_db(db_session: Any) -> None:
|
|
"""create_session persists a PrompterSessionTable row."""
|
|
service = get_prompter_service(db=db_session)
|
|
|
|
agent_id = uuid4()
|
|
agent = AgentTable(
|
|
id=agent_id,
|
|
name="TestAgent",
|
|
slug=f"test-{uuid4().hex[:8]}",
|
|
role=AgentRole.DEVELOPER,
|
|
team=None,
|
|
status=AgentStatus.ACTIVE,
|
|
model_config={},
|
|
system_prompt="dev",
|
|
capabilities=[],
|
|
permissions={},
|
|
metrics={},
|
|
)
|
|
db_session.add(agent)
|
|
await db_session.flush()
|
|
|
|
session = await service.create_session(agent_id=agent_id)
|
|
assert session.id is not None
|
|
assert session.status == "active"
|
|
assert session.agent_id == agent_id
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_get_session_not_found(db_session: Any) -> None:
|
|
"""_get_session raises NotFoundError for unknown session ID."""
|
|
service = get_prompter_service(db=db_session)
|
|
with pytest.raises(NotFoundError):
|
|
await service._get_session(uuid4(), uuid4())
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_get_draft_empty_session_raises(db_session: Any) -> None:
|
|
"""get_or_generate_draft raises ValidationError if no messages exist."""
|
|
service = get_prompter_service(db=db_session)
|
|
|
|
agent_id = uuid4()
|
|
agent = AgentTable(
|
|
id=agent_id,
|
|
name="TestAgent",
|
|
slug=f"test-{uuid4().hex[:8]}",
|
|
role=AgentRole.DEVELOPER,
|
|
team=None,
|
|
status=AgentStatus.ACTIVE,
|
|
model_config={},
|
|
system_prompt="dev",
|
|
capabilities=[],
|
|
permissions={},
|
|
metrics={},
|
|
)
|
|
db_session.add(agent)
|
|
await db_session.flush()
|
|
|
|
session = await service.create_session(agent_id=agent_id)
|
|
|
|
with pytest.raises(ValidationError, match="empty conversation"):
|
|
await service.get_or_generate_draft(
|
|
session_id=UUID(str(session.id)),
|
|
agent_id=agent_id,
|
|
)
|
|
|
|
|
|
async def _seed_project_and_ceo(db_session: Any) -> tuple[UUID, UUID]:
|
|
"""Seed a system agent + project + CEO; return (project_id, ceo_id).
|
|
|
|
Returns plain ``UUID``s (not the ORM rows) so callers pass real uuids to the
|
|
service — no casting the ORM ``.id`` column type at the call site.
|
|
"""
|
|
system_id, project_id, ceo_id = uuid4(), uuid4(), uuid4()
|
|
system = AgentTable(
|
|
id=system_id,
|
|
name="System",
|
|
slug=f"system-{uuid4().hex[:8]}",
|
|
role=AgentRole.SYSTEM,
|
|
team=None,
|
|
status=AgentStatus.ACTIVE,
|
|
model_config={},
|
|
system_prompt="system",
|
|
capabilities=[],
|
|
permissions={},
|
|
metrics={},
|
|
)
|
|
db_session.add(system)
|
|
await db_session.flush()
|
|
project = ProjectTable(
|
|
id=project_id,
|
|
name="Intake Test Project",
|
|
slug=f"intake-{uuid4().hex[:8]}",
|
|
git_url="https://github.com/example/intake.git",
|
|
default_branch="main",
|
|
protected_branches=["main"],
|
|
assigned_cell=Team.BACKEND,
|
|
created_by=system_id,
|
|
is_active=True,
|
|
)
|
|
ceo = AgentTable(
|
|
id=ceo_id,
|
|
name="CEO",
|
|
slug=f"ceo-{uuid4().hex[:8]}",
|
|
role=AgentRole.CEO,
|
|
team=None,
|
|
status=AgentStatus.ACTIVE,
|
|
model_config={},
|
|
system_prompt="ceo",
|
|
capabilities=[],
|
|
permissions={},
|
|
metrics={},
|
|
)
|
|
db_session.add_all([project, ceo])
|
|
await db_session.flush()
|
|
# The "& Start" routes assign the draft to a fixed board/PM agent
|
|
# (product-owner for "Board review", main-pm for "Approve & Start"); those
|
|
# rows must exist for the assigned_to FK. merge() is idempotent, so this is
|
|
# safe whether or not another test already committed them on the shared DB.
|
|
for slug, role, team in (
|
|
("product-owner", AgentRole.PRODUCT_OWNER, None),
|
|
("main-pm", AgentRole.MAIN_PM, Team.MAIN_PM),
|
|
):
|
|
await db_session.merge(
|
|
AgentTable(
|
|
id=UUID(AGENT_UUIDS[slug]),
|
|
name=slug,
|
|
slug=slug,
|
|
role=role,
|
|
team=team,
|
|
status=AgentStatus.ACTIVE,
|
|
model_config={},
|
|
system_prompt=slug,
|
|
capabilities=[],
|
|
permissions={},
|
|
metrics={},
|
|
)
|
|
)
|
|
await db_session.flush()
|
|
return project_id, ceo_id
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_confirm_live_draft_board_route_assigns_po(db_session: Any) -> None:
|
|
""" "Board review & Start" (default route) → PENDING, assigned to the Product
|
|
Owner so the orchestrator fires the PO + HoM review."""
|
|
project_id, ceo_id = await _seed_project_and_ceo(db_session)
|
|
service = get_prompter_service(db=db_session)
|
|
|
|
draft = {
|
|
"title": "Add token metrics",
|
|
"objective": "See token usage at a glance.",
|
|
"acceptance_criteria": ["Dashboard shows total tokens"],
|
|
"team": "backend",
|
|
"the_work": [
|
|
{"team": "backend", "summary": "instrument", "items": ["count tokens"]}
|
|
],
|
|
}
|
|
task_id = await service.confirm_live_draft(draft, ceo_id, project_id=project_id)
|
|
|
|
row = await db_session.get(TaskTable, task_id)
|
|
assert row is not None
|
|
assert row.status == TaskStatus.PENDING # "& Start" — started now
|
|
assert row.assigned_to == UUID(AGENT_UUIDS["product-owner"]) # board review
|
|
assert row.source == "prompter"
|
|
assert row.confirmed_by_human is True
|
|
assert row.team == Team.BACKEND # lead cell from the_work
|
|
assert row.created_by == ceo_id
|
|
assert row.nature is not None and row.task_type is not None
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_confirm_live_draft_main_pm_route_assigns_main_pm(
|
|
db_session: Any,
|
|
) -> None:
|
|
""" "Approve & Start" (route="main_pm") → PENDING, assigned to the Main PM."""
|
|
project_id, ceo_id = await _seed_project_and_ceo(db_session)
|
|
service = get_prompter_service(db=db_session)
|
|
draft = {
|
|
"title": "Quick fix",
|
|
"acceptance_criteria": ["done"],
|
|
"team": "backend",
|
|
}
|
|
task_id = await service.confirm_live_draft(
|
|
draft, ceo_id, project_id=project_id, route="main_pm"
|
|
)
|
|
row = await db_session.get(TaskTable, task_id)
|
|
assert row.status == TaskStatus.PENDING
|
|
assert row.assigned_to == UUID(AGENT_UUIDS["main-pm"])
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_confirm_live_draft_product_routes_to_main_pm(db_session: Any) -> None:
|
|
"""A product-scoped live draft is a board-led coordination root (Main PM)."""
|
|
_project_id, ceo_id = await _seed_project_and_ceo(db_session)
|
|
product_id = uuid4()
|
|
product = ProductTable(
|
|
id=product_id,
|
|
name="Intake Product",
|
|
slug=f"prod-{uuid4().hex[:8]}",
|
|
description="x",
|
|
created_by=ceo_id,
|
|
)
|
|
db_session.add(product)
|
|
await db_session.flush()
|
|
|
|
service = get_prompter_service(db=db_session)
|
|
draft = {
|
|
"title": "Board-led feature",
|
|
"acceptance_criteria": ["works end to end"],
|
|
"team": "backend",
|
|
}
|
|
task_id = await service.confirm_live_draft(draft, ceo_id, product_id=product_id)
|
|
row = await db_session.get(TaskTable, task_id)
|
|
assert row.team == Team.MAIN_PM
|
|
assert row.product_id == product_id
|
|
assert row.project_id is None
|