mirror of
https://github.com/rennf93/roboco.git
synced 2026-08-03 07:23:24 +02:00
* [e7349d84] feat(dashboard): WS usage store, hook extension, status badge, and smooth animations (#111) (#113) - Add src/store/usage-store.ts with typed UsageData interface, useUsageStore Zustand store, setUsageData, clearUsageData, and setWsState actions - Export useUsageStore and UsageData from store/index.ts - Extend use-rate-limit-websocket.ts: rename msg type to SystemWsMessage, add key_metrics field; add useEffect syncing wsState into useUsageStore; add USAGE_UPDATE/USAGE_SNAPSHOT handler dispatching to useUsageStore (RATE_LIMIT_HIT/LIFTED handling and onReconnect unchanged) - Update CommandCenter to read key_metrics from useUsageStore when wsState === 'connected' and usageData non-null; falls back to useCeoOverview() (refetchInterval: 60000) when WS disconnected - Update KeyMetricsPanel: add wsState prop, render connection status Badge matching AgentStreamViewer pattern (bg-green-500+Wifi / bg-yellow-500+ Loader2 spin / bg-gray-500+WifiOff); add transition-all duration-300 ease-in-out to metric value spans for smooth animated updates Co-authored-by: Frontend Developer 1 <fe-dev-1@agents.roboco.dev> * [c9745ee8] feat(events): add USAGE_UPDATE/SNAPSHOT event types, throttled publisher, /ws/system usage bridge (#112) (#114) - Add EventType.USAGE_UPDATE='usage.update' and EventType.USAGE_SNAPSHOT='usage.snapshot' to the EventType StrEnum in roboco/models/events.py - Create roboco/services/usage_events.py with _UsageThrottle class (5-second per-agent window using time.monotonic()) and publish_usage_update() / publish_usage_snapshot() helpers; lazy imports prevent circular dependency with roboco.events - Extend orchestrator._sweep_token_snapshots() to publish USAGE_UPDATE per active agent (throttled) and a USAGE_SNAPSHOT aggregate after each sweep cycle; wrapped in contextlib.suppress so event errors never abort DB snapshot operations - Add _handle_usage_event() to websocket_bridge.py following _handle_rate_limit_event pattern; register USAGE_UPDATE and USAGE_SNAPSHOT subscriptions in register_websocket_bridge_handlers() forwarding both to /ws/system via broadcast_system() - Add unit tests: test_usage_events.py (throttle suppression, publish helpers) and test_websocket_bridge.py extended with _handle_usage_event coverage and updated registration assertion to include USAGE_UPDATE/USAGE_SNAPSHOT Co-authored-by: Backend Developer 1 <be-dev-1@agents.roboco.dev> * fix(usage-ws): reconcile the realtime token/cost contract end-to-end The backend and frontend halves shipped mismatched contracts, so the usage dashboard never received live data: - The bridge forwarded the dotted event value ("usage.update") while the panel switched on "USAGE_UPDATE"; map both to the UPPER_SNAKE type string the same way the rate-limit handler does. - The backend emitted token/cost telemetry but the frontend read a key_metrics field and fed the org-metrics panel. Rewire the frontend to consume the USAGE_SNAPSHOT token/cost payload into the "Token Usage & Cost" panel — WS-first with polling fallback and a connection-status badge — and revert the unrelated KeyMetricsPanel / CommandCenter wiring. Backend cleanups in the same path: - Replace the multi-argument publish helpers with typed UsageUpdate / UsageSnapshot payloads, removing the too-many-arguments lint suppressions. - Extract _fetch_agent_tokens and _persist_token_snapshot from the token sweep, removing the too-many-statements suppression; label the live snapshot "live". Hardening uncovered while fixing the above: - _finalize_spawn_session pulled the full RAG stack into the session-finalization path through a transcript-parse import; move the pure parser into a dependency-light roboco.agent_sdk.transcript_usage module so finalization never imports the agent SDK server. - Reduce _finalize_spawn_session complexity by extracting _resolve_final_token_usage, and widen the transcript-fallback guard so a read error can never abort finalization. Also align KeyMetricsPanel with the metrics /dashboard/ceo actually returns: it read velocity_24h / avg_time_to_done / active_agents, none of which get_key_metrics() emits, so four of five rows rendered "—". Render velocity_weekly, completion_rate, documentation_coverage and active_blockers. * docs: note live usage push over /ws/system on the usage dashboard * fix(usage): finalize on self-exit and de-duplicate transcript token counts Two bugs left token capture broken even after the transcript-read fallback landed — surfaced by a live agent run: - Agents that self-exit (the normal i_am_idle -> container shutdown, exit 0) were never finalized. _finalize_spawn_session is only called from stop_agent(), but a graceful self-exit goes through _handle_stopped_container, which set the instance OFFLINE and returned without finalizing — leaving the spawn-session row open with zero tokens. Finalize there for both graceful (exit_reason="completed") and crash (exit_reason="crashed") exits. - sum_transcript_usage double-counted. Claude Code logs one assistant message as several JSONL lines (one per content block — thinking / text / tool_use), each repeating the same message.usage, so summing every line roughly doubled the totals. De-duplicate by message.id. Verified against a live agent transcript: the raw sum (12, 1068, 62502, 115828) vs the de-duped (6, 516, 62502, 63336), which matches the session's authoritative result.usage exactly. * feat(usage): fall back to the transcript in the live token sweep The 60s token sweep read only the agent SDK's /usage/status, which races container teardown and reports zero mid-run — so live usage (and the USAGE_SNAPSHOT pushed to /ws/system) stayed at zero for active agents. Extract _resolve_active_tokens: try the SDK, then fall back to the durable transcript (the same source finalize uses) so running agents report live. * feat(usage): add GET /usage/sessions for the dashboard's Recent Sessions The panel's Recent Sessions table was mock-only — the backend had no sessions endpoint, so production always showed 'No sessions recorded yet'. Add UsageService.get_recent_sessions + a /usage/sessions route returning the most recent spawn-session rows (token totals + cost), and point the panel client at it. --------- Co-authored-by: Frontend Developer 1 <fe-dev-1@agents.roboco.dev> Co-authored-by: Backend Developer 1 <be-dev-1@agents.roboco.dev> Co-authored-by: Renn F <rennf93@users.noreply.github.com>
175 lines
5.6 KiB
TypeScript
175 lines
5.6 KiB
TypeScript
"use client";
|
|
|
|
import { Card, CardContent, CardHeader, CardTitle } from "@/components/ui/card";
|
|
import { Badge } from "@/components/ui/badge";
|
|
import { Skeleton } from "@/components/ui/skeleton";
|
|
import { useUsageSummary } from "@/hooks/use-usage";
|
|
import { useUsageStore } from "@/store/usage-store";
|
|
import type { ConnectionState } from "@/lib/websocket/connection";
|
|
import {
|
|
Coins,
|
|
TrendingUp,
|
|
TrendingDown,
|
|
Zap,
|
|
Activity,
|
|
Wifi,
|
|
WifiOff,
|
|
Loader2,
|
|
} from "lucide-react";
|
|
|
|
function fmt(n: number, decimals = 0): string {
|
|
if (n >= 1_000_000) return (n / 1_000_000).toFixed(1) + "M";
|
|
if (n >= 1_000) return (n / 1_000).toFixed(1) + "K";
|
|
return n.toFixed(decimals);
|
|
}
|
|
|
|
function fmtCost(n: number): string {
|
|
return "$" + n.toFixed(2);
|
|
}
|
|
|
|
interface MetricRowProps {
|
|
icon: React.ReactNode;
|
|
label: string;
|
|
value: string;
|
|
sub?: React.ReactNode;
|
|
}
|
|
|
|
function MetricRow({ icon, label, value, sub }: MetricRowProps) {
|
|
return (
|
|
<div className="flex items-center justify-between py-1">
|
|
<div className="flex items-center gap-2 text-sm text-muted-foreground">
|
|
{icon}
|
|
{label}
|
|
</div>
|
|
<div className="flex items-center gap-1">
|
|
<span className="font-semibold text-sm transition-all duration-300 ease-in-out">
|
|
{value}
|
|
</span>
|
|
{sub}
|
|
</div>
|
|
</div>
|
|
);
|
|
}
|
|
|
|
/**
|
|
* Badge props mirroring the AgentStreamViewer connection-status pattern:
|
|
* green/Live when the /ws/system stream is connected, yellow while
|
|
* (re)connecting, gray/Polling when it is down and the panel uses HTTP polling.
|
|
*/
|
|
function getConnectionBadge(wsState: ConnectionState) {
|
|
switch (wsState) {
|
|
case "connected":
|
|
return {
|
|
className: "bg-green-500 text-white",
|
|
icon: <Wifi className="h-3 w-3 mr-1" />,
|
|
label: "Live",
|
|
};
|
|
case "connecting":
|
|
case "reconnecting":
|
|
return {
|
|
className: "bg-yellow-500 text-white",
|
|
icon: <Loader2 className="h-3 w-3 mr-1 animate-spin" />,
|
|
label: wsState === "reconnecting" ? "Reconnecting..." : "Connecting...",
|
|
};
|
|
case "disconnected":
|
|
default:
|
|
return {
|
|
className: "bg-gray-500 text-white",
|
|
icon: <WifiOff className="h-3 w-3 mr-1" />,
|
|
label: "Polling",
|
|
};
|
|
}
|
|
}
|
|
|
|
export function UsageOverviewPanel() {
|
|
// The polling summary always runs in the background: it is the fallback when
|
|
// the WS is down, and it supplies the trend (which the live snapshot, being a
|
|
// point-in-time aggregate, does not compute).
|
|
const { data: summary, isLoading } = useUsageSummary("24h");
|
|
|
|
// Live token/cost pushed over /ws/system (USAGE_SNAPSHOT). Prefer it whenever
|
|
// the stream is connected; `live` is non-null only then, so it narrows safely.
|
|
const { wsState, usageData } = useUsageStore();
|
|
const live = wsState === "connected" ? usageData : null;
|
|
|
|
const tokensInput = live ? live.tokens_input : summary?.tokens_input;
|
|
const tokensOutput = live ? live.tokens_output : summary?.tokens_output;
|
|
const totalCost = live ? live.total_cost_usd : summary?.total_cost_usd;
|
|
const periodLabel = live ? live.period : summary?.period;
|
|
|
|
// Trend always comes from the polling summary (needs a prior-period baseline).
|
|
const trendPct = summary?.trend_pct ?? 0;
|
|
const trendUp = trendPct >= 0;
|
|
|
|
const badge = getConnectionBadge(wsState);
|
|
// Only show skeletons on first load with no data from either source.
|
|
const showSkeleton = isLoading && !live;
|
|
|
|
return (
|
|
<Card>
|
|
<CardHeader className="pb-3">
|
|
<div className="flex items-center justify-between">
|
|
<CardTitle className="text-lg flex items-center gap-2">
|
|
<Coins className="h-5 w-5" />
|
|
Token Usage & Cost
|
|
</CardTitle>
|
|
<Badge className={badge.className}>
|
|
{badge.icon}
|
|
{badge.label}
|
|
</Badge>
|
|
</div>
|
|
</CardHeader>
|
|
<CardContent>
|
|
{showSkeleton ? (
|
|
<div className="space-y-3">
|
|
{Array.from({ length: 5 }).map((_, i) => (
|
|
<Skeleton key={i} className="h-6" />
|
|
))}
|
|
</div>
|
|
) : (
|
|
<div className="divide-y">
|
|
<MetricRow
|
|
icon={<Zap className="h-4 w-4" />}
|
|
label="Tokens (input)"
|
|
value={tokensInput != null ? fmt(tokensInput) : "—"}
|
|
/>
|
|
<MetricRow
|
|
icon={<Zap className="h-4 w-4 text-muted-foreground" />}
|
|
label="Tokens (output)"
|
|
value={tokensOutput != null ? fmt(tokensOutput) : "—"}
|
|
/>
|
|
<MetricRow
|
|
icon={<Coins className="h-4 w-4" />}
|
|
label="Total cost"
|
|
value={totalCost != null ? fmtCost(totalCost) : "—"}
|
|
/>
|
|
<MetricRow
|
|
icon={
|
|
trendUp ? (
|
|
<TrendingUp className="h-4 w-4 text-red-500" />
|
|
) : (
|
|
<TrendingDown className="h-4 w-4 text-green-500" />
|
|
)
|
|
}
|
|
label="Trend vs prior period"
|
|
value={summary ? (trendUp ? "+" : "") + trendPct.toFixed(1) + "%" : "—"}
|
|
sub={
|
|
summary ? (
|
|
<span className={"text-xs " + (trendUp ? "text-red-500" : "text-green-500")}>
|
|
{trendUp ? "▲" : "▼"}
|
|
</span>
|
|
) : undefined
|
|
}
|
|
/>
|
|
<MetricRow
|
|
icon={<Activity className="h-4 w-4 text-blue-500" />}
|
|
label="Period"
|
|
value={periodLabel ?? "—"}
|
|
/>
|
|
</div>
|
|
)}
|
|
</CardContent>
|
|
</Card>
|
|
);
|
|
}
|