mirror of
https://github.com/rennf93/roboco.git
synced 2026-08-03 07:23:24 +02:00
[aaac85d2] Rate limit guardrails for Anthropic and Ollama providers (#104)
* [25aa5b24] Implement rate-limit Zustand store, Axios interceptor, WebSocket hook, banner component, and page-load sync (#99) (#101) * [25aa5b24] feat(rate-limits): add types, Zustand store, Axios 429 interceptor, WS hook, sync hook, and banner component - panel/src/types/rate-limits.ts: RateLimitEntry, RateLimitHitEvent, RateLimitLiftedEvent, RateLimitApiResponse - panel/src/store/rate-limit-store.ts: useRateLimitStore with Map state, hitRateLimit/liftRateLimit/syncFromApi - panel/src/lib/api/rate-limits.ts: GET /api/system/rate-limits with isMockMode guard - panel/src/lib/api/client.ts: 429 interceptor dispatches to store first, Sonner toast on retry exhaustion - panel/src/hooks/use-rate-limit-websocket.ts: RATE_LIMIT_HIT/LIFTED events + onReconnect callback - panel/src/hooks/use-rate-limit-sync.ts: mount sync + no-op with console.warn when endpoint unavailable - panel/src/components/rate-limit/rate-limit-banner.tsx: amber rows with countdown, no dismiss button - panel/src/app/(dashboard)/layout.tsx: RateLimitBanner mounted below Header - store/index.ts, hooks/index.ts: export new store and hooks * [25aa5b24] fix(rate-limit-banner): use lint-clean countdown pattern (computeSecondsLeft outside render) * [25aa5b24] fix(client): add real retry loop to 429 interceptor so Sonner toast fires on exhaustion - Increment error.config._retryCount and return api(error.config) when retryCount < RATE_LIMIT_MAX_RETRIES, actually retrying the request. - Toast fires only when retryCount >= RATE_LIMIT_MAX_RETRIES (3 attempts). - Fixes AC4: toast was dead code because without return api(error.config) every 429 saw retryCount=1, permanently below the threshold of 3. --------- Co-authored-by: Frontend Developer 1 <fe-dev-1@agents.roboco.dev> * [4112cd34] feat(rate-limit): add RateLimitError with 5-retry exponential backoff at all LLM call sites (#102) (#103) - Create roboco/services/exceptions.py with RateLimitError(provider, retry_after), HTTP_TOO_MANY_REQUESTS, MAX_RATE_LIMIT_RETRIES constants, and parse_retry_after_header() helper - extraction.py: extract _call_anthropic_with_retry() helper; retry Anthropic call 5x on 429 with exponential backoff; re-raise RateLimitError from outer except instead of swallowing it - ollama_embedder.py: 5-retry outer loop (429) wrapping existing 3-retry inner loop (ConnectError/Timeout) for all 4 call sites; two concerns kept isolated - indexes/base.py, mentor.py, validator.py: replace magic 429 literals with HTTP_TOO_MANY_REQUESTS; 5-retry loop on 429 for LLM calls - middleware.py: add rate_limit_exception_handler returning HTTP 429 with Retry-After response header - tests/unit/services/test_rate_limit_retry.py: 28 tests covering exhaustion, Retry-After header sleep, partial retries then success, ConnectError isolation Co-authored-by: Backend Developer 1 <be-dev-1@agents.roboco.dev> * [18107054] feat(rate-limit): Redis rate-limit state tracker + i_am_blocked rate_limited path (#105) (#106) - Add RateLimitStateTracker in roboco/services/gateway/rate_limit_tracker.py with activate(), clear(), is_rate_limited(), get_state(), increment_probe_failures(), reset_probe_failures() backed by redis.asyncio - Add RATE_LIMIT_HIT = "rate_limit.hit" to EventType StrEnum in events.py - Add _handle_rate_limited_parking() to Choreographer: intercepts i_am_blocked(reason='rate_limited') before block state transition, parks all active agents sharing affected provider via mark_waiting_long, publishes RATE_LIMIT_HIT event to StreamEventBus, task stays in_progress - Add get_provider_for_agent() and get_active_agent_slugs_for_provider() helper methods to AgentOrchestrator - Wire orchestrator and stream_bus into ChoreographerDeps via deps.py - Add test_rate_limit_tracker.py (basic ops, probe failures, cross-reconnection persistence, provider isolation) and test_i_am_blocked_rate_limited.py (AC3/AC4/AC5 coverage: task stays in_progress, mark_waiting_long call count equals active agent count, RATE_LIMIT_HIT event payload structure) Co-authored-by: Backend Developer 1 <be-dev-1@agents.roboco.dev> * [5501e4b4] Wire RateLimitStateTracker into live orchestrator paths — 4 CEO-identified integration gaps (#109) * [8451ca50] feat(gateway): wire RateLimitStateTracker.activate() into i_am_blocked rate-limited path and add provider-rate-limit gate to decide_spawn() (#107) - Add provider/provider_rate_limited optional fields to TriggerContext (backward-compatible defaults) - Insert rule 2 in decide_spawn(): QUEUE when trigger.provider_rate_limited is True with reason 'provider X rate-limited' - Call RateLimitStateTracker(provider).activate() in _handle_rate_limited_parking() after mark_waiting_long loop (wrapped in contextlib.suppress for Redis fault tolerance) - Extend gateway_pre_spawn_check() with optional provider param; check RateLimitStateTracker.is_rate_limited() when provider is known - Pass provider=self.get_provider_for_agent(agent_id) from orchestrator call site - Add TestProviderRateLimitGate (6 tests) to test_trigger_filter.py - Add TestRateLimitTrackerActivateOnParking (6 tests) to test_i_am_blocked_rate_limited.py - All 38 unit tests pass; ruff and mypy clean on changed files Co-authored-by: Backend Developer 1 <be-dev-1@agents.roboco.dev> * [e9cef0f0] feat(rate-limits): sweeper probe loop, CEO notification, and GET /api/system/rate-limits endpoint (AC4, AC8, AC9) (#108) - Add RATE_LIMIT_LIFTED event type to EventType enum in models/events.py - Add RateLimitStateTracker.list_rate_limited_providers() classmethod to scan Redis for all currently rate-limited providers (used by the new endpoint) - Add orchestrator._rate_limit_probe_loop(): background task started/stopped in start()/stop(), runs _sweep_rate_limit_probes() every 30s - Add orchestrator._probe_one_provider(): checks estimated_lift_at gate, calls _do_probe(); on success: tracker.clear(), resolve_wait() for all parked agents with waiting_for='rate_limit_lifted' matching the provider, publishes RATE_LIMIT_LIFTED event; on failure: increments probe_failures counter, sends CEO notification at threshold 10 (once per episode via _rate_limit_ceo_notified) - Add orchestrator._make_tracker(): injectable factory for RateLimitStateTracker - Add orchestrator._do_probe(): overridable async bool probe (default: True) - Add orchestrator._notify_rate_limit_ceo(): high-priority notification to CEO containing provider name, duration since activation, and paused agent count - Add roboco/api/routes/system.py with GET /rate-limits endpoint (AC9) - Register system_router in app.py under /api/system prefix - Add 17 unit tests in tests/unit/runtime/test_rate_limit_sweep.py covering all AC4/AC8/AC9 paths: probe success/failure, CEO threshold, endpoint schema Co-authored-by: Backend Developer 1 <be-dev-1@agents.roboco.dev> --------- Co-authored-by: Backend Developer 1 <be-dev-1@agents.roboco.dev> --------- Co-authored-by: Frontend Developer 1 <fe-dev-1@agents.roboco.dev> Co-authored-by: Backend Developer 1 <be-dev-1@agents.roboco.dev> Co-authored-by: Renn F <rennf93@users.noreply.github.com>
This commit is contained in:
Renzo F
co-authored by
Backend Developer 1
Frontend Developer 1
Renn F
Backend Developer 1
Frontend Developer 1
Renn F
parent
cc4ccb7ea3
commit
98e618c243
@@ -2,6 +2,7 @@ import { Suspense } from "react";
|
||||
import { Sidebar } from "@/components/layout/sidebar";
|
||||
import { Header } from "@/components/layout/header";
|
||||
import { ScrollRestoration } from "@/components/scroll-restoration";
|
||||
import { RateLimitBanner } from "@/components/rate-limit/rate-limit-banner";
|
||||
|
||||
export default function DashboardLayout({
|
||||
children,
|
||||
@@ -13,6 +14,7 @@ export default function DashboardLayout({
|
||||
<Sidebar />
|
||||
<div className="flex flex-1 flex-col overflow-hidden">
|
||||
<Header />
|
||||
<RateLimitBanner />
|
||||
<main className="flex-1 overflow-auto bg-muted/30 p-6">
|
||||
<Suspense fallback={null}>
|
||||
<ScrollRestoration />
|
||||
|
||||
@@ -0,0 +1,95 @@
|
||||
"use client";
|
||||
|
||||
import { useEffect, useState, useCallback } from "react";
|
||||
import { AlertTriangle } from "lucide-react";
|
||||
import { useRateLimitStore } from "@/store/rate-limit-store";
|
||||
import { useRateLimitSync } from "@/hooks/use-rate-limit-sync";
|
||||
import { useRateLimitWebSocket } from "@/hooks/use-rate-limit-websocket";
|
||||
import type { RateLimitEntry } from "@/types/rate-limits";
|
||||
|
||||
// =============================================================================
|
||||
// Countdown row for a single rate-limited provider
|
||||
// =============================================================================
|
||||
|
||||
function computeSecondsLeft(resumeAt: string): number {
|
||||
return Math.max(
|
||||
0,
|
||||
Math.ceil((new Date(resumeAt).getTime() - Date.now()) / 1000)
|
||||
);
|
||||
}
|
||||
|
||||
function RateLimitRow({ entry }: { entry: RateLimitEntry }) {
|
||||
const resumeAt = entry.resumeAt;
|
||||
const [secondsLeft, setSecondsLeft] = useState(() =>
|
||||
computeSecondsLeft(resumeAt)
|
||||
);
|
||||
|
||||
useEffect(() => {
|
||||
// Tick every second; re-runs when resumeAt changes (re-hit same provider)
|
||||
const id = setInterval(() => {
|
||||
setSecondsLeft(computeSecondsLeft(resumeAt));
|
||||
}, 1000);
|
||||
return () => clearInterval(id);
|
||||
}, [resumeAt]);
|
||||
|
||||
const agentCount = entry.affectedAgents.length;
|
||||
|
||||
return (
|
||||
<div className="flex items-center gap-3 px-4 py-2 bg-amber-50 border-b border-amber-300 last:border-b-0">
|
||||
<AlertTriangle className="h-4 w-4 text-amber-600 shrink-0" />
|
||||
<span className="text-sm font-medium text-amber-900">
|
||||
{entry.provider}
|
||||
</span>
|
||||
{agentCount > 0 && (
|
||||
<span className="text-sm text-amber-700">
|
||||
{agentCount} agent{agentCount !== 1 ? "s" : ""} affected
|
||||
</span>
|
||||
)}
|
||||
<span className="text-sm text-amber-700">
|
||||
{secondsLeft}s
|
||||
</span>
|
||||
<span className="text-sm text-amber-800 font-medium ml-auto">
|
||||
operations paused — resuming automatically
|
||||
</span>
|
||||
</div>
|
||||
);
|
||||
}
|
||||
|
||||
// =============================================================================
|
||||
// Main banner component
|
||||
// =============================================================================
|
||||
|
||||
export function RateLimitBanner() {
|
||||
const limits = useRateLimitStore((state) => state.limits);
|
||||
|
||||
// Sync hook — calls GET /api/system/rate-limits on mount and exposes sync()
|
||||
const { sync } = useRateLimitSync();
|
||||
|
||||
// Called when the WS reconnects — re-sync state from API
|
||||
const handleReconnect = useCallback(() => {
|
||||
void sync();
|
||||
}, [sync]);
|
||||
|
||||
// WS hook — subscribes to RATE_LIMIT_HIT / RATE_LIMIT_LIFTED events
|
||||
useRateLimitWebSocket({ onReconnect: handleReconnect });
|
||||
|
||||
// Nothing to show when no providers are rate-limited
|
||||
if (limits.size === 0) {
|
||||
return null;
|
||||
}
|
||||
|
||||
const entries = Array.from(limits.values());
|
||||
|
||||
return (
|
||||
<div
|
||||
className="border-b border-amber-300 bg-amber-50"
|
||||
role="alert"
|
||||
aria-live="polite"
|
||||
aria-label="Rate limit notifications"
|
||||
>
|
||||
{entries.map((entry) => (
|
||||
<RateLimitRow key={entry.provider} entry={entry} />
|
||||
))}
|
||||
</div>
|
||||
);
|
||||
}
|
||||
@@ -1,4 +1,6 @@
|
||||
export * from "./use-tasks";
|
||||
export * from "./use-rate-limit-websocket";
|
||||
export * from "./use-rate-limit-sync";
|
||||
export * from "./use-agents";
|
||||
export * from "./use-channels";
|
||||
export * from "./use-notifications";
|
||||
|
||||
@@ -0,0 +1,36 @@
|
||||
"use client";
|
||||
|
||||
import { useEffect, useCallback } from "react";
|
||||
import { rateLimitsApi } from "@/lib/api/rate-limits";
|
||||
import { useRateLimitStore } from "@/store/rate-limit-store";
|
||||
|
||||
/**
|
||||
* Calls GET /api/system/rate-limits on mount and passes results to syncFromApi.
|
||||
* Is a no-op (with console.warn) when the endpoint is unavailable.
|
||||
* Also exposes a sync() function that can be called on WS reconnect.
|
||||
*/
|
||||
export function useRateLimitSync() {
|
||||
const { syncFromApi } = useRateLimitStore();
|
||||
|
||||
const sync = useCallback(async () => {
|
||||
try {
|
||||
const response = await rateLimitsApi.getRateLimits();
|
||||
syncFromApi(response);
|
||||
} catch (err) {
|
||||
// Endpoint unavailable — treat as no-op per acceptance criteria
|
||||
const status = (err as { response?: { status?: number } })?.response?.status;
|
||||
if (status === 404) {
|
||||
console.warn("[rate-limits] GET /api/system/rate-limits returned 404 — endpoint not available");
|
||||
} else {
|
||||
console.warn("[rate-limits] GET /api/system/rate-limits unavailable:", err);
|
||||
}
|
||||
}
|
||||
}, [syncFromApi]);
|
||||
|
||||
// Sync on mount
|
||||
useEffect(() => {
|
||||
void sync();
|
||||
}, [sync]);
|
||||
|
||||
return { sync };
|
||||
}
|
||||
@@ -0,0 +1,70 @@
|
||||
"use client";
|
||||
|
||||
import { useEffect, useRef } from "react";
|
||||
import { useWebSocket } from "./use-websocket";
|
||||
import { useRateLimitStore } from "@/store/rate-limit-store";
|
||||
import type { RateLimitHitEvent, RateLimitLiftedEvent } from "@/types/rate-limits";
|
||||
|
||||
interface RateLimitWsMessage {
|
||||
type: string;
|
||||
provider?: string;
|
||||
affectedAgents?: string[];
|
||||
retryAfterSeconds?: number;
|
||||
timestamp?: string;
|
||||
}
|
||||
|
||||
interface UseRateLimitWebSocketOptions {
|
||||
/** Called when the WebSocket reconnects after a disconnect */
|
||||
onReconnect?: () => void;
|
||||
}
|
||||
|
||||
/**
|
||||
* Subscribes to RATE_LIMIT_HIT and RATE_LIMIT_LIFTED WebSocket events and
|
||||
* dispatches them to the useRateLimitStore. Accepts an optional onReconnect
|
||||
* callback that fires when the connection recovers from a reconnecting state.
|
||||
*/
|
||||
export function useRateLimitWebSocket(options: UseRateLimitWebSocketOptions = {}) {
|
||||
const { onReconnect } = options;
|
||||
const prevStateRef = useRef<string | null>(null);
|
||||
|
||||
const { state, lastMessage } = useWebSocket<RateLimitWsMessage>(
|
||||
"/ws/system",
|
||||
undefined,
|
||||
true
|
||||
);
|
||||
|
||||
// Fire onReconnect when state transitions from reconnecting → connected
|
||||
useEffect(() => {
|
||||
if (prevStateRef.current === "reconnecting" && state === "connected") {
|
||||
onReconnect?.();
|
||||
}
|
||||
prevStateRef.current = state;
|
||||
}, [state, onReconnect]);
|
||||
|
||||
// Handle incoming WS messages
|
||||
useEffect(() => {
|
||||
if (!lastMessage) return;
|
||||
|
||||
const { hitRateLimit, liftRateLimit } = useRateLimitStore.getState();
|
||||
|
||||
if (lastMessage.type === "RATE_LIMIT_HIT") {
|
||||
const event: RateLimitHitEvent = {
|
||||
type: "RATE_LIMIT_HIT",
|
||||
provider: lastMessage.provider ?? "unknown",
|
||||
affectedAgents: lastMessage.affectedAgents ?? [],
|
||||
retryAfterSeconds: lastMessage.retryAfterSeconds ?? 60,
|
||||
timestamp: lastMessage.timestamp ?? new Date().toISOString(),
|
||||
};
|
||||
hitRateLimit(event);
|
||||
} else if (lastMessage.type === "RATE_LIMIT_LIFTED") {
|
||||
const event: RateLimitLiftedEvent = {
|
||||
type: "RATE_LIMIT_LIFTED",
|
||||
provider: lastMessage.provider ?? "unknown",
|
||||
timestamp: lastMessage.timestamp ?? new Date().toISOString(),
|
||||
};
|
||||
liftRateLimit(event);
|
||||
}
|
||||
}, [lastMessage]);
|
||||
|
||||
return { wsState: state };
|
||||
}
|
||||
@@ -1,5 +1,17 @@
|
||||
import axios, { AxiosInstance, AxiosError } from "axios";
|
||||
import { toast } from "sonner";
|
||||
import { API_URL, CEO_AGENT_ID, CEO_ROLE } from "@/lib/constants";
|
||||
import { useRateLimitStore } from "@/store/rate-limit-store";
|
||||
import type { RateLimitHitEvent } from "@/types/rate-limits";
|
||||
|
||||
// Custom Axios config extension for retry tracking
|
||||
declare module "axios" {
|
||||
interface InternalAxiosRequestConfig {
|
||||
_retryCount?: number;
|
||||
}
|
||||
}
|
||||
|
||||
const RATE_LIMIT_MAX_RETRIES = 3;
|
||||
|
||||
// Create axios instance with default config
|
||||
const api: AxiosInstance = axios.create({
|
||||
@@ -47,6 +59,46 @@ api.interceptors.response.use(
|
||||
const errorData = error.response?.data as Record<string, unknown> | undefined;
|
||||
const errorDetail = errorData?.detail || error.message;
|
||||
|
||||
// -------------------------------------------------------------------------
|
||||
// 429 Rate-limit handling — FIRST side-effect, before any other logic
|
||||
// -------------------------------------------------------------------------
|
||||
if (status === 429) {
|
||||
const retryAfterHeader = error.response?.headers?.["retry-after"];
|
||||
const retryAfterSeconds = retryAfterHeader ? parseInt(String(retryAfterHeader), 10) : 60;
|
||||
const safeRetryAfter = isNaN(retryAfterSeconds) ? 60 : retryAfterSeconds;
|
||||
|
||||
// Extract provider from custom header or fall back to URL path heuristics
|
||||
const providerHeader = error.response?.headers?.["x-provider"];
|
||||
const urlProvider = url
|
||||
? (["anthropic", "openai", "ollama"].find((p) => url.includes(p)) ?? "unknown")
|
||||
: "unknown";
|
||||
const provider = (providerHeader as string | undefined) ?? urlProvider;
|
||||
|
||||
// Dispatch to store as first side-effect
|
||||
const hitEvent: RateLimitHitEvent = {
|
||||
type: "RATE_LIMIT_HIT",
|
||||
provider,
|
||||
affectedAgents: [],
|
||||
retryAfterSeconds: safeRetryAfter,
|
||||
timestamp: new Date().toISOString(),
|
||||
};
|
||||
useRateLimitStore.getState().hitRateLimit(hitEvent);
|
||||
|
||||
// Track retry count; retry the request until exhausted, then toast
|
||||
const retryCount = (error.config?._retryCount ?? 0) + 1;
|
||||
if (error.config) {
|
||||
error.config._retryCount = retryCount;
|
||||
if (retryCount < RATE_LIMIT_MAX_RETRIES) {
|
||||
// Retry the request — interceptor re-runs on each subsequent 429
|
||||
return api(error.config);
|
||||
}
|
||||
}
|
||||
// Retries exhausted — notify the user via Sonner toast
|
||||
toast.warning(
|
||||
`Rate limited by ${provider}. The system has paused operations and will resume automatically in ~${safeRetryAfter}s.`
|
||||
);
|
||||
}
|
||||
|
||||
// Log comprehensive error info
|
||||
console.error(`[API] ✗ ${method} ${url}`, {
|
||||
status,
|
||||
|
||||
@@ -0,0 +1,18 @@
|
||||
import api from "./client";
|
||||
import type { RateLimitApiResponse } from "@/types/rate-limits";
|
||||
import { isMockMode } from "@/lib/mock-data";
|
||||
|
||||
export const rateLimitsApi = {
|
||||
/**
|
||||
* GET /api/system/rate-limits — fetch active rate limits on page load or WS reconnect.
|
||||
* Returns empty list in mock mode (rate limits are a real-backend-only concern).
|
||||
*/
|
||||
getRateLimits: async (): Promise<RateLimitApiResponse> => {
|
||||
if (isMockMode()) {
|
||||
console.warn("[rate-limits] isMockMode: skipping GET /api/system/rate-limits");
|
||||
return { entries: [] };
|
||||
}
|
||||
const { data } = await api.get<RateLimitApiResponse>("/system/rate-limits");
|
||||
return data;
|
||||
},
|
||||
};
|
||||
@@ -1,2 +1,3 @@
|
||||
export { useUIStore } from "./ui-store";
|
||||
export { useNotificationStore } from "./notifications-store";
|
||||
export { useRateLimitStore } from "./rate-limit-store";
|
||||
|
||||
@@ -0,0 +1,53 @@
|
||||
import { create } from "zustand";
|
||||
import type {
|
||||
RateLimitEntry,
|
||||
RateLimitHitEvent,
|
||||
RateLimitLiftedEvent,
|
||||
RateLimitApiResponse,
|
||||
} from "@/types/rate-limits";
|
||||
|
||||
interface RateLimitState {
|
||||
/** Active rate limits keyed by provider name */
|
||||
limits: Map<string, RateLimitEntry>;
|
||||
|
||||
// Actions
|
||||
hitRateLimit: (event: RateLimitHitEvent) => void;
|
||||
liftRateLimit: (event: RateLimitLiftedEvent) => void;
|
||||
syncFromApi: (response: RateLimitApiResponse) => void;
|
||||
}
|
||||
|
||||
export const useRateLimitStore = create<RateLimitState>((set) => ({
|
||||
limits: new Map<string, RateLimitEntry>(),
|
||||
|
||||
hitRateLimit: (event: RateLimitHitEvent) =>
|
||||
set((state) => {
|
||||
const next = new Map(state.limits);
|
||||
const entry: RateLimitEntry = {
|
||||
provider: event.provider,
|
||||
affectedAgents: event.affectedAgents,
|
||||
hitAt: event.timestamp,
|
||||
resumeAt: new Date(
|
||||
new Date(event.timestamp).getTime() + event.retryAfterSeconds * 1000
|
||||
).toISOString(),
|
||||
retryAfterSeconds: event.retryAfterSeconds,
|
||||
};
|
||||
next.set(event.provider, entry);
|
||||
return { limits: next };
|
||||
}),
|
||||
|
||||
liftRateLimit: (event: RateLimitLiftedEvent) =>
|
||||
set((state) => {
|
||||
const next = new Map(state.limits);
|
||||
next.delete(event.provider);
|
||||
return { limits: next };
|
||||
}),
|
||||
|
||||
syncFromApi: (response: RateLimitApiResponse) =>
|
||||
set(() => {
|
||||
const next = new Map<string, RateLimitEntry>();
|
||||
for (const entry of response.entries) {
|
||||
next.set(entry.provider, entry);
|
||||
}
|
||||
return { limits: next };
|
||||
}),
|
||||
}));
|
||||
@@ -0,0 +1,53 @@
|
||||
// =============================================================================
|
||||
// RATE LIMIT TYPES
|
||||
// =============================================================================
|
||||
|
||||
/**
|
||||
* Represents an active rate-limit entry for a provider.
|
||||
* Stored in the Zustand store keyed by provider name.
|
||||
*/
|
||||
export interface RateLimitEntry {
|
||||
/** The AI provider that is rate-limited (e.g. "anthropic", "openai") */
|
||||
provider: string;
|
||||
/** Agent slugs affected by this rate limit */
|
||||
affectedAgents: string[];
|
||||
/** ISO timestamp when the rate limit was hit */
|
||||
hitAt: string;
|
||||
/** ISO timestamp when the rate limit is expected to lift (hitAt + retryAfterSeconds) */
|
||||
resumeAt: string;
|
||||
/** How many seconds until operations resume */
|
||||
retryAfterSeconds: number;
|
||||
}
|
||||
|
||||
/**
|
||||
* WebSocket event emitted when a rate limit is triggered.
|
||||
*/
|
||||
export interface RateLimitHitEvent {
|
||||
type: "RATE_LIMIT_HIT";
|
||||
/** The AI provider being rate-limited */
|
||||
provider: string;
|
||||
/** Agent slugs affected */
|
||||
affectedAgents: string[];
|
||||
/** How many seconds to wait before retrying */
|
||||
retryAfterSeconds: number;
|
||||
/** ISO timestamp of the event */
|
||||
timestamp: string;
|
||||
}
|
||||
|
||||
/**
|
||||
* WebSocket event emitted when a rate limit is cleared.
|
||||
*/
|
||||
export interface RateLimitLiftedEvent {
|
||||
type: "RATE_LIMIT_LIFTED";
|
||||
/** The AI provider whose rate limit has been lifted */
|
||||
provider: string;
|
||||
/** ISO timestamp of the event */
|
||||
timestamp: string;
|
||||
}
|
||||
|
||||
/**
|
||||
* Response shape from GET /api/system/rate-limits
|
||||
*/
|
||||
export interface RateLimitApiResponse {
|
||||
entries: RateLimitEntry[];
|
||||
}
|
||||
Reference in New Issue
Block a user