Files
buzz/benchmarks/harbor-buzz-orchestra/tests/conftest.py
1e307e178a chore(compose): remove stale typesense env vars (#3332)
Search migrated to Postgres FTS (commit f8bbe6efc). 

The Typesense container was removed from compose.yml and the Helm chart,
but the cleanup missed two template/config files:

- `deploy/compose/.env.example`: `TYPESENSE_API_KEY` and
`TYPESENSE_PORT` are dead — no typesense service exists in compose.yml
and the relay binary no longer reads `TYPESENSE_API_KEY`. The
`CHANGE_ME_RANDOM_API_KEY` placeholder was never consumed, so removing
it also unbreaks the sed loop in the blog draft (one fewer no-op secret
to generate).
- `benchmarks/harbor-buzz-orchestra/scripts/benchmark.py`: generates a
typesense_api_key in state and writes `TYPESENSE_API_KEY` to the .env
file it creates.
- *Editing this file caused the
https://github.com/block/buzz/blob/main/.github/workflows/benchmark-harbor.yml
linter ci checks to run, which seemingly haven't run before, so I needed
fix the lint issues to pass this.*

---------

Signed-off-by: Kalvin Chau <kalvin@block.xyz>
Co-authored-by: npub1c4alndp82zyt9veaklm5d965quss79vlhk9awv7qu5erwhmf42qqlvc25c <c57bf9b4275088b2b33db7f746975407210f159fbd8bd733c0e532375f69aa80@buzz.block.builderlab.xyz>
2026-07-28 12:31:24 -07:00

54 lines
1.6 KiB
Python

from typing import Any
import pytest
@pytest.fixture
def manifest_data() -> dict[str, Any]:
digest = "a" * 64
generation = {
"temperature": 0,
"max_output_tokens": 4096,
"context_window_tokens": 200000,
}
return {
"schema_version": "1",
"condition": "O",
"roster": [
{
"id": "opus-orchestrator",
"kind": "orchestrator",
"role": "orchestrator",
"count": 1,
"endpoint": "databricks/opus",
"model_revision": "2026-07-01",
"prompt": {"path": "prompts/orchestrator.md", "sha256": digest},
"generation": generation,
},
{
"id": "qwen-workers",
"kind": "worker",
"role": "fast-worker",
"count": 4,
"concurrency": 2,
"endpoint": "databricks/qwen",
"model_revision": "revision-42",
"prompt": {"path": "prompts/qwen.md", "sha256": digest},
"generation": {**generation, "context_window_tokens": 32768},
},
],
"prices": {
"databricks/opus": {
"input_per_million_usd": 5,
"cached_input_per_million_usd": 0.5,
"output_per_million_usd": 25,
},
"databricks/qwen": {
"input_per_million_usd": 0.1,
"cached_input_per_million_usd": 0.01,
"output_per_million_usd": 0.2,
},
},
"trial_budget": {"timeout_seconds": 3600, "max_cost_usd": 5},
}