Files
SnapOtter/apps/docs/guide/database.md
T
SnapOtterandGitHub 17726ae59d docs: multi-modality rebrand, 2.0 architecture accuracy, and full OpenAPI coverage (#254)
* docs: rebrand from image-only to multi-modality across docs and metadata

SnapOtter expanded from image-only to 157 tools across 5 modalities
(image, video, audio, document/PDF, data). Update all product-level
copy, metadata, and i18n that still framed it as an image-only tool.

- README, package.json, root llms.txt: multi-modality framing, 157 tools
- OpenAPI info + tags, generated /llms.txt tagline (docs.ts)
- VitePress docs site: hero, getting-started, architecture, security,
  deployment, configuration, developer, supported-formats
- i18n: 10 product keys across all 21 locales (hero, app description,
  privacy notes, AI features, progress messages, getting-started)
- web/demo/landing meta + privacy copy, COMMUNITY_GUIDE, .env.example

Stale tool counts (53/50+/52/70+/35) corrected to 157 throughout.
Database/container deployment claims left unchanged (out of scope).

* docs: fix stale post-rebrand test assertions and README language list

- tests/e2e-docs/homepage.spec.ts: assert the current docs homepage (file toolkit, 157 tools, 5 modalities) instead of the old image-only strings
- tests/unit/api/docs-route.test.ts: sync the reproduced llms.txt tagline with docs.ts
- README.md: 21 languages with the correct list (add Swedish and Chinese Traditional, drop Czech which is not supported)

* docs: correct 2.0 architecture references (Postgres 17 + Redis 8, 3-container stack)

The docs and metadata still described the 1.x stack (SQLite, single container, p-queue). Update them to the current 2.0 reality.

- README: replace the broken single-container `docker run` quick-start with the real Docker Compose stack (app + Postgres 17 + Redis 8); fix the "no Redis, no Postgres" feature bullet
- package.json: description no longer claims a single container
- apps/docs: rewrite database.md for Postgres; configuration.md DB_PATH -> DATABASE_URL + REDIS_URL; architecture.md SQLite/p-queue/better-sqlite3 -> Postgres/BullMQ/pg and add media-engine + doc-engine; developer/security/deployment/docker-tags/getting-started/contributing compose examples now include postgres + redis; index.md + api/ai.md AI count 16 -> 19
- SECURITY.md: Drizzle (SQLite) -> (PostgreSQL)
- landing: enterprise/FeatureHighlights single-container wording; TrustSignals/ToolGrid 150+ -> 157 (dynamic); Pricing/FAQ 15 -> 19 AI tools

* docs(api): document all video, audio, document, and data tool endpoints in OpenAPI

The spec covered only image tools; the Scalar UI and the generated /llms.txt and /llms-full.txt inherited that gap. Add the 104 missing tool endpoints so the API docs match the code.

- Video: 29 endpoints (most long/async; auto-subtitles is AI)
- Audio: 17 (transcribe-audio is AI)
- Document/PDF: 36 (ocr-pdf is AI; conversions are long/async)
- Data: 10
- Image: 12 newer tools (background-replace, blur-background AI; histogram/lqip-placeholder/sprite-sheet custom responses; barcode-generate uses a JSON body)

Each schema is derived from the tool's Zod validator and executionHint (fast -> 200, long -> 202+SSE, AI adds 501 FeatureNotInstalledError, multi-file inputs as arrays), referencing the existing shared schemas. Tool path entries: 64 -> 168. Spec parses as valid YAML with no duplicate paths and only known $refs.
2026-06-16 18:04:52 +08:00

5.9 KiB

description
description
PostgreSQL database schema, tables, migrations, and backup procedures for SnapOtter.

Database

SnapOtter uses PostgreSQL 17 with Drizzle ORM (pg-core / node-postgres) for data persistence. The schema is defined in apps/api/src/db/schema.ts.

The connection is configured via the DATABASE_URL environment variable (default postgres://snapotter:snapotter@postgres:5432/snapotter). In Docker Compose, the Postgres container stores its data in the SnapOtter-pgdata named volume.

Tables

users

Stores user accounts. Created automatically on first run from DEFAULT_USERNAME and DEFAULT_PASSWORD.

Column Type Notes
id uuid Primary key
username varchar Unique, required
passwordHash varchar scrypt hash
role varchar admin, editor, or user
mustChangePassword boolean Forced password reset flag
createdAt timestamp Creation time
updatedAt timestamp Last update time

sessions

Active login sessions. Each row ties a session token to a user.

Column Type Notes
id varchar Primary key (session token)
userId uuid Foreign key to users.id
expiresAt timestamp Expiry time
createdAt timestamp Creation time

teams

Groups for organizing users. Admins can assign users to teams.

Column Type Description
id uuid Primary key
name varchar (unique, max 50 chars) Team name
createdAt timestamp Creation time

api_keys

API keys for programmatic access. The raw key is shown once on creation; only the hash is stored.

Column Type Notes
id uuid Primary key
userId uuid Foreign key to users.id
keyHash varchar scrypt hash of the key
name varchar User-provided label
createdAt timestamp Creation time
lastUsedAt timestamp Updated on each authenticated request

Keys are prefixed with si_ followed by 96 hex characters (48 random bytes).

pipelines

Saved tool chains that users create in the UI.

Column Type Notes
id uuid Primary key
name varchar Pipeline name
description varchar Optional description
steps jsonb Array of { toolId, settings } objects
createdAt timestamp Creation time

user_files

Persistent file library with version chain tracking. Each processing step that saves a result creates a new row linked to its parent via parentId, forming a version tree.

Column Type Description
id uuid Primary key
userId uuid FK to users (CASCADE DELETE)
originalName varchar Original upload filename
storedName varchar Filename on disk
mimeType varchar MIME type
size integer File size in bytes
width integer Image width in px
height integer Image height in px
version integer Version number (1 = original)
parentId uuid or null FK to user_files (parent version)
toolChain jsonb Tool IDs applied in order to produce this version
createdAt timestamp Creation time

jobs

Tracks processing jobs for progress reporting and cleanup.

Column Type Notes
id uuid Primary key
type varchar Tool or pipeline identifier
status varchar queued, processing, completed, or failed
progress real 0.0-1.0 fraction
inputFiles jsonb Array of input file paths
outputPath varchar Path to the result file
settings jsonb Tool settings used
error varchar Error message if failed
createdAt timestamp Creation time
completedAt timestamp Completion time

settings

Key-value store for server-wide settings that admins can change from the UI.

Column Type Notes
key varchar Primary key
value varchar Setting value
updatedAt timestamp Last update time

roles

Custom roles with granular permissions.

Column Type Notes
id uuid Primary key
name varchar Unique role name
description varchar Optional description
permissions jsonb Array of permission strings
createdAt timestamp Creation time

audit_log

Security-relevant action log.

Column Type Notes
id uuid Primary key
userId uuid FK to users
action varchar Action type
details jsonb Action-specific data
createdAt timestamp Action time

Migrations

Drizzle handles schema migrations. Migration files live in apps/api/drizzle/. During development:

cd apps/api
npx drizzle-kit generate   # generate a migration from schema changes
npx drizzle-kit migrate    # apply pending migrations

In production, pending migrations are applied automatically on startup.

Backup and restore

The relational database lives in the Postgres container's SnapOtter-pgdata volume, not the app's /data volume.

Option 1: pg_dump (recommended)

# Dump the database while the stack is running
docker exec SnapOtter-postgres pg_dump -U snapotter snapotter > backup.sql

# Restore into a fresh database
cat backup.sql | docker exec -i SnapOtter-postgres psql -U snapotter snapotter

Option 2: Volume snapshot

# Stop the stack, then snapshot the pgdata volume
docker compose down
docker run --rm -v SnapOtter-pgdata:/data -v $(pwd)/backup:/backup \
  alpine tar czf /backup/snapotter-pgdata.tar.gz -C /data .

Migrating from 1.x (SQLite)

If you are upgrading from SnapOtter 1.x, set SQLITE_MIGRATE_PATH to the path of your old snapotter.db file on first boot. The migration runs once and imports users, settings, pipelines, and files into Postgres. Remove the variable after migration succeeds.