feat: vendor text-watermark detection (Gemini SynthID, Claude seam, MarkLLM) + SynthID image scorer sidecar (#109)

* feat: add vendor text-watermark detection and SynthID image scorer sidecar

Adds Layer B watermark detection as a first-class service capability:

- text_detectors.py: a registry of text-watermark detectors behind one
  interface — Google's official SynthID-text detector via the Gemini API
  (taskType DETECT_TEXT_WATERMARK), a Claude placeholder ready for
  Anthropic's announced detection API, and the MarkLLM research harness
  (KGW / SynthID, same-config-only). Fail-soft: unconfigured or errored
  detectors never block cleaning.
- server.py: new POST /detect endpoint, detect_before / detect_after options
  on /clean (before/after scoring for text and images), an opt-in
  /inspect "detect" flag, and /capabilities gains text_detectors and
  scorers.synthid_http.
- synthid_score_server.py: a stdlib HTTP sidecar for the reverse-SynthID
  scorer, so the published core image never bundles the non-commercial
  upstream code; wired via WATERMARKS_SYNTHID_SCORER_URL.
- score_synthid.py: extract score_file() so the CLI and the sidecar share
  one implementation.
- compose.yaml / Dockerfile.synthid / .env.example: wr-synthid-score sidecar
  service and env wiring.
- README + skill docs, plus tests for the detectors, the /detect endpoint,
  and the image sidecar.

* feat: per-candidate watermark detection for Layer B rewrite candidates

When --candidates N (N > 1) is combined with --markllm-scheme or
WATERMARKS_GEMINI_API_KEY, run every configured text detector from the
text_detectors.py registry on each candidate and report per-candidate
measurements in --json-stats as candidate_scores entries carrying
lexical_divergence, selection_score, selected, and per-detector reports
(is_watermarked, score, threshold where the detector provides one).

Candidate selection stays purely lexical; the detections are observability
for correlating lexical divergence with watermark removal (issue #106).

Converges rewrite_text.py onto the shared detector registry:
- MarkLLMTextDetector gains constructor overrides (scheme, upstream_dir,
  model, timeout) plus the checkout-venv interpreter preference and the
  WATERMARKS_MARKLLM_RLIMIT_AS preexec guard ported from rewrite_text.py;
  the old _markllm_detect / _venv_python / _markllm_preexec helpers are gone.
- run_all_text_detectors() accepts an injected MarkLLM instance and an
  include_markllm switch so CLI flag gating stays intact.
- before/after/cleared semantics unchanged; detection remains fail-soft.

* docs: pin Watermarks in the Sand reference to arXiv v5

* fix: mark only one rewrite candidate as selected (#110)

---------

Co-authored-by: Zhenxin Ai <142008897+ai-kunkun@users.noreply.github.com>
This commit is contained in:
Guillaume Meyer (The Opinionated Man)
2026-08-17 18:31:22 -07:00
committed by GitHub
co-authored by Zhenxin Ai
parent 6df80e77a4
commit a2e72ed019
14 changed files with 1963 additions and 328 deletions
+30
View File
@@ -27,6 +27,13 @@ services:
environment:
# Empty by default (no auth). Set to require `Authorization: Bearer <key>`.
WATERMARKS_SERVER_API_KEY: ${WATERMARKS_SERVER_API_KEY:-}
# Optional Gemini API key enabling vendor SynthID-text watermark
# detection via /detect and detect_before/after (see .env.example).
WATERMARKS_GEMINI_API_KEY: ${WATERMARKS_GEMINI_API_KEY:-}
WATERMARKS_GEMINI_MODEL: ${WATERMARKS_GEMINI_MODEL:-}
# Optional SynthID image scorer sidecar (heavy profile).
WATERMARKS_SYNTHID_SCORER_URL: ${WATERMARKS_SYNTHID_SCORER_URL:-}
WATERMARKS_SYNTHID_SCORER_API_KEY: ${WATERMARKS_SYNTHID_SCORER_API_KEY:-}
read_only: true
tmpfs:
- /tmp
@@ -109,6 +116,29 @@ services:
volumes:
- synthid-cache:/home/scorer/.cache/huggingface
# HTTP SynthID scorer sidecar: lets wr-core score images before/after
# cleaning without bundling the non-commercial reverse-SynthID code in the
# published core image. Reach it via WATERMARKS_SYNTHID_SCORER_URL on
# wr-core (see .env.example) and require the same bearer key on both sides.
wr-synthid-score:
profiles: [heavy]
build:
context: service
dockerfile: Dockerfile.synthid
image: watermarks-remover-synthid-scorer:local
entrypoint: ["python3"]
command: ["/app/synthid_score_server.py", "--host", "0.0.0.0", "--port", "8766"]
read_only: true
tmpfs:
- /tmp
init: true
user: "10001:10001"
environment:
WATERMARKS_SYNTHID_SCORER_API_KEY: ${WATERMARKS_SYNTHID_SCORER_API_KEY:-}
REVERSE_SYNTHID_DIR: /opt/reverse-synthid
volumes:
- synthid-cache:/home/scorer/.cache/huggingface
volumes:
markllm-cache:
markdiffusion-cache: