mirror of
https://github.com/guillaumemeyer/watermarks-remover.git
synced 2026-08-22 13:11:57 +02:00
d5fdaae8a1
* fix: report unmeasurable burstiness instead of scoring it as max LLM-like compute_burstiness returned cv=0.0 for an empty (or single-sentence) list, which the tiering read as perfectly uniform prose — the strongest LLM-likeness signal — so any file whose body yielded no parseable sentences (e.g. entirely wrapped in a code fence) scored falsely high while word_count stayed high enough to defeat the small-sample dampener (#132). On a real export this hit 159 of 162 files as pure artifact. compute_burstiness now returns None for the CV when it cannot be measured; the scoring site drops the burstiness component and renormalizes the composite over AI-phrase density and lexical diversity, with an explicit note. burstiness_cv is null in JSON for unmeasurable cases, the CLI prints n/a instead of crashing, and the uniform-cadence finding guards on cv not being None. * style: satisfy ruff import sorting and formatting --------- Co-authored-by: yzxcj797 <yzxcj797@users.noreply.github.com> Co-authored-by: Guillaume Meyer (The Opinionated Man) <1385518+guillaumemeyer@users.noreply.github.com> Co-authored-by: Guillaume Meyer <guillaumemeyer@users.noreply.github.com>