docker-compose.yml

version: "3.9"
services:
  dashboard:
    build: .
    ports:
      - "6677:6677"
    volumes:
      - ./data:/data
    environment:
      - DATA_DIR=/data
      - PARQUET_URL=https://github.com/digitalcortex/72m-domains-dataset/raw/refs/heads/master/domains.parquet
      - CONCURRENCY_LIMIT=50
      - SCORE_THRESHOLD=60
      - TARGET_TLDS=es,com,net
      - TARGET_COUNTRIES=ES,GB,DE,FR,RO,PT,AD,IT
      - REPLICATE_API_TOKEN=r8_7I7Feai78f9PzMOs20y5GVFKiLkgUWP463vZO
      - AI_CONCURRENCY=3
    restart: unless-stopped
feat: initial Dockerized domain intelligence dashboard - FastAPI backend with DuckDB pushdown queries on 72M parquet - Async enrichment worker: HTTP, SSL, DNS MX, CMS fingerprint, ip-api.com - Resumable parquet download with HTTP Range support - Lead scoring engine (max 100 pts, target countries ES,GB,DE,FR,RO,PT,AD,IT) - Single-file Alpine.js + Chart.js dashboard on port 6677 - SQLite enrichment DB with job queue and scores tables - Dockerized with persistent /data volume Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> 2026-04-13 16:22:30 +02:00			`version: "3.9"`
			`services:`
			`dashboard:`
			`build: .`
			`ports:`
			`- "6677:6677"`
			`volumes:`
			`- ./data:/data`
			`environment:`
			`- DATA_DIR=/data`
			`- PARQUET_URL=https://github.com/digitalcortex/72m-domains-dataset/raw/refs/heads/master/domains.parquet`
			`- CONCURRENCY_LIMIT=50`
			`- SCORE_THRESHOLD=60`
			`- TARGET_TLDS=es,com,net`
			`- TARGET_COUNTRIES=ES,GB,DE,FR,RO,PT,AD,IT`
feat: deep site analysis engine + fix AI assess for any domain site_analyzer.py (new): - Fresh scrape with timing, page size, server, CMS detection - Lorem ipsum detection (16 phrases incl. user's example) - Placeholder content detection (hello world, sample page, etc.) - Analytics: GA4, GTM, Facebook Pixel, Hotjar, Clarity - Webmaster: Google Search Console, Bing, Yandex verification tags - sitemap.xml and robots.txt check + Googlebot block detection - Mobile viewport check, word count, image/script count - Full contact extraction: emails, phones, WhatsApp, social links - Kit Digital signal detection AI worker fix: - No longer requires pre-enrichment — works on ANY selected domain - Does fresh site_analyzer scrape then calls Gemini with full context - Stores site_analysis JSON alongside AI assessment - Upserts into enriched_domains even if domain was never enriched Gemini prompt now includes: - Complete technical snapshot (load time, size, server, SSL) - Full SEO signals (sitemap, robots, analytics, webmaster verified) - Content quality (lorem ipsum matches, placeholder matches) - Kit Digital signals - All extracted contacts - 500-word page text sample - Outputs: summary, site_quality_score/10, content_issues[], urgency_signals[], performance_notes, seo_status, best_contact_channel+value, all_contacts, ES pitch, services_needed, outreach_notes UI: rich AI modal with summary banner, quality grid, content issues, urgency signals, full contact list, technical snapshot Fixes: correct Replicate token, ai_queue status='running' bug Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> 2026-04-13 17:46:01 +02:00			`- REPLICATE_API_TOKEN=r8_7I7Feai78f9PzMOs20y5GVFKiLkgUWP463vZO`
feat: Gemini AI assessment, Kit Digital detection, contact extraction Kit Digital detection (enricher.py): - Scans img src/alt/srcset for digitalizadores, kit-digital, fondos-europeos etc - Scans page text for Kit Digital, Agente Digitalizador, Next Generation EU, PRTR - Scans links for acelerapyme.es, red.es, kit-digital refs - +20 score bonus for Kit Digital confirmed sites (proven IT buyers) Contact extraction (enricher.py): - Pulls mailto/tel/wa.me links from HTML - Extracts email addresses via regex, phone numbers (ES format) - Detects social media links (FB, IG, LinkedIn, Twitter, TikTok) - Stored as JSON in contact_info column Gemini via Replicate (replicate_ai.py): - Assesses lead quality (HOT/WARM/COLD), Kit Digital confirmation - Identifies best contact channel + actual value (email/phone/WA) - Writes Spanish cold-call/email pitch angle - Lists services likely needed + outreach notes - 3 concurrent requests, 90s timeout, JSON output parsing DB: migration adds kit_digital, kit_digital_signals, contact_info, ai_assessment, ai_lead_quality, ai_pitch, ai_contact_channel/value, ai_queue table UI: Kit Digital 🏅 badge, AI quality pill (clickable modal with full assessment), contact chips (email/phone/WA/social), AI Assess button, Kit Digital only filter, AI queue status in enrichment tab Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> 2026-04-13 17:25:06 +02:00			`- AI_CONCURRENCY=3`
feat: initial Dockerized domain intelligence dashboard - FastAPI backend with DuckDB pushdown queries on 72M parquet - Async enrichment worker: HTTP, SSL, DNS MX, CMS fingerprint, ip-api.com - Resumable parquet download with HTTP Range support - Lead scoring engine (max 100 pts, target countries ES,GB,DE,FR,RO,PT,AD,IT) - Single-file Alpine.js + Chart.js dashboard on port 6677 - SQLite enrichment DB with job queue and scores tables - Dockerized with persistent /data volume Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> 2026-04-13 16:22:30 +02:00			`restart: unless-stopped`