External/coreclaw-api-directory
1
0
Fork 0
mirror of https://github.com/cporter202/coreclaw-api-directory.git synced 2026-08-03 21:15:24 +02:00
Code Issues Packages Projects Releases Wiki Activity

Flatten categories and add linked footer

Browse Source
This commit is contained in:
cporter202
2026-07-23 13:30:03 -04:00
parent e3542f1ea7
commit 2398375ca0
16 changed files with 49 additions and 104 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+20 -15
View File
@@ -3,7 +3,7 @@
</p> </p>
<p align="center"> <p align="center">
<a href="categories/README.md"><strong>Browse categories</strong></a> <a href="#categories"><strong>Browse categories</strong></a>
· ·
<a href="#directory">All 118 APIs</a> <a href="#directory">All 118 APIs</a>
· ·
@@ -33,9 +33,6 @@ A polished, community-maintained directory of **118 public CoreClaw Workers** fo
<a href="https://coreclaw.com?fpr=chris69"><strong>Explore CoreClaw →</strong></a> <a href="https://coreclaw.com?fpr=chris69"><strong>Explore CoreClaw →</strong></a>
</p> </p>
> [!NOTE]
> **Affiliate disclosure:** Worker and CoreClaw links in this directory include the maintainer’s FirstPromoter referral parameter, `fpr=chris69`. If you create an account or purchase through one of these links, the maintainer may receive a commission at no additional cost to you. This helps support continued maintenance of the directory.
## At a glance ## At a glance
<table> <table>
@@ -56,17 +53,17 @@ Choose a category to open its dedicated repository folder. Inside each category
| | Category | APIs | What you can collect | | | Category | APIs | What you can collect |
|---:|---|---:|---| |---:|---|---:|---|
| 🛍️ | [**E-Commerce & Marketplaces**](categories/e-commerce-marketplaces/README.md) | **28** | Products, pricing, reviews, stores, suppliers and marketplace intelligence. | | 🛍️ | [**E-Commerce & Marketplaces**](e-commerce-marketplaces/README.md) | **28** | Products, pricing, reviews, stores, suppliers and marketplace intelligence. |
| 🌐 | [**Social & Creator Data**](categories/social-creator-data/README.md) | **47** | Profiles, posts, comments, creators, events and audience signals. | | 🌐 | [**Social & Creator Data**](social-creator-data/README.md) | **47** | Profiles, posts, comments, creators, events and audience signals. |
| 🔎 | [**Search, Maps & SEO**](categories/search-maps-seo/README.md) | **5** | SERPs, maps, local business data, keywords and SEO intelligence. | | 🔎 | [**Search, Maps & SEO**](search-maps-seo/README.md) | **5** | SERPs, maps, local business data, keywords and SEO intelligence. |
| 💼 | [**Jobs & Recruiting**](categories/jobs-recruiting/README.md) | **12** | Job listings, candidate discovery, employers, salaries and recruiting data. | | 💼 | [**Jobs & Recruiting**](jobs-recruiting/README.md) | **12** | Job listings, candidate discovery, employers, salaries and recruiting data. |
| 🎯 | [**Lead Generation & Company Intelligence**](categories/lead-generation-company-intelligence/README.md) | **11** | Companies, decision-makers, suppliers, business emails and sales prospects. | | 🎯 | [**Lead Generation & Company Intelligence**](lead-generation-company-intelligence/README.md) | **11** | Companies, decision-makers, suppliers, business emails and sales prospects. |
| ✨ | [**AI & Research**](categories/ai-research/README.md) | **3** | AI answers, cited sources and structured research workflows. | | ✨ | [**AI & Research**](ai-research/README.md) | **3** | AI answers, cited sources and structured research workflows. |
| 🧰 | [**Developer & Web Utilities**](categories/developer-web-utilities/README.md) | **7** | Browser automation, extraction, screenshots, parsing and data utilities. | | 🧰 | [**Developer & Web Utilities**](developer-web-utilities/README.md) | **7** | Browser automation, extraction, screenshots, parsing and data utilities. |
| 📈 | [**Finance & Markets**](categories/finance-markets/README.md) | **1** | Public-market, company and financial time-series data. | | 📈 | [**Finance & Markets**](finance-markets/README.md) | **1** | Public-market, company and financial time-series data. |
| 🏠 | [**Real Estate**](categories/real-estate/README.md) | **1** | Property listings, valuations, history and location data. | | 🏠 | [**Real Estate**](real-estate/README.md) | **1** | Property listings, valuations, history and location data. |
| 📚 | [**Education & Knowledge**](categories/education-knowledge/README.md) | **2** | Courses, books, metadata and learning catalog intelligence. | | 📚 | [**Education & Knowledge**](education-knowledge/README.md) | **2** | Courses, books, metadata and learning catalog intelligence. |
| 📰 | [**News & Media**](categories/news-media/README.md) | **1** | News articles, media pages and publication monitoring. | | 📰 | [**News & Media**](news-media/README.md) | **1** | News articles, media pages and publication monitoring. |
<p align="center"><a href="#directory"><strong>Open the complete categorized API directory →</strong></a></p> <p align="center"><a href="#directory"><strong>Open the complete categorized API directory →</strong></a></p>
@@ -605,8 +602,16 @@ This snapshot contains every unique public Store Worker returned by CoreClaw whe
--- ---
<p align="center">
<a href="https://coreclaw.com?fpr=chris69">
<img src="assets/coreclaw-web-data-apis.png" alt="CoreClaw web data APIs and ready-to-use scrapers" width="100%">
</a>
</p>
<p align="center"> <p align="center">
<strong>Built for people who want fresh web data without rebuilding every scraper from scratch.</strong> <strong>Built for people who want fresh web data without rebuilding every scraper from scratch.</strong>
<br> <br>
<sub>Unofficial community resource. Not affiliated with or endorsed by CoreClaw or Apex DataWorks Limited.</sub> <sub>Unofficial community resource. Not affiliated with or endorsed by CoreClaw or Apex DataWorks Limited.</sub>
<br>
<sub>Some links are affiliate links; the maintainer may earn a commission at no additional cost to you.</sub>
</p> </p>
categories/ai-research/README.md → ai-research/README.md
+2 -2
View File
@@ -1,4 +1,4 @@
<p align="center"><a href="../README.md">← All categories</a> · <a href="../../README.md">Main directory</a></p> <p align="center"><a href="../README.md#categories">← All categories</a> · <a href="../README.md">Main directory</a></p>
# ✨ AI & Research # ✨ AI & Research
@@ -34,4 +34,4 @@ AI answers, cited sources and structured research workflows.
> [!NOTE] > [!NOTE]
> Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure. > Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure.
<p align="center"><a href="../README.md">← Browse all categories</a> · <a href="../../README.md#directory">Complete API directory</a></p> <p align="center"><a href="../README.md#categories">← Browse all categories</a> · <a href="../README.md#directory">Complete API directory</a></p>
assets/coreclaw-web-data-apis.png
BIN
View File
Binary file not shown.
Side by Side

After

Width:  |  Height:  |  Size: 1.4 MiB

categories/README.md
-24
View File
@@ -1,24 +0,0 @@
<p align="center"><a href="../README.md">← Main directory</a></p>
# CoreClaw API Categories
Browse all **118 CoreClaw Worker APIs** through 11 focused categories. Open a category to see every matching API, grouped by source.
| | Category | APIs | Sources |
|---:|---|---:|---:|
| 🛍️ | [**E-Commerce & Marketplaces**](e-commerce-marketplaces/README.md) | **28** | **9** |
| 🌐 | [**Social & Creator Data**](social-creator-data/README.md) | **47** | **7** |
| 🔎 | [**Search, Maps & SEO**](search-maps-seo/README.md) | **5** | **3** |
| 💼 | [**Jobs & Recruiting**](jobs-recruiting/README.md) | **12** | **4** |
| 🎯 | [**Lead Generation & Company Intelligence**](lead-generation-company-intelligence/README.md) | **11** | **7** |
| ✨ | [**AI & Research**](ai-research/README.md) | **3** | **3** |
| 🧰 | [**Developer & Web Utilities**](developer-web-utilities/README.md) | **7** | **1** |
| 📈 | [**Finance & Markets**](finance-markets/README.md) | **1** | **1** |
| 🏠 | [**Real Estate**](real-estate/README.md) | **1** | **1** |
| 📚 | [**Education & Knowledge**](education-knowledge/README.md) | **2** | **2** |
| 📰 | [**News & Media**](news-media/README.md) | **1** | **1** |
> [!NOTE]
> Worker links include the maintainer’s `fpr=chris69` referral parameter. Purchases through these links may support this directory at no additional cost to you.
<p align="center"><a href="../README.md#directory"><strong>View the complete directory →</strong></a></p>
categories/developer-web-utilities/README.md → developer-web-utilities/README.md
+2 -2
View File
@@ -1,4 +1,4 @@
<p align="center"><a href="../README.md">← All categories</a> · <a href="../../README.md">Main directory</a></p> <p align="center"><a href="../README.md#categories">← All categories</a> · <a href="../README.md">Main directory</a></p>
# 🧰 Developer & Web Utilities # 🧰 Developer & Web Utilities
@@ -26,4 +26,4 @@ Browser automation, extraction, screenshots, parsing and data utilities.
> [!NOTE] > [!NOTE]
> Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure. > Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure.
<p align="center"><a href="../README.md">← Browse all categories</a> · <a href="../../README.md#directory">Complete API directory</a></p> <p align="center"><a href="../README.md#categories">← Browse all categories</a> · <a href="../README.md#directory">Complete API directory</a></p>
categories/e-commerce-marketplaces/README.md → e-commerce-marketplaces/README.md
+2 -2
View File
@@ -1,4 +1,4 @@
<p align="center"><a href="../README.md">← All categories</a> · <a href="../../README.md">Main directory</a></p> <p align="center"><a href="../README.md#categories">← All categories</a> · <a href="../README.md">Main directory</a></p>
# 🛍️ E-Commerce & Marketplaces # 🛍️ E-Commerce & Marketplaces
@@ -95,4 +95,4 @@ Products, pricing, reviews, stores, suppliers and marketplace intelligence.
> [!NOTE] > [!NOTE]
> Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure. > Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure.
<p align="center"><a href="../README.md">← Browse all categories</a> · <a href="../../README.md#directory">Complete API directory</a></p> <p align="center"><a href="../README.md#categories">← Browse all categories</a> · <a href="../README.md#directory">Complete API directory</a></p>
categories/education-knowledge/README.md → education-knowledge/README.md
+2 -2
View File
@@ -1,4 +1,4 @@
<p align="center"><a href="../README.md">← All categories</a> · <a href="../../README.md">Main directory</a></p> <p align="center"><a href="../README.md#categories">← All categories</a> · <a href="../README.md">Main directory</a></p>
# 📚 Education & Knowledge # 📚 Education & Knowledge
@@ -27,4 +27,4 @@ Courses, books, metadata and learning catalog intelligence.
> [!NOTE] > [!NOTE]
> Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure. > Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure.
<p align="center"><a href="../README.md">← Browse all categories</a> · <a href="../../README.md#directory">Complete API directory</a></p> <p align="center"><a href="../README.md#categories">← Browse all categories</a> · <a href="../README.md#directory">Complete API directory</a></p>
categories/finance-markets/README.md → finance-markets/README.md
+2 -2
View File
@@ -1,4 +1,4 @@
<p align="center"><a href="../README.md">← All categories</a> · <a href="../../README.md">Main directory</a></p> <p align="center"><a href="../README.md#categories">← All categories</a> · <a href="../README.md">Main directory</a></p>
# 📈 Finance & Markets # 📈 Finance & Markets
@@ -20,4 +20,4 @@ Public-market, company and financial time-series data.
> [!NOTE] > [!NOTE]
> Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure. > Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure.
<p align="center"><a href="../README.md">← Browse all categories</a> · <a href="../../README.md#directory">Complete API directory</a></p> <p align="center"><a href="../README.md#categories">← Browse all categories</a> · <a href="../README.md#directory">Complete API directory</a></p>
categories/jobs-recruiting/README.md → jobs-recruiting/README.md
+2 -2
View File
@@ -1,4 +1,4 @@
<p align="center"><a href="../README.md">← All categories</a> · <a href="../../README.md">Main directory</a></p> <p align="center"><a href="../README.md#categories">← All categories</a> · <a href="../README.md">Main directory</a></p>
# 💼 Jobs & Recruiting # 💼 Jobs & Recruiting
@@ -49,4 +49,4 @@ Job listings, candidate discovery, employers, salaries and recruiting data.
> [!NOTE] > [!NOTE]
> Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure. > Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure.
<p align="center"><a href="../README.md">← Browse all categories</a> · <a href="../../README.md#directory">Complete API directory</a></p> <p align="center"><a href="../README.md#categories">← Browse all categories</a> · <a href="../README.md#directory">Complete API directory</a></p>
categories/lead-generation-company-intelligence/README.md → lead-generation-company-intelligence/README.md
+2 -2
View File
@@ -1,4 +1,4 @@
<p align="center"><a href="../README.md">← All categories</a> · <a href="../../README.md">Main directory</a></p> <p align="center"><a href="../README.md#categories">← All categories</a> · <a href="../README.md">Main directory</a></p>
# 🎯 Lead Generation & Company Intelligence # 🎯 Lead Generation & Company Intelligence
@@ -66,4 +66,4 @@ Companies, decision-makers, suppliers, business emails and sales prospects.
> [!NOTE] > [!NOTE]
> Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure. > Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure.
<p align="center"><a href="../README.md">← Browse all categories</a> · <a href="../../README.md#directory">Complete API directory</a></p> <p align="center"><a href="../README.md#categories">← Browse all categories</a> · <a href="../README.md#directory">Complete API directory</a></p>
categories/news-media/README.md → news-media/README.md
+2 -2
View File
@@ -1,4 +1,4 @@
<p align="center"><a href="../README.md">← All categories</a> · <a href="../../README.md">Main directory</a></p> <p align="center"><a href="../README.md#categories">← All categories</a> · <a href="../README.md">Main directory</a></p>
# 📰 News & Media # 📰 News & Media
@@ -20,4 +20,4 @@ News articles, media pages and publication monitoring.
> [!NOTE] > [!NOTE]
> Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure. > Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure.
<p align="center"><a href="../README.md">← Browse all categories</a> · <a href="../../README.md#directory">Complete API directory</a></p> <p align="center"><a href="../README.md#categories">← Browse all categories</a> · <a href="../README.md#directory">Complete API directory</a></p>
categories/real-estate/README.md → real-estate/README.md
+2 -2
View File
@@ -1,4 +1,4 @@
<p align="center"><a href="../README.md">← All categories</a> · <a href="../../README.md">Main directory</a></p> <p align="center"><a href="../README.md#categories">← All categories</a> · <a href="../README.md">Main directory</a></p>
# 🏠 Real Estate # 🏠 Real Estate
@@ -20,4 +20,4 @@ Property listings, valuations, history and location data.
> [!NOTE] > [!NOTE]
> Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure. > Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure.
<p align="center"><a href="../README.md">← Browse all categories</a> · <a href="../../README.md#directory">Complete API directory</a></p> <p align="center"><a href="../README.md#categories">← Browse all categories</a> · <a href="../README.md#directory">Complete API directory</a></p>
scripts/generate_category_pages.py
+6 -39
View File
@@ -13,7 +13,7 @@ from pathlib import Path
ROOT = Path(__file__).resolve().parents[1] ROOT = Path(__file__).resolve().parents[1]
CSV_PATH = ROOT / "data" / "workers.csv" CSV_PATH = ROOT / "data" / "workers.csv"
CATEGORY_ROOT = ROOT / "categories" CATEGORY_ROOT = ROOT
CATEGORIES = ( CATEGORIES = (
( (
@@ -104,39 +104,6 @@ def load_workers() -> list[dict[str, str]]:
return workers return workers
def render_index(grouped: dict[str, list[dict[str, str]]]) -> str:
lines = [
'<p align="center"><a href="../README.md">← Main directory</a></p>',
"",
"# CoreClaw API Categories",
"",
"Browse all **118 CoreClaw Worker APIs** through 11 focused categories. "
"Open a category to see every matching API, grouped by source.",
"",
"| | Category | APIs | Sources |",
"|---:|---|---:|---:|",
]
for name, slug, emoji, _summary in CATEGORIES:
rows = grouped[name]
source_count = len({row["source"] for row in rows})
lines.append(
f"| {emoji} | [**{name}**]({slug}/README.md) | "
f"**{len(rows)}** | **{source_count}** |"
)
lines.extend(
[
"",
"> [!NOTE]",
"> Worker links include the maintainer’s `fpr=chris69` referral parameter. "
"Purchases through these links may support this directory at no additional cost to you.",
"",
'<p align="center"><a href="../README.md#directory"><strong>View the complete directory →</strong></a></p>',
"",
]
)
return "\n".join(lines)
def render_category( def render_category(
name: str, name: str,
emoji: str, emoji: str,
@@ -148,8 +115,8 @@ def render_category(
sources[worker["source"]].append(worker) sources[worker["source"]].append(worker)
lines = [ lines = [
'<p align="center"><a href="../README.md">← All categories</a> · ' '<p align="center"><a href="../README.md#categories">← All categories</a> · '
'<a href="../../README.md">Main directory</a></p>', '<a href="../README.md">Main directory</a></p>',
"", "",
f"# {emoji} {name}", f"# {emoji} {name}",
"", "",
@@ -191,8 +158,8 @@ def render_category(
"> Links open the exact CoreClaw Worker page and include the maintainer’s " "> Links open the exact CoreClaw Worker page and include the maintainer’s "
"affiliate attribution. See the main README for the full disclosure.", "affiliate attribution. See the main README for the full disclosure.",
"", "",
'<p align="center"><a href="../README.md">← Browse all categories</a> · ' '<p align="center"><a href="../README.md#categories">← Browse all categories</a> · '
'<a href="../../README.md#directory">Complete API directory</a></p>', '<a href="../README.md#directory">Complete API directory</a></p>',
"", "",
] ]
) )
@@ -210,7 +177,7 @@ def expected_pages() -> dict[Path, str]:
if unknown: if unknown:
raise SystemExit(f"Unknown categories in CSV: {', '.join(unknown)}") raise SystemExit(f"Unknown categories in CSV: {', '.join(unknown)}")
pages = {CATEGORY_ROOT / "README.md": render_index(grouped)} pages = {}
for name, slug, emoji, summary in CATEGORIES: for name, slug, emoji, summary in CATEGORIES:
pages[CATEGORY_ROOT / slug / "README.md"] = render_category( pages[CATEGORY_ROOT / slug / "README.md"] = render_category(
name, emoji, summary, grouped[name] name, emoji, summary, grouped[name]
scripts/validate_catalog.py
+1 -4
View File
@@ -14,7 +14,7 @@ ROOT = Path(__file__).resolve().parents[1]
CSV_PATH = ROOT / "data" / "workers.csv" CSV_PATH = ROOT / "data" / "workers.csv"
README_PATH = ROOT / "README.md" README_PATH = ROOT / "README.md"
BANNER_PATH = ROOT / "assets" / "coreclaw-api-directory-banner.svg" BANNER_PATH = ROOT / "assets" / "coreclaw-api-directory-banner.svg"
CATEGORY_ROOT = ROOT / "categories" CATEGORY_ROOT = ROOT
CATEGORY_SLUGS = {name: slug for name, slug, _emoji, _summary in CATEGORIES} CATEGORY_SLUGS = {name: slug for name, slug, _emoji, _summary in CATEGORIES}
REQUIRED_FIELDS = { REQUIRED_FIELDS = {
@@ -73,9 +73,6 @@ def main() -> None:
if missing_from_readme: if missing_from_readme:
fail(f"README is missing {len(missing_from_readme)} Worker paths") fail(f"README is missing {len(missing_from_readme)} Worker paths")
category_index = CATEGORY_ROOT / "README.md"
if not category_index.is_file():
fail("missing categories/README.md")
for row in rows: for row in rows:
category_slug = CATEGORY_SLUGS.get(row["category"]) category_slug = CATEGORY_SLUGS.get(row["category"])
if category_slug is None: if category_slug is None:
categories/search-maps-seo/README.md → search-maps-seo/README.md
+2 -2
View File
@@ -1,4 +1,4 @@
<p align="center"><a href="../README.md">← All categories</a> · <a href="../../README.md">Main directory</a></p> <p align="center"><a href="../README.md#categories">← All categories</a> · <a href="../README.md">Main directory</a></p>
# 🔎 Search, Maps & SEO # 🔎 Search, Maps & SEO
@@ -36,4 +36,4 @@ SERPs, maps, local business data, keywords and SEO intelligence.
> [!NOTE] > [!NOTE]
> Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure. > Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure.
<p align="center"><a href="../README.md">← Browse all categories</a> · <a href="../../README.md#directory">Complete API directory</a></p> <p align="center"><a href="../README.md#categories">← Browse all categories</a> · <a href="../README.md#directory">Complete API directory</a></p>
categories/social-creator-data/README.md → social-creator-data/README.md
+2 -2
View File
@@ -1,4 +1,4 @@
<p align="center"><a href="../README.md">← All categories</a> · <a href="../../README.md">Main directory</a></p> <p align="center"><a href="../README.md#categories">← All categories</a> · <a href="../README.md">Main directory</a></p>
# 🌐 Social & Creator Data # 🌐 Social & Creator Data
@@ -102,4 +102,4 @@ Profiles, posts, comments, creators, events and audience signals.
> [!NOTE] > [!NOTE]
> Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure. > Links open the exact CoreClaw Worker page and include the maintainer’s affiliate attribution. See the main README for the full disclosure.
<p align="center"><a href="../README.md">← Browse all categories</a> · <a href="../../README.md#directory">Complete API directory</a></p> <p align="center"><a href="../README.md#categories">← Browse all categories</a> · <a href="../README.md#directory">Complete API directory</a></p>