Server data from the Official MCP Registry
Crawl a website for links, file download links, HTML tables as rows, and lists, with no AI
About
Crawl a website for links, file download links, HTML tables as rows, and lists, with no AI
Security Report
This is a thin wrapper that starts and polls an Apify actor run and returns its dataset. The Apify token is read from the APIFY_TOKEN environment variable and sent only to api.apify.com, and there is no hardcoded credential, shell execution, or data sent to unexpected hosts. The main concerns are cost and scope: the tool is annotated read-only but starts paid runs, and the default spend cap is unset, so the score reflects minor quality and disclosure issues rather than security defects. Supply chain analysis found 1 known vulnerability in dependencies (0 critical, 1 high severity). Package verification found 1 issue.
7 files analyzed · 8 issues found
Security scores are indicators to help you make informed decisions, not guarantees. Always review permissions before connecting any MCP server.
Permissions Required
This plugin requests these system permissions. Most are normal for its category.
What You'll Need
Set these up before or after installing:
Environment variable: APIFY_TOKEN
How to Install
Add this to your MCP configuration file:
{
"mcpServers": {
"com-mambabuilt-mcp-site-crawler-links-tables": {
"env": {
"APIFY_TOKEN": "your-apify-token-here"
},
"args": [
"-y",
"@mambalabsdev/mcp-site-crawler-links-tables"
],
"command": "npx"
}
}
}Documentation
View on GitHubFrom the project's GitHub README.
Site Crawler for Links and Tables MCP Server
An MCP server for the Mamba Labs Site Crawler for Links and Tables actor on Apify. Crawl a website and get its links, download links, tables, and lists as rows.
What's Inside
- What it does
- Quick start
- Prerequisites
- Example prompts
- Tool
- Inputs
- Pricing
- Full actor documentation
- License
What it does
Give a start address. The actor crawls the site over plain HTTP, following links and the sitemap, and returns one row per page with internal links, external links, file download links, every HTML table as rows, and every list. The output is deterministic, with no AI. robots.txt is obeyed by default. Pages built by JavaScript return little, because no browser runs.
All of the work runs on Apify. This package is a thin client that starts the actor run, waits for it, and hands back the dataset rows.
Quick start
You need Node.js 18 or newer and an Apify account with an API token.
Add this to your Claude Desktop config (claude_desktop_config.json), Cursor, or any MCP client:
{
"mcpServers": {
"mamba-site-crawler-links-tables": {
"command": "npx",
"args": [
"-y",
"@mambalabsdev/mcp-site-crawler-links-tables"
],
"env": {
"APIFY_TOKEN": "your-apify-token"
}
}
}
}
Restart the client. The crawl_site_links_tables tool appears.
Prerequisites
- Node.js 18 or newer.
- An Apify API token from console.apify.com/account/integrations, set as
APIFY_TOKEN. The server lists its tool without a token; a call needs one.
Example prompts
- "List every external download link on this website."
- "Pull all the tables from these pages into rows."
- "Crawl this site and show me which pages link out to other domains."
Tool
crawl_site_links_tables. One tool. Example arguments:
{
"start_urls": [
"https://webscraper.io/test-sites/tables"
],
"extract": [
"tables",
"links"
],
"max_pages": 10,
"max_depth": 1
}
Inputs
Every buyer facing input of the actor. Omitted inputs take the actor's own defaults.
| Input | Type | Required | Description |
|---|---|---|---|
start_urls | array | no | Web addresses to start from, up to 100. A bare domain such as example.com is read as https. |
max_pages | number | no | Pages to read across the whole run, up to 10,000. Default 100. |
max_depth | number | no | How many links to follow from a start address. 0 reads only the start address. Default 10. |
same_domain_only | string | no | yes (default): follow links only on the start address's host and its subdomains. no: also follow links to other sites, up to Maximum pages. Links to other sites are listed either way. |
extract | array | no | Any of links, tables, lists, download_links. Default links, tables, lists. download_links adds one separate row per file link, charged as download-link-row; the download_links field on page rows is always filled at no extra charge. |
download_extensions | array | no | File extensions that count as download links. Default pdf, zip, xlsx, xls, docx, doc, pptx, csv, mp3, mp4, exe, dmg, msi, pkg, gz, tar, tgz, 7z, rar, iso, apk. Files are listed, never downloaded. |
use_sitemap | string | no | yes (default): also queue the addresses in /sitemap.xml, which finds pages no link reaches. no: follow links only. |
obey_robots | string | no | yes (default): skip pages robots.txt disallows and honor its crawl delay up to 5 seconds. no: read them, only if you have the right to. |
max_charge_usd | string | no | Optional. The run stops before a charge that would pass this amount. Summary rows are always returned. |
proxy_mode | string | no | pool (default): the Apify proxy pool only, charged as page-row; a page that refuses it gets a free blocked row. auto: a refused page is retried on residential addresses, and a page read that way is charged as residential-page-row. residential: every page uses residential addresses and is charged as residential-page-row. |
Pricing
Pay per event on Apify, billed to your Apify account. Prices in USD.
| Event | Free plan | Bronze | Silver | Gold |
|---|---|---|---|---|
page-row, one page read on the proxy pool | $0.006 | $0.0057 | $0.0054 | $0.0051 |
residential-page-row, one page read on residential addresses, only with proxy_mode auto or residential | $0.02 | $0.019 | $0.018 | $0.017 |
download-link-row, one separate file link row, only when extract includes download_links | $0.0001 | $0.000095 | $0.00009 | $0.000085 |
apify-actor-start, per run start | $0.0055 | $0.0055 | $0.0055 | $0.0055 |
Failed or refused pages, summary rows, pages skipped by robots.txt, and refused input are free. Mamba Labs pays the platform costs of the run, Apify proxy traffic included. Mamba Labs pays the platform costs of the run, Apify proxy traffic included.
Full actor documentation
apify.com/mambalabs/site-crawler-links-tables
License
MIT. See LICENSE.
Reviews
No reviews yet
Be the first to review this server!
More Developer Tools MCP Servers
Rea
Freeby Morluto · Developer Tools
Reverse engineer anything from your terminal or agent with one CLI and MCP server.
Paperclip
Freeby Paperclipai · Developer Tools
Trending hip-hop artist momentum scores across four cultural dimensions.
Fetch
Freeby Modelcontextprotocol · Developer Tools
Web content fetching and conversion for efficient LLM usage
Git
Freeby Modelcontextprotocol · Developer Tools
Read, search, and manipulate Git repositories programmatically
Toleno
Freeby Toleno · Developer Tools
Toleno Network MCP Server — Manage your Toleno mining account with Claude AI using natural language.
MCP Marketplace
Freeby mcp-marketplace · Developer Tools
Search and install MCP servers from inside your AI client.
