Spider MCP server
Read a public page, follow a bounded set of related pages or discover links before choosing what to retrieve. Access is gated: request enablement for your organization before connecting.
Agent workflows for Spider.
Scrape one page
Use when a known public URL needs markdown or plain text. Fetches one page using HTTP, with a 15-second server budget. Content may be partial. Spends credits; a timeout may still be charged, and retrying spends again.
Crawl a small site section
Use when related pages on one site are needed. Requires a 1–5 page limit and depth 1–3; use limit 1 to start. HTTP only, 15-second server budget; results may be partial. Spends credits; timeouts may still be charged and retries spend again.
Discover website links
Use when finding URLs before selecting pages to scrape. Requires a 1–5 page limit and depth 1–3; returns up to 100 links per page. HTTP only, 15-second server budget. Spends credits; timeouts may still be charged and retries spend again.
5 Spider actions, graded by risk.
These actions come from the Arc0 registry. Your identity, provider permissions and Arc0 policies determine which actions can run.
read
5Look things up, subject to your permissions.
- spider.scrapeScrape one page
Use when a known public URL needs markdown or plain text. Fetches one page using HTTP, with a 15-second server budget. Content may be partial. Spends credits; a timeout may still be charged, and retrying spends again.
- spider.crawlCrawl a small site section
Use when related pages on one site are needed. Requires a 1–5 page limit and depth 1–3; use limit 1 to start. HTTP only, 15-second server budget; results may be partial. Spends credits; timeouts may still be charged and retries spend again.
- spider.linksDiscover website links
Use when finding URLs before selecting pages to scrape. Requires a 1–5 page limit and depth 1–3; returns up to 100 links per page. HTTP only, 15-second server budget. Spends credits; timeouts may still be charged and retries spend again.
- spider.searchSearch the web
Use when finding public sources by query. Returns up to five URLs with titles and snippets; page selects results 1–10. Does not fetch result pages. Spends credits; a timed-out search may still be charged and retrying spends again.
- spider.search_and_scrapeSearch and read result pages
Use when a query needs source text in one call. Fetches up to five search hits as markdown or text, one page per hit. HTTP only, 15-second server budget; results may be partial. Spends credits; timeouts may still be charged and retries spend again.
write
0Create and change things. Allow, or ask the user first.
- No write actions.
destructive
0Delete, cancel or archive. Ask first, or deny outright.
- No destructive actions.
Control access to Spider.
After early access is enabled, connect the intended Spider account, authorize your AI client and set policies for its tools.
Provider permissions and Arc0 policy both apply. Allow reads, require approval for selected writes, or deny destructive actions. The audit log records execution decisions.
Configure policies and approvalsExample policy choices
- Read actions: allow where authorized
Arc0 MCP endpoint: https://api.arc0.ai/mcp
How Spider connects.
Connect Spider using API key. OAuth grants the provider scopes shown during consent; API keys and other credentials retain the permissions configured at the provider. Arc0 stores credentials in its encrypted vault and does not pass them to the model. Disconnect to remove access through Arc0; revoke a key at the provider to invalidate it there. Token refresh and provider-side revocation depend on the authentication lane and provider.
The connection serves authorized calls through Arc0 MCP and REST. How Arc0 handles credentials →
- AUTH
- API key
- CREDENTIALS
- Per-tenant encrypted vault
- MODEL SEES
- Results only, never credentials
- AUDIT LOG
- Every call, on every plan
Use Spider with your AI client.
Request access to Spider first. An Arc0 administrator must enable it for your organization before these actions appear. Then authorize your AI client separately. It only receives tools and accounts allowed for that identity.
Spider with Claude
Claude Desktop + Claude Code
- In Claude Desktop, add Arc0 through the remote MCP settings and use OAuth. Follow the generic remote-client steps if your account’s interface differs.
- For Claude Code, run the command below. Open /mcp, select Arc0, and authenticate in your browser. Select your workspace and review access.
- Check the connection with claude mcp get arc0.
claude mcp add --transport http --scope user arc0 https://api.arc0.ai/mcpSpider with ChatGPT
ChatGPT on the web
- Open Plugins in ChatGPT, select the plus button, then Add custom MCP server.
- Name it Arc0, enter the server URL below, and choose OAuth. Use dynamic client registration if asked; no Arc0 API key is needed.
- Review the notice and select Create as a plugin. Complete Arc0 sign-in, workspace selection and consent, then install and select the plugin in your conversation. Labels and access vary by account; managed workspaces may require administrator approval.
https://api.arc0.ai/mcpSpider with OpenAI Codex
Codex app + CLI
- Run the registration command below. The app and CLI share ~/.codex/config.toml.
- Complete browser OAuth, choose your Arc0 workspace, and review access. If authentication does not start, run codex mcp login arc0.
- Check codex mcp list, then open a new Codex chat. Inspect an existing arc0 entry before changing it.
codex mcp add arc0 --url https://api.arc0.ai/mcpSpider with Cursor
Remote MCP setup
- Add Arc0 in your client’s remote MCP settings using the server URL below.
- Choose OAuth, sign in to Arc0, select the intended workspace and review access.
- Confirm the server is connected and start with an allowed read. These are generic remote-MCP steps; consult your client’s settings for its current interface.
https://api.arc0.ai/mcpSpider with VS Code
Remote MCP setup
- Add a remote HTTP MCP server named Arc0 using the URL below.
- Use OAuth and finish Arc0 sign-in, workspace selection and consent.
- Confirm discovery succeeds before requesting a read. These are generic remote-MCP steps; client UI and availability may differ.
https://api.arc0.ai/mcpSpider with Any MCP client
Streamable HTTP
- Use a client that supports remote MCP over Streamable HTTP. Add the server URL below and choose OAuth.
- For a client without OAuth, use a self-bound API key with execute permission in the X-API-Key header. Store it in secret storage or an environment variable, outside source control. Never send both an API key and an OAuth bearer token.
- Use the MCP clients guide for the SDK transport example and Embedded identity for business-managed end users.
https://api.arc0.ai/mcpAfter setup, ask your agent to find an allowed read action, load its schema, and execute it on the intended account. Check Activity for the receipt. A connected MCP client alone does not confirm a successful provider call.
More web data and scraping apps.
Spider and Arc0, answered.
Does Spider work with Claude Desktop and Claude Code?
Yes, after early access is enabled for your organization and you connect the intended account. Use Arc0’s remote MCP endpoint with OAuth. Claude Code has a documented registration command; Desktop uses the generic remote-client setup.
Can I use Spider with OpenAI Codex, ChatGPT and Cursor?
Yes, after early access is enabled for your organization and you connect the intended account. Codex and ChatGPT have setup instructions in Arc0’s MCP clients guide. Cursor uses the generic remote-MCP steps. Tool access remains scoped to the authorized identity.
Is this the official Spider MCP server?
This is Arc0’s integration page, not a claim of an official Spider server. Arc0 adds a shared connection, policy and audit experience across apps. Consult Spider for its own current MCP offerings.
Which Spider actions are supported?
5 registry-defined actions: 5 read, 0 write and 0 destructive. Provider permissions, access enablement and Arc0 policy determine what can execute.
Which permissions does Spider need?
Connect Spider using API key. OAuth grants the provider scopes shown during consent; API keys and other credentials retain the permissions configured at the provider. Arc0 stores credentials in its encrypted vault and does not pass them to the model. Disconnect to remove access through Arc0; revoke a key at the provider to invalidate it there. Token refresh and provider-side revocation depend on the authentication lane and provider.
Can I restrict writes in Spider?
You can deny write and destructive actions or require approval. Provider scopes and Arc0 action policies are separate controls; a policy does not grant additional provider permissions.
What does Spider through Arc0 cost?
See Arc0 pricing for current connectivity plans. The provider may require its own subscription or charge per request. Arc0 plan allowances do not make third-party data or paid actions free.
Request Spider access.
Spider MCP server: 5 actions including scrape one page, crawl a small site section, discover website links. Request early access through Arc0.
Free to build · MCP + REST · Audit log on every plan
Spider and its logo are trademarks of their respective owners. Arc0 is not affiliated with or endorsed by Spider.