Crawlbase MCP server
Crawlbase crawls web pages at scale, managing crawler queues and storing results so a team can pull page data without running its own infrastructure. Connect Crawlbase through Arc0 and use it from any MCP client.
Connect Crawlbase
Add Crawlbase in Arc0, then call it from Claude, ChatGPT, Cursor or any remote MCP client with one URL.
Agent workflows for Crawlbase.
Crawl a specific URL
Crawl a URL and store its result for later retrieval instead of fetching it live each time.
Check stored crawl results
Get a previously stored page's content back instead of crawling that URL again.
Check crawling usage
Check current crawling usage and limits before submitting a large batch of URLs.
Sign in to Arc0, connect Crawlbase in My apps, then add Arc0's MCP URL to your AI client. Explore Arc0 MCP setup.
Crawlbase and Arc0, answered.
Does Crawlbase work with Claude Desktop and Claude Code?
Yes, after connecting the account and authorizing the client.
Can I use Crawlbase with OpenAI Codex, ChatGPT and Cursor?
Yes, after connecting the account and authorizing the client.
Is this the official Crawlbase MCP server?
This is Arc0’s integration page, not a claim of an official Crawlbase server. Arc0 adds a shared connection, policy and audit experience across apps. Consult Crawlbase for its own current MCP offerings.
Which Crawlbase actions are supported?
Connect Crawlbase in Arc0 to see the actions available to your account. Every action is graded read, write or destructive, and Arc0 policy determines what can execute.
Which permissions does Crawlbase need?
Connect Crawlbase through Arc0's hosted consent flow. Arc0 stores credentials in its encrypted vault and does not pass them to the model. Disconnect to remove access through Arc0.
Can I restrict writes in Crawlbase?
You can deny write and destructive actions or require approval. Provider scopes and Arc0 action policies are separate controls; a policy does not grant additional provider permissions.
What does Crawlbase through Arc0 cost?
See Arc0 pricing for current connectivity plans. The provider may require its own subscription or charge per request. Arc0 plan allowances do not make third-party data or paid actions free.
Plug Crawlbase into your agent.
Crawlbase MCP server: connect Crawlbase to Claude, ChatGPT, Cursor or any MCP client through Arc0.
Free to build · MCP + REST · Audit log on every plan
Crawlbase and its logo are trademarks of their respective owners. Arc0 is not affiliated with or endorsed by Crawlbase.