WebCrawlerAPI MCP server
WebCrawlerAPI crawls and scrapes web pages and monitors sites for changes, used by data teams building datasets or feeds from public web content. Connect WebCrawlerAPI through Arc0 and use it from any MCP client.
Connect WebCrawlerAPI
Add WebCrawlerAPI in Arc0, then call it from Claude, ChatGPT, Cursor or any remote MCP client with one URL.
Agent workflows for WebCrawlerAPI.
Scrape a single page
Pull the content of a specific page for use in a dataset or summary.
Create a crawl job
Start a crawl across a site to collect pages matching a pattern.
Confirm before deleting a feed
Check with the user before deleting a monitored feed, since its change history goes with it.
Sign in to Arc0, connect WebCrawlerAPI in My apps, then add Arc0's MCP URL to your AI client. Explore Arc0 MCP setup.
WebCrawlerAPI and Arc0, answered.
Does WebCrawlerAPI work with Claude Desktop and Claude Code?
Yes, after connecting the account and authorizing the client.
Can I use WebCrawlerAPI with OpenAI Codex, ChatGPT and Cursor?
Yes, after connecting the account and authorizing the client.
Is this the official WebCrawlerAPI MCP server?
This is Arc0’s integration page, not a claim of an official WebCrawlerAPI server. Arc0 adds a shared connection, policy and audit experience across apps. Consult WebCrawlerAPI for its own current MCP offerings.
Which WebCrawlerAPI actions are supported?
Connect WebCrawlerAPI in Arc0 to see the actions available to your account. Every action is graded read, write or destructive, and Arc0 policy determines what can execute.
Which permissions does WebCrawlerAPI need?
Connect WebCrawlerAPI through Arc0's hosted consent flow. Arc0 stores credentials in its encrypted vault and does not pass them to the model. Disconnect to remove access through Arc0.
Can I restrict writes in WebCrawlerAPI?
You can deny write and destructive actions or require approval. Provider scopes and Arc0 action policies are separate controls; a policy does not grant additional provider permissions.
What does WebCrawlerAPI through Arc0 cost?
See Arc0 pricing for current connectivity plans. The provider may require its own subscription or charge per request. Arc0 plan allowances do not make third-party data or paid actions free.
Plug WebCrawlerAPI into your agent.
WebCrawlerAPI MCP server: connect WebCrawlerAPI to Claude, ChatGPT, Cursor or any MCP client through Arc0.
Free to build · MCP + REST · Audit log on every plan
WebCrawlerAPI and its logo are trademarks of their respective owners. Arc0 is not affiliated with or endorsed by WebCrawlerAPI.