Skip to content

AI Coding Assistants

The Crawlberg plugin lets your coding agent crawl and scrape the web without leaving the chat — ask it to pull a page as Markdown, map a site, or extract metadata, and it drives Crawlberg for you.

What the plugin does: it bundles the Crawlberg agent skills (site crawling, HTML→Markdown scraping, headless-Chrome fallback) and wires up the crawlberg MCP server, so any major coding agent can call the crawler directly.

The plugin shells out to the crawlberg CLI. Install it from the Installation guide (for example, brew install xberg-io/tap/crawlberg) before driving the crawler from an assistant.

The plugin, its per-platform manifests, and version history live in this repository’s self-hosted xberg-io/crawlberg marketplace.

Pick your harness below.

Claude Code
/plugin marketplace add xberg-io/crawlberg
/plugin install crawlberg@crawlberg
Codex CLI
/plugins add https://github.com/xberg-io/crawlberg

Then search for crawlberg and select Install Plugin.

Cursor

Settings → Plugins → Add from URL → https://github.com/xberg-io/crawlberg, then select crawlberg.

Gemini CLI
gemini extensions install https://github.com/xberg-io/crawlberg
Factory Droid
droid plugin marketplace add https://github.com/xberg-io/crawlberg
droid plugin install crawlberg@crawlberg
GitHub Copilot CLI
copilot plugin marketplace add https://github.com/xberg-io/crawlberg
copilot plugin install crawlberg@crawlberg
opencode

Add the package to opencode.json:

{
"$schema": "https://opencode.ai/config.json",
"plugin": ["@xberg-io/opencode-crawlberg"]
}