AI Coding Assistants
The Crawlberg plugin lets your coding agent crawl and scrape the web without leaving the chat — ask it to pull a page as Markdown, map a site, or extract metadata, and it drives Crawlberg for you.
What the plugin does: it bundles the Crawlberg agent skills (site crawling, HTML→Markdown scraping, headless-Chrome fallback) and wires up the crawlberg MCP server, so any major coding agent can call the crawler directly.
The plugin shells out to the crawlberg CLI. Install it from the Installation guide (for example, brew install xberg-io/tap/crawlberg) before driving the crawler from an assistant.
The plugin, its per-platform manifests, and version history live in this repository’s self-hosted xberg-io/crawlberg marketplace.
Installing
Section titled “Installing”Pick your harness below.
Claude Code
/plugin marketplace add xberg-io/crawlberg/plugin install crawlberg@crawlbergCodex CLI
/plugins add https://github.com/xberg-io/crawlbergThen search for crawlberg and select Install Plugin.
Cursor
Settings → Plugins → Add from URL → https://github.com/xberg-io/crawlberg, then select crawlberg.
Gemini CLI
From a checkout of this repository:
gemini extensions install ./pluginThe manifest is inside plugin/. See the Gemini extension reference
for local installation and updates.
Kimi installation and compatibility
From a checkout of this repository, install with the Python Kimi CLI version used for native plugin validation:
uvx --from kimi-cli==1.51.0 kimi plugin install ./pluginNative plugin installation was validated with Python Kimi CLI 1.51.0. The replacement
@moonshot-ai/kimi-code 2.1.1 does not provide a plugin CLI subcommand; its interactive
plugin loading has not been verified. These results do not establish compatibility with
newer Kimi releases.
Factory Droid
droid plugin marketplace add https://github.com/xberg-io/crawlbergdroid plugin install crawlberg@crawlbergGitHub Copilot CLI
copilot plugin marketplace add https://github.com/xberg-io/crawlbergcopilot plugin install crawlberg@crawlbergPi
From a checkout of this repository:
pi install ./pluginAfter the next plugin release, install the same package used by OpenCode:
pi install npm:@xberg-io/opencode-crawlbergPi loads the bundled skills and prompt templates. Use /crawlberg-scrape or /crawlberg-crawl with the input as arguments. Install the crawlberg CLI separately for shell access. This package does not register MCP servers, hooks, or native Pi extensions.
opencode
Add the package to opencode.json:
{ "$schema": "https://opencode.ai/config.json", "plugin": ["@xberg-io/opencode-crawlberg"]}Runtime resources and prerequisites
Section titled “Runtime resources and prerequisites”The generated bundle targets Claude Code, Codex, Cursor, Gemini CLI, Kimi, OpenCode, Factory Droid, Hermes, Pi, Agent Plugins and GitHub Copilot CLI. Use the plugin installation guide for the runtime’s installation method and configuration.
| Runtime | Integration |
|---|---|
| Claude, Codex, Cursor, Factory | Native plugin manifests, skills and MCP configuration |
| Gemini CLI | Extension manifest, command templates and MCP configuration |
| Kimi | Plugin manifest and session instructions |
| OpenCode | npm adapter, instructions and MCP configuration |
| Hermes | Python plugin, explicitly selected skills and a local stdio MCP bridge |
| Pi | Skills and prompt templates; execute operations through the CLI |
| Agent Plugins, Copilot | Agent Plugins 1.0 manifest, skills and MCP configuration |
Install the product CLI before using Hermes or Pi. Hermes starts the installed CLI directly;
its wheel does not include the auto-installing launcher used by other MCP clients.
Select list_tools through the product’s Hermes bridge to inspect the supported tools and
request schemas. Select skills explicitly when needed; they are not appended automatically
to every conversation.
From a checkout, install the generated Hermes package into Hermes’ Python environment:
pip install ./plugin/.hermes/packageEnable the plugin in Hermes configuration. Loading project plugins also requires
HERMES_ENABLE_PROJECT_PLUGINS=true. After a release publishes the updated package, the
registry install is pip install crawlberg-hermes-plugin.
Pi resources can be installed from the checkout with pi install ./plugin.
After a plugin release includes them, install npm:@xberg-io/opencode-crawlberg through Pi.
Pi does not register an MCP server, hooks or executable extensions from this package.
Standalone public skills
Section titled “Standalone public skills”The public skills directory contains instructions you can install independently of the runtime plugin. Use the skills CLI to list and select them:
npx skills add xberg-io/crawlberg --listnpx skills add xberg-io/crawlbergChoose the target agents interactively. For a local checkout, use npx skills add ./skills.
This installs instructions; it does not install the product CLI, enable MCP, download models
or set provider credentials.