# crawlberg

> High-performance Rust web crawling and scraping with always-on HTML→Markdown, browser fallback, REST/MCP servers, and native bindings for 14 languages.

## Documentation Sets

- [Abridged documentation](https://docs.crawlberg.xberg.io/llms-small.txt): a compact version of the documentation for crawlberg, with non-essential content removed
- [Complete documentation](https://docs.crawlberg.xberg.io/llms-full.txt): the full documentation for crawlberg
- [Get Started](https://docs.crawlberg.xberg.io/_llms-txt/get-started.txt)
- [Guides](https://docs.crawlberg.xberg.io/_llms-txt/guides.txt)
- [Concepts](https://docs.crawlberg.xberg.io/_llms-txt/concepts.txt)
- [Reference](https://docs.crawlberg.xberg.io/_llms-txt/reference.txt)
- [More](https://docs.crawlberg.xberg.io/_llms-txt/more.txt)

## Notes

- The complete documentation includes all content from the official documentation
- The content is automatically generated from the same source as the official documentation

## Optional

- [GitHub](https://github.com/xberg-io/crawlberg): Source code and issues