GitHub - h4ckf0r0day/obscura at selfh.st
The headless browser for AI agents and web scraping - h4ckf0r0day/obscura
Rust/JavaScript Library
Summary
Rusteerio is a Rust-native HTML/XML parser with a Cheerio-compatible TypeScript API, configurable parallel workers, and zero npm runtime dependencies. It targets large-scale scraping workloads with 4.5x speed over Cheerio and 30x over jsdom.
Highlights
- Cheerio-compatible API backed by a native Rust engine, keeping DOM, parsing, selectors, and serialization in a native addon
- Configurable parallel worker extraction supporting 1 to 256 threads to move CPU work off the JavaScript main thread
- Zero npm runtime dependencies with prebuilt native binaries for macOS, Linux glibc and musl, and Windows, requiring no Rust installation
- Benchmarks report 4.5x speed over Cheerio and 30x over jsdom on one CPU, with 1.7 GB peak memory versus Cheerio's 7.2 GB at 16 CPUs
- Supports both synchronous and async batch APIs, streaming, URL loading, XML parsing with CDATA, and requires Node.js 20.19 or newer
auto-generated
Context
Audience
Developers building server-side HTML processing, web scraping, or data extraction pipelines who need higher throughput and lower memory usage than JavaScript-based parsers like Cheerio or jsdom
DomainWeb Scraping and HTML Processing
FormatOpen source library on GitHub
AccessOpen source, free via npm
Source Overview
Rusteerio is a Rust-native HTML/XML parser exposing a Cheerio-compatible API via a TypeScript wrapper, with zero npm runtime dependencies.
It supports configurable parallel worker extraction (1–256 threads), streaming, and URL loading on Node.js 20.19+. Benchmarks report 4.5x speed over cheerio and 30x over jsdom on one CPU, with 1.7 GB peak memory versus cheerio's 7.2 GB at 16 CPUs.
Topics
Related
CheeriojsdomRustWeb scrapingHTML parsingNode.js native addons
