GitHub - viperrcrypto/Siftly: Local Twitter/X bookmark organizer with AI categorization and mindmap visualization
Local Twitter/X bookmark organizer with AI categorization and mindmap visualization - viperrcrypto/Siftly
Open Source Archive Tool
Summary
HackerBook is a static, offline archive of 20 years of Hacker News data that runs entirely in the browser using SQLite WebAssembly. It packages the dataset into immutable, content-hashed shards, allowing users to query and browse the full history without a server.
Highlights
- Runs entirely client-side in the browser via SQLite WASM, requiring no backend server.
- Uses content-hashed filenames for shards to ensure perfect cache correctness and immutability.
- Provides a toolkit for building daily snapshots from BigQuery raw data using Node.js.
- Designed for durability and offline access, ensuring the community data is never lost.
- Optimized for performance by fetching only necessary gzipped SQLite shards on demand.
auto-generated
Context
Audience
Developers and data enthusiasts interested in archiving community discussions and client-side database technologies
DomainWeb Development
Formatopen source repository
Accessopen source
Source Overview
HackerBook is a static, offline archive of 20 years of Hacker News data, packaged as HTML, JSON, and gzipped SQLite shards that run entirely in the browser via SQLite WASM.
The browser fetches only needed shards for fast navigation, with content hashing in filenames ensuring cache correctness and immutability. Users can view pre-built sites locally, build from BigQuery raw data using Node.js tools, or deploy their own snapshots.
Topics
Related
SQLite WebAssemblyHacker NewsStatic WebsiteBigQueryNode.jsKiwix
