~/bookmarks

Welcome! Type "help" for available commands.

$

Welcome! Type "help" for available commands.

$

Welcome! Type "help" for available commands.

$

~/bookmarks

William's Bookmark Library

/**/

GitHub - haykgrigo3/TimeCapsuleLLM: An LLM trained only on data from certain time periods to reduce modern bias

github.comSaved July 15, 20254 min

Open Source AI Project

Summary

TimeCapsuleLLM is an experimental project training language models from scratch on historical datasets to eliminate modern bias. By avoiding fine-tuning, it aims to simulate the worldview and language of specific eras, currently focusing on 1800–1850 London.

Highlights

Trains from scratch to prevent modern concept leakage
Uses nanoGPT architecture
Focuses on 1800–1850 London data
Scaling dataset from 50 to 600 texts for better coherence

auto-generated

Preview of GitHub - haykgrigo3/TimeCapsuleLLM: An LLM trained only on data from certain time periods to reduce modern bias

haykgrigo3 · via GitHub

Context

Audience

Machine Learning Researchers and AI Developers

DomainMachine Learning

FormatOpen source repository

AccessOpen source

Topics

Large Language Models nanoGPT Historical Language Models Bias Reduction LLM Training 19th Century London

View on GitHub All Bookmarks