LLM Chronicles
A fast-paced whiteboard animation series unraveling Deep Learning and Large Language Models. Dive into core concepts, from Neural Networks basics to t...
Welcome! Type "help" for available commands.
$
GitHub - rasbt/LLMs-from-scratch: Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Machine Learning Tutorial
Summary
This repository provides code for building a GPT-like LLM from scratch using PyTorch, serving as the official companion to Sebastian Raschka's book. It guides users through implementing core components like attention mechanisms and training pipelines.
Highlights
- Step-by-step implementation of a ChatGPT-like LLM from the ground up using PyTorch.
- Covers key stages including text data processing, attention mechanisms, and model training.
- Includes code for loading and finetuning larger pretrained models.
- Serves as the official companion code for Sebastian Raschka's published book.
- Designed for educational purposes to help users understand LLM internals.
auto-generated
Context
Audience
Data Scientists and Software Developers
DomainMachine Learning
Formatopen source code repository
Accessfree online
Topics
Related
PyTorchLarge Language ModelsGPT ArchitectureNatural Language ProcessingDeep Learning
