GitHub - peonist-ai/halogen-flash-server: The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)
The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151) - peonist-ai/halogen-flash-server
Java Performance Engineering
Summary
Documents real-world deployment issues with the JDK AOT cache feature, including CPU incompatibility crashes (SIGILL) when training and target systems differ in instruction set support. Covers the feature's evolution from JDK 24 to planned JDK 28 and provides build scripts to work around known pitfalls.
Highlights
- AOT cache records class loading and linking during a training run to skip initialization on subsequent starts
- CPU incompatibility crashes (SIGILL) occur when training and target systems differ in instruction set support like AVX or AVX-512
- Feature evolves across JDK 24-28: class loading, method profiling, object caching, and planned AOT code compilation
- Distinguishes AOT caching from GraalVM Native Image as separate approaches to Java startup optimization
- Includes production build scripts that work around known pitfalls for safe deployment
auto-generated
Context
Audience
Java developers and platform engineers deploying JVM applications to production who want to optimize startup times
DomainJVM Performance Optimization
Formatlong-form technical blog post
Accessfree online
Source Overview
This post documents deployment issues with the JDK AOT cache, which reduces Java startup time by recording class loading and linking during a training run.
Production use at XPipe exposed CPU incompatibility crashes (SIGILL) when training and target systems differ in instruction set support like AVX or AVX-512. It covers the feature's evolution from JDK 24 through planned JDK 28, distinguishes AOT caching from GraalVM Native Image, and includes build scripts to work around known pitfalls.
Topics
Related
GraalVM Native ImageJEP 483: Ahead-of-Time Class Loading & LinkingJEP 514: Ahead-of-Time Command-Line ErgonomicsJEP 544: Ahead-of-Time Code CompilationClass-Data Sharing (CDS)
