Cutting LLM Fine-Tuning Memory in Pure Kotlin: Fused Linear Cross-Entropy and the JVM Vector API
DEV · 19.11.2026 · 05:56
When fine-tuning language models like Qwen2-0.5B or Llama-3 on a constrained heap, the biggest memory and compute bottleneck often isn't self-attention. On models with a small hidden…