https://blog.kmoon.fun/blog/pre-training/ Recent content in Pre Training on Kmoon Blog Hugo zh-CN hushan@kmoon.fun (Kmoon) hushan@kmoon.fun (Kmoon) Copyright © 2020-2026. Kmoon. Wed, 20 May 2026 21:41:56 +0800 00000000000000000 00000000000000000 https://blog.kmoon.fun/pre-training%E5%A4%A7%E6%A8%A1%E5%9E%8B%E4%B8%96%E7%95%8C%E7%9A%84%E4%B9%9D%E5%B9%B4%E4%B9%89%E5%8A%A1%E6%95%99%E8%82%B2/ Wed, 20 May 2026 21:41:56 +0800hushan@kmoon.fun (Kmoon) https://blog.kmoon.fun/pre-training%E5%A4%A7%E6%A8%A1%E5%9E%8B%E4%B8%96%E7%95%8C%E7%9A%84%E4%B9%9D%E5%B9%B4%E4%B9%89%E5%8A%A1%E6%95%99%E8%82%B2/ <p>This article outlines the goals, pipeline, and trade-offs of LLM pre-training from data collection to optimization.</p>