This article outlines the goals, pipeline, and trade-offs of LLM pre-training from data collection to optimization.