Concept

time to first token

1:50:48Why Inference Matters 12x More Than Training | YC Paper ClubY Combinator · 2026-10-24YC’s inference panel says serving can use 12× more FLOPs than training, while SGLang’s cache cuts time to first token by 56%.