主題

large language model inference

44:15Inferact: Building the Infrastructure That Runs Modern AIa16z Deep Dives · 2026-01-22Inferact’s vLLM founders aim to build an open-source inference layer for trillion-parameter models across 400,000–500,000 GPUs.