12 posts with tag llm

• llm
• infrastructure
• colossus
• stargate
• gpu-cluster
• project-rainier

From 16K to 1M-GPU systems — how xAI built Colossus in 122 days, how AWS deployed 500K Trainium2 chips for Anthropic, and what OpenAI's $500B Stargate commitment actually covers.

• llm
• pre-training
• datasets
• common-crawl
• fineweb
• qwen
• deepseek

Where 2026 frontier LLMs get their pre-training data — Common Crawl, FineWeb, DCLM, StackV2, multilingual, PDFs — and how Qwen 3, DeepSeek-V3, Llama 3.1 sized their corpora.

• llm
• energy
• capex
• stargate
• infrastructure
• power
• ai-investment

• llm
• fp8
• mixed-precision
• training
• deepseek-v3
• quantization

• llm
• gpu
• hardware
• h100
• h200
• tpu
• trainium
• gb200

Side-by-side specifications of every chip and pod system used at the 2026 LLM frontier, with primary-source numbers from NVIDIA, Google Cloud, and AWS.

• llm
• mixture-of-experts
• architecture
• deepseek-v3
• qwen
• llama

Fine-grained experts, shared experts, auxiliary-loss-free routing — the modern MoE recipe in 2026, with side-by-side comparison of DeepSeek-V3, Qwen 3, Llama 4.