ALGORITHMS
The Geometry of Latent Space: Visualizing AI Reasoning Paths
New research suggests LLM attention heads are forming complex topological manifolds during multi-step inference tasks.
LATEST_ANALYSIS
The Geometry of Latent Space: Beyond Linear Reasoning
New research suggests LLM attention heads are forming complex topological manifolds during multi-step inference tasks.
ALGORITHMS
Sparsity in LLMs: Cutting Compute Costs by 40% with New Kernels
Techniques in mixture-of-experts (MoE) are enabling massive parameter counts with a fraction of active compute.