High sparsity is achieved by constraint weights during the training phase

From Black Box to Schematic: OpenAI Improves Neural Network Interpretability with Weight Sparse Transformers

On November 13, 2025, OpenAI released a research and paper titled "Understanding neural networks through sparse circuits", proposing to improve the me...