Vector Normalization May 05, 2026 Generalization Statistics Dataset normalization & uses including: LayerNorm, Dynamic Tanh, BatchNorm, RMSNorm, L1, & L2 Read more →
L1 Lasso vs L2 Ridge Regression May 01, 2026 Generalization Statistics L1 Lasso vs L2 Ridge Constraint's Effect on Weight Minimization Read more →
L1 Lasso Regularization & Sparsity April 28, 2026 Generalization Statistics $L(w) = ||y-Xw||^2 + \lambda ||w||_1$ L1 Lasso Regularization & Weight Sparsity Read more →
Bias Variance of L2 Ridge Regression April 24, 2026 Generalization Statistics How $\lambda$ affect the Bias & Variance for Ridge Regression? Read more →
Decomposition of L2 Ridge Regression April 23, 2026 Generalization Statistics What happens when we increase $\lambda$ in $L(W) = ||y - Wx||^2 + \lambda ||W||^2$ Read more →
Different Forms of Linear Regression April 23, 2026 Statistics It's "M" for mini, should be "W" for "wumbo". - Patrick Star on Isomorphic Representations Read more →
Linear Regression as MLE Under Gaussian Noise April 20, 2026 Statistics Finding the Maximum Likelihood Estimation of Data with Gaussian Noise Equivalent to Linear Regression Read more →
Linear Regression Solution from Projections onto Subspaces April 18, 2026 Statistics Deriving Linear Regression Normal Form & Showing its Properties Read more →
