Q17Machine Learning

Machine Learning algorithms (especially Gradient Descent, SVMs, and K-Means) are mathematically blind to real-world units. If Feature A is "Salary" (ranging from 50,000 to 200,000) and Feature B is "Age" (ranging from 18 to 80), the massive numbers in Feature A will violently dominate the Euclidean distance calculations, completely eradicating the impact of Feature B. Feature Scaling is the mandatory architectural process of mathematically forcing all features into a similar numerical scale.

1. Normalization (Min-Max Scaling)

• Mathematical Equation: $$X_{norm}=\frac{X-X_{min}}{X_{max}-X_{min}}$$
• Mechanism: It mathematically crushes the entire dataset strictly into the exact boundary of [0.0, 1.0].
• Demerit: It is catastrophically vulnerable to Outliers. If the maximum Salary is usually $100,000$, but one outlier is $10,000,000$, the $X_{max}$ becomes 10M. The entire normal dataset gets violently squashed into a tiny microscopic range between 0.0 and 0.01.

2. Standardization (Z-Score Scaling)

• Mathematical Equation: $$X_{std}=\frac{X-\mu }{\sigma }$$
• Mechanism: It subtracts the dataset Mean ($\mu$) and divides by the Standard Deviation ($\sigma$).
• Result: The new data is mathematically centered exactly at a Mean of $0.0$, with a Standard Deviation of $1.0$. The values usually range from roughly $-3.0$ to $+3.0$.
• Merit: It is vastly superior to Normalization because it does NOT bind the data to a strict limit, making it highly robust against massive outliers. It is the absolute mandatory requirement for Deep Learning and Gradient Descent.