Q4Soft Computing
Question
2 marks
Q.4. What is Activation Function and write its importance.
Answer
An activation function is a mathematical function (such as sigmoid, tanh, or ReLU) applied to a neuron's weighted input sum to produce its output. Its importance lies in introducing non-linearity into the network, without which any multi-layer network would collapse mathematically into an equivalent single-layer linear model, incapable of learning complex, non-linear patterns.