Tag: vanishing gradient
Sigmoid Neuron – Fundamentals of Neural Networks Part 2
Introduction to Sigmoid Function Previously we have covered Single-Node Perceptron neural networks. The next important topics to study are the sigmoid neuron of a neural network and logistic regression. Sigmoid function is defined as: This function originates in mathematical biology. Various fields have used it long before its adoption in artificial neural networks. Here’s a… Read more