Tagged articles

ReLU

4 articles · Page 1 of 1

Sep 19, 2025 · Artificial Intelligence

Neural Networks Explained: Why ReLU Beats Sigmoid & How to Build One in PyTorch

This article explains neural network fundamentals, covering why logistic regression units form neurons, the problems with Sigmoid activation in hidden layers (vanishing gradients, non-zero centered outputs), why ReLU and its variants are preferred, how Softmax enables multi-class classification with cross-entropy loss, and provides a complete PyTorch implementation example.

Neural NetworksPyTorchReLU

0 likes · 8 min read

Neural Networks Explained: Why ReLU Beats Sigmoid & How to Build One in PyTorch

Qborfy AI

Jul 2, 2025 · Artificial Intelligence

Mastering Activation Functions: From Sigmoid to Swish and When to Use Them

This article explains the role of activation functions in neural networks, compares five classic functions with formulas, performance trade‑offs, and gradient behavior, and provides a Python visualization demo plus several practical insights and real‑world examples.

Neural NetworksReLUSwish

0 likes · 7 min read

Mastering Activation Functions: From Sigmoid to Swish and When to Use Them

Code DAO

May 12, 2022 · Artificial Intelligence

How Activation Functions Work in Deep Learning

This article explains the role of activation functions in deep learning, covering their definition, why they are needed, the main categories—including linear, binary step, and various non‑linear functions such as Sigmoid, TanH, ReLU, Leaky ReLU, ELU, Softmax and Swish—along with each function's mathematical form, advantages, disadvantages, and practical usage recommendations.

Neural NetworkReLUSigmoid

0 likes · 13 min read

How Activation Functions Work in Deep Learning

dbaplus Community

Oct 12, 2016 · Artificial Intelligence

Mastering Convolutional Neural Networks: Theory, Training, and Implementation

This article provides a comprehensive guide to convolutional neural networks, covering their advantages over fully‑connected nets, architectural patterns, detailed forward and backward calculations, ReLU activation, pooling strategies, Python implementation with NumPy, gradient checking, and a practical MNIST application.

BackpropagationImplementationNumPy

0 likes · 22 min read

Mastering Convolutional Neural Networks: Theory, Training, and Implementation