News

Deep Learning with Yacine on MSN2d
20 Activation Functions in Python for Deep Neural Networks | ELU, ReLU, Leaky ReLU, Sigmoid, Cosine
Explore 20 essential activation functions implemented in Python for deep neural networks—including ELU, ReLU, Leaky ReLU, ...
IEEE3d
Proposal of ReLU Activation Function Using III-V Semiconductor Membrane Laser for Optical Neural Network
Abstract: We propose programmable low-power-consumption optical ReLU activation function for the fully optical neural network. The optical-to-optical nonlinearity is realized using characteristics of ...
IEEE1d
Improving the Performance of Deep Neural Networks Using Two Proposed Activation Functions
Abstract: In artificial neural networks, activation functions play a significant role in the learning process. Choosing the proper activation function is a major factor in achieving a successful ...