Hard sigmoid is a generalization of the sigmoid activation function. Since it’s a generalization and almost linear it’s much faster and cheaper to compute than an ordinary sigmoid activation function.
Hard sigmoid is the default recurrent activation for LSTM models.
We use cookies to offer you a better experience, analyze site traffic and serve targeted advertisements. By using this site, you agree to this use. To find out more, read our Cookie Policy.
