torch.nn.functional.softplus¶

torch.nn.functional.softplus(input, beta=1, threshold=20) → Tensor ¶

Applies element-wise, the function \(\text{Softplus}(x) = \frac{1}{\beta} * \log(1 + \exp(\beta * x))\).

For numerical stability the implementation reverts to the linear function when \(input \times \beta > threshold\).