1 reference to _alpha
Microsoft.ML.TorchSharp (1)
NasBert\Modules\ActivationFunction.cs (1)
73
var x1 = torch.pow(x, 3).mul_(_beta).add_(x).mul_(
_alpha
); // sqrt(2/Pi) * (x + 0.044715 x^3)