1 reference to _beta
Microsoft.ML.TorchSharp (1)
NasBert\Modules\ActivationFunction.cs (1)
73
var x1 = torch.pow(x, 3).mul_(
_beta
).add_(x).mul_(_alpha); // sqrt(2/Pi) * (x + 0.044715 x^3)