1 write to activation_fn
Microsoft.ML.GenAI.Phi (1)
Module\Phi3MLP.cs (1)
37
this.
activation_fn
= Core.Utils.GetActivation(hiddenAct);
1 reference to activation_fn
Microsoft.ML.GenAI.Phi (1)
Module\Phi3MLP.cs (1)
48
upStatus = upStatus * this.
activation_fn
.forward(gate);