1 write to resid_mlp_dropout
Microsoft.ML.GenAI.Phi (1)
Module\Phi3DecoderLayer.cs (1)
96
this.
resid_mlp_dropout
= nn.Dropout(config.ResidPdrop);
1 reference to resid_mlp_dropout
Microsoft.ML.GenAI.Phi (1)
Module\Phi3DecoderLayer.cs (1)
132
hiddenStates = residual + this.
resid_mlp_dropout
.forward(hiddenStates);