1 write to resid_attn_dropout
Microsoft.ML.GenAI.Phi (1)
Module\Phi3DecoderLayer.cs (1)
95
this.
resid_attn_dropout
= nn.Dropout(config.ResidPdrop);
1 reference to resid_attn_dropout
Microsoft.ML.GenAI.Phi (1)
Module\Phi3DecoderLayer.cs (1)
128
hiddenStates = residual + this.
resid_attn_dropout
.forward(attnOutputs);