1 write to input_layernorm
Microsoft.ML.GenAI.Phi (1)
Module\Phi2DecoderLayer.cs (1)
38
this.
input_layernorm
= nn.LayerNorm(config.HiddenSize, eps: config.LayerNormEps, dtype: config.Dtype);
1 reference to input_layernorm
Microsoft.ML.GenAI.Phi (1)
Module\Phi2DecoderLayer.cs (1)
54
hiddenStates = this.
input_layernorm
.forward(hiddenStates);