1 write to input_layernorm
Microsoft.ML.GenAI.Phi (1)
Module\Phi3DecoderLayer.cs (1)
93
this.
input_layernorm
= new RMSNorm(config.HiddenSize, config.RmsNormEps, config.DType);
1 reference to input_layernorm
Microsoft.ML.GenAI.Phi (1)
Module\Phi3DecoderLayer.cs (1)
115
hiddenStates = this.
input_layernorm
.forward(hiddenStates);