1 write to input_layernorm
Microsoft.ML.GenAI.LLaMA (1)
Module\LlamaDecoderLayer.cs (1)
91
this.
input_layernorm
= new Core.RMSNorm(this._hiddenSize, eps: config.RmsNormEps, config.DType);
1 reference to input_layernorm
Microsoft.ML.GenAI.LLaMA (1)
Module\LlamaDecoderLayer.cs (1)
124
var hiddenStates = this.
input_layernorm
.forward(input.HiddenStates);