1 write to input_layernorm
Microsoft.ML.GenAI.LLaMA (1)
Module\LlamaDecoderLayer.cs (1)
91this.input_layernorm = new Core.RMSNorm(this._hiddenSize, eps: config.RmsNormEps, config.DType);
1 reference to input_layernorm
Microsoft.ML.GenAI.LLaMA (1)
Module\LlamaDecoderLayer.cs (1)
124var hiddenStates = this.input_layernorm.forward(input.HiddenStates);