1 write to input_layernorm
Microsoft.ML.GenAI.Mistral (1)
MistralDecoderLayer.cs (1)
85
this.
input_layernorm
= new Core.RMSNorm(this._hiddenSize, eps: config.RmsNormEps, config.DType);
1 reference to input_layernorm
Microsoft.ML.GenAI.Mistral (1)
MistralDecoderLayer.cs (1)
118
var hiddenStates = this.
input_layernorm
.forward(input.HiddenStates);