1 write to post_attention_layernorm
Microsoft.ML.GenAI.LLaMA (1)
Module\LlamaDecoderLayer.cs (1)
92
this.
post_attention_layernorm
= new Core.RMSNorm(this._hiddenSize, eps: config.RmsNormEps, config.DType);
1 reference to post_attention_layernorm
Microsoft.ML.GenAI.LLaMA (1)
Module\LlamaDecoderLayer.cs (1)
140
hiddenStates = this.
post_attention_layernorm
.forward(hiddenStates);