1 write to self_attn
Microsoft.ML.GenAI.Mistral (1)
MistralDecoderLayer.cs (1)
83
this.
self_attn
= CreateAttention(config, layerIndex);
1 reference to self_attn
Microsoft.ML.GenAI.Mistral (1)
MistralDecoderLayer.cs (1)
128
var selfAttnOutput = this.
self_attn
.forward(selfAttnInput);