1 write to self_attn
Microsoft.ML.GenAI.LLaMA (1)
Module\LlamaDecoderLayer.cs (1)
89
this.
self_attn
= CreateAttention(config, layerIndex);
1 reference to self_attn
Microsoft.ML.GenAI.LLaMA (1)
Module\LlamaDecoderLayer.cs (1)
134
var selfAttnOutput = this.
self_attn
.forward(selfAttnInput);