1 write to qkv_proj
Microsoft.ML.GenAI.Core (1)
Module\Attention.cs (1)
118
this.
qkv_proj
= new QuantizedLinear(this._hiddenSize, opSize, hasBias: attentionBias, dtype: dtype);
2 references to qkv_proj
Microsoft.ML.GenAI.Core (2)
Module\Attention.cs (2)
144
if (this.
qkv_proj
is not null)
146
var qkv = this.
qkv_proj
.forward(hiddenStates);