1 write to v_proj
Microsoft.ML.GenAI.Core (1)
Module\Attention.cs (1)
124
this.
v_proj
= new QuantizedLinear(this._hiddenSize, this._numKeyValueHeads * this._headDim, hasBias: attentionBias, dtype: dtype);
2 references to v_proj
Microsoft.ML.GenAI.Core (2)
Module\Attention.cs (2)
152
else if (this.q_proj is not null && this.k_proj is not null && this.
v_proj
is not null)
156
valueStates = this.
v_proj
.forward(hiddenStates);