1 write to q_proj
Microsoft.ML.GenAI.Core (1)
Module\Attention.cs (1)
122this.q_proj = new QuantizedLinear(this._hiddenSize, this._numHeads * this._headDim, hasBias: attentionBias, dtype: dtype);
2 references to q_proj
Microsoft.ML.GenAI.Core (2)
Module\Attention.cs (2)
152else if (this.q_proj is not null && this.k_proj is not null && this.v_proj is not null) 154queryStates = this.q_proj.forward(hiddenStates);