1 write to q_proj
Microsoft.ML.GenAI.Phi (1)
Module\Phi2Attention.cs (1)
71
this.
q_proj
= new GenAILinear(this._hiddenSize, this._numAttentionHeads * this._headDim, hasBias: true, dtype: config.Dtype);
1 reference to q_proj
Microsoft.ML.GenAI.Phi (1)
Module\Phi2Attention.cs (1)
112
var queryStates = this.
q_proj
.forward(hiddenStates);