1 write to k_proj
Microsoft.ML.GenAI.Phi (1)
Module\Phi2Attention.cs (1)
72
this.
k_proj
= new GenAILinear(this._hiddenSize, this._numKeyValueHeads * this._headDim, hasBias: true, dtype: config.Dtype);
1 reference to k_proj
Microsoft.ML.GenAI.Phi (1)
Module\Phi2Attention.cs (1)
113
var keyStates = this.
k_proj
.forward(hiddenStates);