1 write to dense
Microsoft.ML.GenAI.Phi (1)
Module\Phi2Attention.cs (1)
74
this.
dense
= new GenAILinear(this._numAttentionHeads * this._headDim, this._hiddenSize, hasBias: true, dtype: config.Dtype);
1 reference to dense
Microsoft.ML.GenAI.Phi (1)
Module\Phi2Attention.cs (1)
157
var result = this.
dense
.forward(attnOutput);