1 type derived from GenAILinear
Microsoft.ML.GenAI.Core (1)
9 instantiations of GenAILinear
Microsoft.ML.GenAI.Mistral (1)
Microsoft.ML.GenAI.Phi (8)
Module\Phi2Attention.cs (4)
71this.q_proj = new GenAILinear(this._hiddenSize, this._numAttentionHeads * this._headDim, hasBias: true, dtype: config.Dtype);
72this.k_proj = new GenAILinear(this._hiddenSize, this._numKeyValueHeads * this._headDim, hasBias: true, dtype: config.Dtype);
73this.v_proj = new GenAILinear(this._hiddenSize, this._numKeyValueHeads * this._headDim, hasBias: true, dtype: config.Dtype);
74this.dense = new GenAILinear(this._numAttentionHeads * this._headDim, this._hiddenSize, hasBias: true, dtype: config.Dtype);
10 references to GenAILinear
Microsoft.ML.GenAI.Core (1)
Microsoft.ML.GenAI.Mistral (1)
Microsoft.ML.GenAI.Phi (8)