1 write to up_proj
Microsoft.ML.GenAI.LLaMA (1)
Module\LlamaMLP.cs (1)
41this.up_proj = new QuantizedLinear(this._hiddenSize, this._intermediateSize, hasBias: this._hasBias, dtype: config.DType);
1 reference to up_proj
Microsoft.ML.GenAI.LLaMA (1)
Module\LlamaMLP.cs (1)
58using var input3 = input2 * this.up_proj.forward(input);