1 write to OutProjLinear
Microsoft.ML.TorchSharp (1)
NasBert\Modules\MultiHeadAttention.cs (1)
101OutProjLinear = torch.nn.Linear(_embeddingDim, _embeddingDim, _addBiasProj);
4 references to OutProjLinear
Microsoft.ML.TorchSharp (4)
NasBert\Modules\MultiHeadAttention.cs (4)
123ModelUtils.InitXavierUniform(OutProjLinear.weight); 130ModelUtils.InitConstant(OutProjLinear.bias, 0); 296var attentionOutput = OutProjLinear.forward(attention); 394OutProjLinear.Dispose();