1 write to KBias
Microsoft.ML.TorchSharp (1)
NasBert\Modules\MultiHeadAttention.cs (1)
97KBias = torch.zeros(1, 1, _embeddingDim).AsParameter();
3 references to KBias
Microsoft.ML.TorchSharp (3)
NasBert\Modules\MultiHeadAttention.cs (3)
135ModelUtils.InitXavierUniform(KBias); 204var kRepeat = KBias.repeat(1, batchSize, 1); 392KBias?.Dispose();