1 write to KBias
Microsoft.ML.TorchSharp (1)
NasBert\Modules\MultiHeadAttention.cs (1)
97
KBias
= torch.zeros(1, 1, _embeddingDim).AsParameter();
3 references to KBias
Microsoft.ML.TorchSharp (3)
NasBert\Modules\MultiHeadAttention.cs (3)
135
ModelUtils.InitXavierUniform(
KBias
);
204
var kRepeat =
KBias
.repeat(1, batchSize, 1);
392
KBias
?.Dispose();