1 write to attention_bias_idxs
Microsoft.ML.TorchSharp (1)
AutoFormerV2\Attention.cs (1)
92
this.
attention_bias_idxs
= TensorIndex.Tensor(idxsTensor);
1 reference to attention_bias_idxs
Microsoft.ML.TorchSharp (1)
AutoFormerV2\Attention.cs (1)
116
var attn = (torch.matmul(q, k.transpose(-2, -1)) * this.scale) + this.attention_biases[RangeUtil.ToTensorIndex(..), this.
attention_bias_idxs
];