1 implementation of GetUsableLength
Microsoft.ML.GenAI.Core (1)
Utility\Cache.cs (1)
72
public int
GetUsableLength
(int newSeqLen, int layerIndex = 0)
1 reference to GetUsableLength
Microsoft.ML.GenAI.Core (1)
Module\Attention.cs (1)
170
kvSeqLen += pastKeyValue.
GetUsableLength
(kvSeqLen, this._layerIdx);