1 implementation of UpdateKVCache
Microsoft.ML.GenAI.Core (1)
Utility\Cache.cs (1)
33
public (Tensor, Tensor)
UpdateKVCache
(Tensor key, Tensor value, int layerIndex)
1 reference to UpdateKVCache
Microsoft.ML.GenAI.Core (1)
Module\Attention.cs (1)
176
(keyStates, valueStates) = pastKeyValue.
UpdateKVCache
(keyStates, valueStates, this._layerIdx);