3 references to DynamicKVCache
Microsoft.ML.GenAI.Core (1)
Pipeline\CausalLMPipeline.cs (1)
139
var cache = new
DynamicKVCache
();
Microsoft.ML.GenAI.LLaMA (1)
Module\LlamaModel.cs (1)
47
this._cache = new
DynamicKVCache
();
Microsoft.ML.GenAI.Phi (1)
Module\Phi3Model.cs (1)
44
this._cache = new
DynamicKVCache
();