5 instantiations of DynamicKVCache
Microsoft.ML.GenAI.Core (2)
Pipeline\CausalLMPipeline.cs (2)
143var cache = new DynamicKVCache(); 313OverrideCache = new DynamicKVCache(),
Microsoft.ML.GenAI.LLaMA (1)
Module\LlamaModel.cs (1)
41this._cache = new DynamicKVCache();
Microsoft.ML.GenAI.Mistral (1)
MistralModel.cs (1)
41this._cache = new DynamicKVCache();
Microsoft.ML.GenAI.Phi (1)
Module\Phi3Model.cs (1)
44this._cache = new DynamicKVCache();
1 reference to DynamicKVCache
Microsoft.ML.GenAI.Core (1)
Pipeline\CausalLMPipeline.cs (1)
143var cache = new DynamicKVCache();