3 writes to _cache
Microsoft.ML.GenAI.LLaMA (3)
Module\LlamaModel.cs (3)
41this._cache = new DynamicKVCache(); 58this._cache = input.OverrideCache; 62this._cache = null;
2 references to _cache
Microsoft.ML.GenAI.LLaMA (2)
Module\LlamaModel.cs (2)
135pastKeyValue: this._cache, 152return new CausalLMModelOutput(lastHiddenState: hiddenStates, allHiddenStates: allHiddenStates.ToArray(), attentions: allAttentions.ToArray(), cache: this._cache);