_cache

2 writes to _cache

Microsoft.ML.GenAI.Phi (2)

Module\Phi3Model.cs (2)

44this._cache = new DynamicKVCache(); 59this._cache = input.OverrideCache;

2 references to _cache

Microsoft.ML.GenAI.Phi (2)

Module\Phi3Model.cs (2)

128pastKeyValue: this._cache, 145return new CausalLMModelOutput(lastHiddenState: hiddenStates, allHiddenStates: allHiddenStates.ToArray(), attentions: allAttentions.ToArray(), cache: this._cache);