2 writes to _cache
Microsoft.ML.GenAI.Phi (2)
Module\Phi3Model.cs (2)
44
this.
_cache
= new DynamicKVCache();
59
this.
_cache
= input.OverrideCache;
2 references to _cache
Microsoft.ML.GenAI.Phi (2)
Module\Phi3Model.cs (2)
128
pastKeyValue: this.
_cache
,
145
return new CausalLMModelOutput(lastHiddenState: hiddenStates, allHiddenStates: allHiddenStates.ToArray(), attentions: allAttentions.ToArray(), cache: this.
_cache
);