1 write to AttnImplementation
Microsoft.ML.GenAI.LLaMA (1)
LlamaConfig.cs (1)
38
this.
AttnImplementation
= "eager";
1 reference to AttnImplementation
Microsoft.ML.GenAI.LLaMA (1)
Module\LlamaModel.cs (1)
108
if (this._config.
AttnImplementation
== "flash_attention_2")