1 write to NumKeyValueHeads
Microsoft.ML.GenAI.Mistral (1)
MistralConfig.cs (1)
26
this.
NumKeyValueHeads
= 8;
2 references to NumKeyValueHeads
Microsoft.ML.GenAI.Mistral (2)
MistralDecoderLayer.cs (2)
97
numKeyValueHeads: config.
NumKeyValueHeads
,
98
numKeyValueGroups: config.NumAttentionHeads / config.
NumKeyValueHeads
,