1 write to HeadDim
Microsoft.ML.GenAI.Mistral (1)
MistralConfig.cs (1)
34
this.
HeadDim
= this.HiddenSize / this.NumAttentionHeads;
1 reference to HeadDim
Microsoft.ML.GenAI.Mistral (1)
MistralModel.cs (1)
32
var headDim = config.
HeadDim
;