1 write to _rotaryEmb
Microsoft.ML.GenAI.LLaMA (1)
Module\LlamaModel.cs (1)
43
this.
_rotaryEmb
= config.RopeScaling switch
1 reference to _rotaryEmb
Microsoft.ML.GenAI.LLaMA (1)
Module\LlamaModel.cs (1)
123
var embOutput = this.
_rotaryEmb
.forward(new RotaryEmbeddingInput(hiddenStates, positionIds, pastKeyValuesLength));