1 reference to ApplyRotaryPosEmb
Microsoft.ML.GenAI.Core (1)
Module\Attention.cs (1)
172
(queryStates, keyStates) = Utils.
ApplyRotaryPosEmb
(queryStates, keyStates, input.PositionalEmbeddings.Cos, input.PositionalEmbeddings.Sin);