1 reference to SlidingWindow
Microsoft.ML.GenAI.Phi (1)
Module\Phi3Model.cs (1)
111attentionMask = AttentionMaskConverter.Create4DCausalAttentionMask(attentionMask, [batchSize, seqLength], inputsEmbeds.dtype, device, pastKeyValuesLength, this._config.SlidingWindow);