1 reference to CountIdsUpToMaxFromEnd
Microsoft.ML.Tokenizers (1)
Model\BpeTokenizer.cs (1)
1429return word.CountIdsUpToMaxFromEnd(maxTokens, fullTextLength, out textIndex);