1 reference to LastIndexOf
Microsoft.ML.Tokenizers (1)
Model\EnglishRobertaTokenizer.cs (1)
488
return
LastIndexOf
(text, textSpan, settings.MaxTokenCount, settings.ConsiderPreTokenization, settings.ConsiderNormalization, out normalizedText, out tokenCount);