StoreNormalizedTextFromEnd

2 references to StoreNormalizedTextFromEnd

Microsoft.ML.Tokenizers (2)

Model\SentencePieceUnigramModel.cs (2)

1366StoreNormalizedTextFromEnd(text.Slice(current.Offset, current.Length), ref normalizedString, ref normalizedStringCountFromEnd); 1466StoreNormalizedTextFromEnd(text, ref normalizedString, ref normalizedStringCountFromEnd);