StoreNormalizedTextFromEnd

2 references to StoreNormalizedTextFromEnd

Microsoft.ML.Tokenizers (2)

Model\SentencePieceUnigramModel.cs (2)

1622StoreNormalizedTextFromEnd(text.Slice(current.Offset, current.Length), ref normalizedString, ref normalizedStringCountFromEnd); 1722StoreNormalizedTextFromEnd(text, ref normalizedString, ref normalizedStringCountFromEnd);