2 references to AddWhiteSpace
Microsoft.ML.Tokenizers (2)
Normalizer\SentencePieceNormalizer.cs (2)
462AddWhiteSpace(this, normalized, ref normalizedIndex, ref poolArray); 538AddWhiteSpace(this, normalized, ref normalizedIndex, ref poolArray);