1 write to RemoveExtraWhiteSpaces
Microsoft.ML.Tokenizers (1)
Normalizer\SentencePieceNormalizer.cs (1)
40RemoveExtraWhiteSpaces = removeExtraWhiteSpaces;
6 references to RemoveExtraWhiteSpaces
Microsoft.ML.Tokenizers (6)
Normalizer\SentencePieceNormalizer.cs (6)
157if (RemoveExtraWhiteSpaces) 213if (RemoveExtraWhiteSpaces) 426if (RemoveExtraWhiteSpaces) 465bool isPrevSpace = RemoveExtraWhiteSpaces; 512if (!RemoveExtraWhiteSpaces) 519if (RemoveExtraWhiteSpaces)