1 write to RemoveExtraWhitespaces
Microsoft.ML.Tokenizers (1)
SentencepieceModel.cs (1)
450
result.
RemoveExtraWhitespaces
= SentencePieceProtobufReader.ReadRawVarint32(data, end, ref pos) != 0;
1 reference to RemoveExtraWhitespaces
Microsoft.ML.Tokenizers (1)
Model\SentencePieceBaseModel.cs (1)
56
modelProto.NormalizerSpec.
RemoveExtraWhitespaces
,