2 writes to TreatWhitespaceAsSuffix
Microsoft.ML.Tokenizers (2)
SentencepieceModel.cs (2)
2316TreatWhitespaceAsSuffix = other.TreatWhitespaceAsSuffix; 2681TreatWhitespaceAsSuffix = input.ReadBool();
7 references to TreatWhitespaceAsSuffix
Microsoft.ML.Tokenizers (7)
Model\SentencePieceBaseModel.cs (2)
35TreatWhitespaceAsSuffix = modelProto.TrainerSpec.TreatWhitespaceAsSuffix; 58modelProto.TrainerSpec.TreatWhitespaceAsSuffix,
SentencepieceModel.cs (5)
1633if (TreatWhitespaceAsSuffix != other.TreatWhitespaceAsSuffix) return false; 1689if (HasTreatWhitespaceAsSuffix) hash ^= TreatWhitespaceAsSuffix.GetHashCode(); 1997output.WriteBool(TreatWhitespaceAsSuffix); 2316TreatWhitespaceAsSuffix = other.TreatWhitespaceAsSuffix;