2 writes to EosId
Microsoft.ML.Tokenizers (2)
SentencepieceModel.cs (2)
2351EosId = other.EosId; 2729EosId = input.ReadInt32();
8 references to EosId
Microsoft.ML.Tokenizers (8)
Model\SentencePieceTokenizer.cs (2)
66EndOfSentenceId = modelProto.TrainerSpec.EosId <= 0 ? 1 : modelProto.TrainerSpec.EosId;
SentencepieceModel.cs (6)
1646if (EosId != other.EosId) return false; 1702if (HasEosId) hash ^= EosId.GetHashCode(); 2039output.WriteInt32(EosId); 2206size += 2 + pb::CodedOutputStream.ComputeInt32Size(EosId); 2351EosId = other.EosId;