Piece

2 writes to Piece

Microsoft.ML.Tokenizers (2)

SentencepieceModel.cs (2)

4560Piece = other.Piece; 4616Piece = input.ReadString();

8 references to Piece

Microsoft.ML.Tokenizers (8)

Model\SentencePieceTokenizer.cs (2)

51_vocab.Add(new StringSpanOrdinalKey(piece.Piece), (i, piece.Score, (byte)piece.Type)); 52_vocabReverse.Add(i, piece.Piece);

SentencepieceModel.cs (6)

4448if (Piece != other.Piece) return false; 4461if (HasPiece) hash ^= Piece.GetHashCode(); 4512output.WriteString(Piece); 4536size += 1 + pb::CodedOutputStream.ComputeStringSize(Piece); 4560Piece = other.Piece;