Piece

2 writes to Piece

Microsoft.ML.Tokenizers (2)

SentencepieceModel.cs (2)

4560Piece = other.Piece; 4616Piece = input.ReadString();

10 references to Piece

Microsoft.ML.Tokenizers (10)

Model\SentencePieceBpeModel.cs (2)

31_vocab.Add(new StringSpanOrdinalKey(piece.Piece), (i, piece.Score, (byte)piece.Type)); 32_vocabReverse.Add(i, piece.Piece);

Model\SentencePieceUnigramModel.cs (2)

41string piece = modelProto.Pieces[i].Piece; 55_vocabReverse[i] = (modelProto.Pieces[i].Piece, modelProto.Pieces[i].Score, ModelProto.Types.SentencePiece.Types.Type.Unknown);

SentencepieceModel.cs (6)

4448if (Piece != other.Piece) return false; 4461if (HasPiece) hash ^= Piece.GetHashCode(); 4512output.WriteString(Piece); 4536size += 1 + pb::CodedOutputStream.ComputeStringSize(Piece); 4560Piece = other.Piece;