UserDefined

2 references to UserDefined

Microsoft.ML.Tokenizers (2)

Model\SentencePieceUnigramModel.cs (2)

38modelProto.Pieces[i].Type == ModelProto.Types.SentencePiece.Types.Type.UserDefined || 566float score = _vocabReverse[ret].Type == ModelProto.Types.SentencePiece.Types.Type.UserDefined ? length * _maxScore - 0.1f : _vocabReverse[ret].Score;