1 reference to new
Microsoft.ML.Tokenizers (1)
Model\SentencePieceTokenizer.cs (1)
2247
SymbolPair pair =
new
(left, right, leftId.Score, pieceLength, leftId.Id);