1 reference to new
Microsoft.ML.Tokenizers (1)
Model\CodeGenTokenizer.cs (1)
1716
SymbolPair pair =
new
(left, right, rank, symbols[left].pieceSpan.Length + symbols[right].pieceSpan.Length);