1 reference to new
Microsoft.ML.Tokenizers (1)
Model\CodeGenTokenizer.cs (1)
1716SymbolPair pair = new(left, right, rank, symbols[left].pieceSpan.Length + symbols[right].pieceSpan.Length);