3 references to TryMerge
Microsoft.ML.Tokenizers (3)
Model\SentencePieceBpeTokenizer.cs (3)
2199TryMerge(i - 1, i, text); 2226TryMerge(symbols[top.Left].prev, top.Left, text); 2227TryMerge(top.Left, symbols[top.Left].next, text);