1 reference to MergeWord
Microsoft.ML.Tokenizers (1)
Model\BPETokenizer.cs (1)
1357
word =
MergeWord
(text, ref priorityQueue);