6 references to MergeWord
Microsoft.ML.Tokenizers (6)
Model\BPETokenizer.cs (6)
998word = MergeWord(text, ref priorityQueue); 1007word = MergeWord(text, ref priorityQueue); 1073word = MergeWord(text, ref priorityQueue); 1082word = MergeWord(text, ref priorityQueue); 1106word = MergeWord(text, ref priorityQueue); 1115word = MergeWord(text, ref priorityQueue);