2 references to AddSuffixTokens
Microsoft.ML.Tokenizers (2)
Model\SentencePieceUnigramModel.cs (2)
528AddSuffixTokens(tokens, progressOffset); 556AddSuffixTokens(tokens, progressOffset);