2 references to AddPrefixTokens
Microsoft.ML.Tokenizers (2)
Model\SentencePieceUnigramModel.cs (2)
496AddPrefixTokens(tokens); 546AddPrefixTokens(tokens);