1 reference to ResolveTemplateTokenId
Microsoft.ML.Tokenizers (1)
Model\SentencePieceTokenizer.cs (1)
905
int id =
ResolveTemplateTokenId
(tokenName, ppSpecialTokens, specialTokens, vocab);