1 reference to ValidateVocab
Microsoft.ML.Tokenizers (1)
Model\SentencePieceUnigramModel.cs (1)
119
CheckSpecialId(addBos, FindSpecialTokenId(
ValidateVocab
(pieces, unkId), "<s>"), "addBeginningOfSentence"),