1 reference to BertTokenizer
Microsoft.ML.Tokenizers (1)
Model\BertTokenizer.cs (1)
812
return new
BertTokenizer
(vocab, vocabReverse, preTokenizer, normalizer, specialTokens, doLowerCase, doBasicTokenization,