3 references to WordPieceTokenizer
Microsoft.ML.Tokenizers (3)
Model\BertTokenizer.cs (1)
30BertOptions options) : base(vocab, vocabReverse, options)
Model\WordPieceTokenizer.cs (2)
165return new WordPieceTokenizer(vocab, vocabReverse, options); 229return new WordPieceTokenizer(vocab, vocabReverse, options);