2 references to Create
Microsoft.ML.Tokenizers.Tests (2)
BpeTests.cs (2)
369
_gpt2Tokenizer = BpeTokenizer.
Create
(vocabStream, mergesStream);
389
bpe = BpeTokenizer.
Create
(vocabStream, mergesStream);