2 references to Create
Microsoft.ML.Tokenizers.Tests (2)
BpeTests.cs (2)
369_gpt2Tokenizer = BpeTokenizer.Create(vocabStream, mergesStream); 389bpe = BpeTokenizer.Create(vocabStream, mergesStream);