2 references to GetGpt2Tokenizer
Microsoft.ML.Tokenizers.Tests (2)
BpeTests.cs (2)
401Tokenizer tokenizer = GetGpt2Tokenizer(); 460Tokenizer tokenizer = GetGpt2Tokenizer();