2 references to GetGpt2Tokenizer
Microsoft.ML.Tokenizers.Tests (2)
BpeTests.cs (2)
414Tokenizer tokenizer = GetGpt2Tokenizer(); 473Tokenizer tokenizer = GetGpt2Tokenizer();