2 references to GetGpt2Tokenizer
Microsoft.ML.Tokenizers.Tests (2)
BpeTests.cs (2)
368Tokenizer tokenizer = GetGpt2Tokenizer(); 427Tokenizer tokenizer = GetGpt2Tokenizer();