2 references to GetGpt2Tokenizer
Microsoft.ML.Tokenizers.Tests (2)
BpeTests.cs (2)
458Tokenizer tokenizer = GetGpt2Tokenizer(); 517Tokenizer tokenizer = GetGpt2Tokenizer();