2 references to GetGpt2Tokenizer
Microsoft.ML.Tokenizers.Tests (2)
BpeTests.cs (2)
458
Tokenizer tokenizer =
GetGpt2Tokenizer
();
517
Tokenizer tokenizer =
GetGpt2Tokenizer
();