TestTokenizer

5 references to TestTokenizer

Microsoft.ML.Tokenizers.Tests (5)

EnglishRobertaTests.cs (5)

115TestTokenizer(tokenizer); 120TestTokenizer(tokenizer); 126TestTokenizer(tokenizer); 132TestTokenizer(tokenizer, order); 135TestTokenizer(tokenizer, order);