1 write to ClassificationToken
Microsoft.ML.Tokenizers (1)
Model\BertTokenizer.cs (1)
44ClassificationToken = options.ClassificationToken;
1 reference to ClassificationToken
Microsoft.ML.Tokenizers.Tests (1)
BertTokenizerTests.cs (1)
125Assert.True(tokenizer.SpecialTokens!.ContainsKey(tokenizer.ClassificationToken));