1 write to _preTokenizer
Microsoft.ML.Tokenizers (1)
Model\EnglishRobertaTokenizer.cs (1)
146_preTokenizer = preTokenizer;
5 references to _preTokenizer
Microsoft.ML.Tokenizers (5)
Model\EnglishRobertaTokenizer.cs (5)
244public override PreTokenizer? PreTokenizer => _preTokenizer; 316_preTokenizer, 417_preTokenizer, 504_preTokenizer, 551_preTokenizer,