1 write to _preTokenizer
Microsoft.ML.Tokenizers (1)
Model\EnglishRobertaTokenizer.cs (1)
158_preTokenizer = preTokenizer;
5 references to _preTokenizer
Microsoft.ML.Tokenizers (5)
Model\EnglishRobertaTokenizer.cs (5)
255public override PreTokenizer? PreTokenizer => _preTokenizer; 327_preTokenizer, 428_preTokenizer, 515_preTokenizer, 562_preTokenizer,