1 write to _wordOrNonWordPreTokenizer
Microsoft.ML.Tokenizers (1)
PreTokenizer\PreTokenizer.cs (1)
98return _wordOrNonWordPreTokenizer ??= new RegexPreTokenizer(WordOrNonWordRegex(), null);