1 write to _wordOrNonWordPreTokenizer
Microsoft.ML.Tokenizers (1)
PreTokenizer\PreTokenizer.cs (1)
92
return
_wordOrNonWordPreTokenizer
??= new RegexPreTokenizer(WordOrNonWordRegex(), null);