Base:
method
PreTokenize
Microsoft.ML.Tokenizers.PreTokenizer.PreTokenize(System.ReadOnlySpan<System.Char>)