Base:
method
EncodeToTokens
Microsoft.ML.Tokenizers.Tokenizer.EncodeToTokens(System.String, System.ReadOnlySpan<System.Char>, Microsoft.ML.Tokenizers.EncodeSettings)