1 write to SplitOnSpecialTokens
Microsoft.ML.Tokenizers (1)
Model\BertTokenizer.cs (1)
36
SplitOnSpecialTokens
= options.SplitOnSpecialTokens;