1 write to AddDummyPrefix
Microsoft.ML.Tokenizers.Tests (1)
UnigramTests.cs (1)
43
options.
AddDummyPrefix
= true;
2 references to AddDummyPrefix
Microsoft.ML.Tokenizers (2)
Model\SentencePieceBaseModel.cs (2)
94
AddDummyPrefix = options.
AddDummyPrefix
;
118
options.
AddDummyPrefix
, options.EscapeWhiteSpaces,