2 references to
Microsoft.ML.Tokenizers (2)
Model\SentencePieceUnigramModel.cs (2)
117
:
this
(pieces, unkId, addBos, addEos, precompiledCharsmap, addDummyPrefix, escapeWhiteSpaces,
143
:
this
(pieces, unkId, addBos, addEos, precompiledCharsmap, addDummyPrefix, escapeWhiteSpaces,