2 instantiations of SentencePieceBpeModel
Microsoft.ML.Tokenizers (2)
Model\SentencePieceTokenizer.cs (2)
27
TrainerSpec.Types.ModelType.Bpe => new
SentencePieceBpeModel
(modelProto, addBos, addEos, specialTokens),
37
SentencePieceModelType.Bpe => new
SentencePieceBpeModel
(options),