1 reference to SentencePieceBpeModel
Microsoft.ML.Tokenizers (1)
Model\SentencePieceTokenizer.cs (1)
28
TrainerSpec.Types.ModelType.Bpe => new
SentencePieceBpeModel
(modelProto, addBos, addEos, specialTokens),