1 reference to SentencePieceBpeModel
Microsoft.ML.Tokenizers (1)
Model\SentencePieceTokenizer.cs (1)
27
TrainerSpec.Types.ModelType.Bpe => new
SentencePieceBpeModel
(modelProto, addBos, addEos, specialTokens),