1 reference to Bpe
Microsoft.ML.Tokenizers (1)
Model\SentencePieceTokenizer.cs (1)
37
SentencePieceModelType.
Bpe
=> new SentencePieceBpeModel(options),