1 reference to SentencePieceTokenizer
Microsoft.ML.Tokenizers (1)
Model\SentencePieceTokenizer.cs (1)
482
return new
SentencePieceTokenizer
(options);