1 reference to
Microsoft.ML.Tokenizers (1)
Model\SentencePieceBpeTokenizer.cs (1)
40
this
(modelProto is null ? throw new ArgumentNullException(nameof(modelProto)) : modelProto, specialTokens)