1 write to SpecialTokens
Microsoft.ML.Tokenizers (1)
Model\SentencePieceBaseModel.cs (1)
37
SpecialTokens
= specialTokens;
1 reference to SpecialTokens
Microsoft.ML.Tokenizers (1)
Model\SentencePieceTokenizer.cs (1)
36
public IReadOnlyDictionary<string, int>? SpecialTokens => _model.
SpecialTokens
;