2 writes to SpecialTokens
Microsoft.ML.Tokenizers (2)
Model\SentencePieceBaseModel.cs (2)
37
SpecialTokens
= specialTokens;
84
SpecialTokens
= specialTokens;
1 reference to SpecialTokens
Microsoft.ML.Tokenizers (1)
Model\SentencePieceTokenizer.cs (1)
42
public IReadOnlyDictionary<string, int>? SpecialTokens => _model.
SpecialTokens
;