2 writes to _unknownToken
Microsoft.ML.Tokenizers (2)
Model\BPETokenizer.cs (2)
47
_unknownToken
= value;
58
_unknownToken
= value;
1 reference to _unknownToken
Microsoft.ML.Tokenizers (1)
Model\BPETokenizer.cs (1)
40
return
_unknownToken
;