1 reference to EndOfSentenceToken
Microsoft.ML.Tokenizers (1)
Model\BPETokenizer.cs (1)
192
options.
EndOfSentenceToken
);