3 writes to EndOfWordSuffix
Microsoft.ML.Tokenizers.Tests (3)
BpeTests.cs (3)
267
EndOfWordSuffix
= endOfWordSuffix,
290
EndOfWordSuffix
= endOfWordSuffix,
981
bpeOptions.
EndOfWordSuffix
= endOfWordSuffixElement.GetString();
1 reference to EndOfWordSuffix
Microsoft.ML.Tokenizers (1)
Model\BPETokenizer.cs (1)
193
options.
EndOfWordSuffix
,