2 writes to FuseUnknownTokens
Microsoft.ML.Tokenizers.Tests (2)
BpeTests.cs (2)
278
FuseUnknownTokens
= fuseUnknownToken
913
bpeOptions.
FuseUnknownTokens
= fuseUnknownTokensElement.GetBoolean();
1 reference to FuseUnknownTokens
Microsoft.ML.Tokenizers (1)
Model\BPETokenizer.cs (1)
189
options.
FuseUnknownTokens
,