3 writes to FuseUnknownTokens
Microsoft.ML.Tokenizers.Tests (3)
BpeTests.cs (3)
268FuseUnknownTokens = fuseUnknownToken 291FuseUnknownTokens = fuseUnknownToken 986bpeOptions.FuseUnknownTokens = fuseUnknownTokensElement.GetBoolean();
1 reference to FuseUnknownTokens
Microsoft.ML.Tokenizers (1)
Model\BPETokenizer.cs (1)
194options.FuseUnknownTokens,