1 write to ByteLevel
Microsoft.ML.Tokenizers.Tests (1)
BpeTests.cs (1)
919
bpeOptions.
ByteLevel
= byteLevel;
1 reference to ByteLevel
Microsoft.ML.Tokenizers (1)
Model\BPETokenizer.cs (1)
190
options.
ByteLevel
,