1 write to ByteLevel
Microsoft.ML.Tokenizers (1)
Model\BPETokenizer.cs (1)
310ByteLevel = byteLevel;
9 references to ByteLevel
Microsoft.ML.Tokenizers (9)
Model\BPETokenizer.cs (9)
783if (ByteLevel) 902if (ByteLevel) 1317if (ByteLevel) 1430if (ByteLevel) 1456if (ByteLevel) 1477if (ByteLevel) 1510if (ByteLevel) 1537if (ByteLevel) 1559if (ByteLevel)