1 reference to DecodeByteLevel
Microsoft.ML.Tokenizers (1)
Model\BPETokenizer.cs (1)
904
return
DecodeByteLevel
(ids, destination, considerSpecialTokens, out idsConsumed, out charsWritten);