1 reference to EncodeCodePointToUtf8
Microsoft.ML.Tokenizers (1)
Utils\Helpers.cs (1)
231
i +=
EncodeCodePointToUtf8
(text, i, ref bytes, ref bytesIndex) - 1;