1 reference to EncodeCodePointToUtf8
Microsoft.ML.Tokenizers.Tests (1)
src\Microsoft.ML.Tokenizers\Utils\Helpers.cs (1)
231
i +=
EncodeCodePointToUtf8
(text, i, ref bytes, ref bytesIndex) - 1;