1 reference to IsValidDecodeUtf8
Microsoft.ML.Tokenizers (1)
Normalizer\SentencePieceNormalizer.cs (1)
304
if (!Helpers.
IsValidDecodeUtf8
(input, out int length))