2 references to ExtractPrecompiledCharsMap
Microsoft.ML.Tokenizers (2)
Model\SentencePieceTokenizer.cs (2)
688
precompiledCharsMap =
ExtractPrecompiledCharsMap
(normalizerElement);
1062
byte[]? innerResult =
ExtractPrecompiledCharsMap
(inner);