1 reference to InsertDummyPrefixAtEnd
Microsoft.ML.Tokenizers (1)
Normalizer\SentencePieceNormalizer.cs (1)
155
InsertDummyPrefixAtEnd
(span, ref bufferIndex);