1 reference to
Microsoft.ML.Tokenizers (1)
Model\SentencePieceTokenizer.cs (1)
1658
Debug.Assert(sb
[
suffixIndex] == SentencePieceNormalizer.DummyPrefix);