2 writes to MaxIdByteFallbackId
Microsoft.ML.Tokenizers (2)
Model\SentencePieceUnigramModel.cs (2)
72MaxIdByteFallbackId = ByteCodeToIdOffset + 0xFF; // from <0x00> to <0xFF>. 225MaxIdByteFallbackId = ByteCodeToIdOffset + 0xFF;