2 writes to MaxIdByteFallbackId
Microsoft.ML.Tokenizers (2)
Model\SentencePieceUnigramModel.cs (2)
61MaxIdByteFallbackId = ByteCodeToIdOffset + 0xFF; // from <0x00> to <0xFF>. 119MaxIdByteFallbackId = ByteCodeToIdOffset + 0xFF; // from <0x00> to <0xFF>.