3 writes to CurRank
Microsoft.ML.Tokenizers (3)
Utils\BytePairEncoder.cs (3)
168CurRank = int.MaxValue 188CurRank = int.MaxValue 228state[leftStart].CurRank = state[leftStart].NextRank;
2 references to CurRank
Microsoft.ML.Tokenizers (2)
Utils\BytePairEncoder.cs (2)
274int tokenId = state[currentIndex].CurRank != int.MaxValue 275? state[currentIndex].CurRank