2 references to GetPieceCount
Microsoft.ML.Tokenizers (2)
Model\SentencePieceUnigramModel.cs (2)
165bosId >= 0 && bosId < GetPieceCount(pieces) ? pieces[bosId].Piece : "<s>", bosId, 166eosId >= 0 && eosId < GetPieceCount(pieces) ? pieces[eosId].Piece : "</s>", eosId,