1 write to ModelType
Microsoft.ML.Tokenizers (1)
SentencepieceModel.cs (1)
350result.ModelType = (Types.ModelType)SentencePieceProtobufReader.ReadRawVarint32(data, end, ref pos);
3 references to ModelType
Microsoft.ML.Tokenizers (3)
Model\LlamaTokenizer.cs (1)
47if (modelProto.TrainerSpec.ModelType != TrainerSpec.Types.ModelType.Bpe)
Model\SentencePieceTokenizer.cs (2)
25_model = modelProto.TrainerSpec.ModelType switch 29_ => throw new ArgumentException($"The model type '{modelProto.TrainerSpec.ModelType}' is not supported.", nameof(modelProto))