1 implementation of TypedTokenizer
Microsoft.ML.GenAI.Core (1)
Pipeline\CausalLMPipeline.cs (1)
80
public TTokenizer
TypedTokenizer
{ get => (TTokenizer)base.Tokenizer; }
1 reference to TypedTokenizer
Microsoft.ML.GenAI.Samples (1)
Llama\SFT_Llama_3_2_1B.cs (1)
46
var input = CreateDataset(dataset, pipeline.
TypedTokenizer
, Llama3_1ChatTemplateBuilder.Instance);