1 implementation of Tokenizer
Microsoft.ML.GenAI.Core (1)
Pipeline\CausalLMPipeline.cs (1)
116
public Tokenizer
Tokenizer
{ get; }