1 reference to CreateForModel
Microsoft.ML.Tokenizers.Tests (1)
TiktokenTests.cs (1)
82
tokenizer = TiktokenTokenizer.
CreateForModel
("gpt-4", stream);