Base:
method
Decode
Microsoft.ML.Tokenizers.Tokenizer.Decode(System.Collections.Generic.IEnumerable<System.Int32>)
4 references to Decode
Microsoft.ML.GenAI.LLaMA.Tests (1)
LLaMA3_1Tests.cs (1)
84var decodeToString = tokenizer.Decode(tokenizeIds);
Microsoft.ML.Tokenizers.Tests (3)
TiktokenTests.cs (3)
304Assert.Equal(text, tokenizer.Decode(encoded)); 312Assert.Equal(text, tokenizer.Decode(encoded)); 823Assert.Equal(text, GptOss.Decode(ids));