Base:
method
Decode
Microsoft.ML.Tokenizers.Tokenizer.Decode(System.Collections.Generic.IEnumerable<System.Int32>)
2 references to Decode
Microsoft.ML.Tokenizers.Tests (2)
BpeTests.cs (2)
832Assert.Equal(beginningOfSentenceToken + text, tokenizer.Decode(ids)); 871Assert.Equal(beginningOfSentenceToken + textWithSpecialTokens, tokenizer.Decode(ids));