Base:
method
Decode
Microsoft.ML.Tokenizers.Tokenizer.Decode(System.Collections.Generic.IEnumerable<System.Int32>, System.Span<System.Char>, out System.Int32, out System.Int32)
2 references to Decode
Microsoft.ML.Tokenizers.Tests (2)
TiktokenTests.cs (2)
170status = tokenizer.Decode(ids, destinationBuffer.AsSpan().Slice(0, i), out idsConsumed, out charactersWritten); 180status = tokenizer.Decode(ids, destinationBuffer.AsSpan(), out idsConsumed, out charactersWritten);