Decode

3 references to Decode

Microsoft.ML.Tokenizers (1)

Model\CodeGenTokenizer.cs (1)

1327=> Decode(ids, destination, hasPrefixSpace: AddPrefixSpace, considerSpecialTokens: false, out idsConsumed, out charsWritten);

Microsoft.ML.Tokenizers.Tests (2)

CodeGenTests.cs (2)

314status = tokenizer.Decode(ids, destinationBuffer.AsSpan().Slice(0, i), hasPrefixSpace, considerSpecialTokens, out idsConsumed, out charactersWritten); 324status = tokenizer.Decode(ids, destinationBuffer.AsSpan(), hasPrefixSpace, considerSpecialTokens, out idsConsumed, out charactersWritten);