Implemented interface member:
method
GenerateStreaming
Microsoft.ML.GenAI.Core.ICausalLMPipeline.GenerateStreaming(TorchSharp.torch.Tensor, TorchSharp.torch.Tensor, System.Int32[][], System.Single, System.Single, System.Int32)
2 references to GenerateStreaming
Microsoft.ML.GenAI.Core (2)
Pipeline\CausalLMPipeline.cs (2)
205
foreach (var (token, _logits) in this.
GenerateStreaming
(inputIds, attentionMask, stopTokenSequence, temperature, topP, maxLen))
270
foreach (var (token, _) in this.
GenerateStreaming
(inputTensor, attentionMask, stopTokenIds.ToArray(), temperature: temperature, maxLen: maxLen))
