1 instantiation of ScenarioRun
Microsoft.Extensions.AI.Evaluation.Reporting (1)
ReportingConfiguration.cs (1)
206return new ScenarioRun(
100 references to ScenarioRun
Microsoft.Extensions.AI.Evaluation.Integration.Tests (12)
EvaluatorTests.cs (2)
61await using ScenarioRun scenarioRun = 112await using ScenarioRun scenarioRun =
ResultsTests.cs (10)
156await using ScenarioRun scenarioRun = 181await using ScenarioRun scenarioRun = 231await using ScenarioRun scenarioRun = 286await using ScenarioRun scenarioRun = 335await using ScenarioRun scenarioRun = 370await using ScenarioRun scenarioRun = 428await using ScenarioRun scenarioRun = 475await using ScenarioRun scenarioRun = 528await using ScenarioRun scenarioRun = 560await using ScenarioRun scenarioRun =
Microsoft.Extensions.AI.Evaluation.Reporting (84)
Defaults.cs (1)
23/// <see cref="ScenarioRun"/> via
IResponseCacheProvider.cs (9)
12/// <see cref="ScenarioRun"/>. 17/// responses associated with each <see cref="ScenarioRun"/> are stored in the <see cref="IDistributedCache"/> that is 20/// <see cref="ScenarioRun"/> use the cached responses instead of invoking the AI model to generate new ones. Bypassing 27/// <see cref="ScenarioRun"/>. 29/// <param name="scenarioName">The <see cref="ScenarioRun.ScenarioName"/>.</param> 30/// <param name="iterationName">The <see cref="ScenarioRun.IterationName"/>.</param> 34/// <see cref="ScenarioRun"/>. 42/// Deletes cached AI responses for all <see cref="ScenarioRun"/>s. 49/// Deletes expired cache entries for all <see cref="ScenarioRun"/>s.
IResultStore.cs (24)
16/// Returns <see cref="ScenarioRunResult"/>s for <see cref="ScenarioRun"/>s filtered by the specified 25/// The <see cref="ScenarioRun.ExecutionName"/> by which the <see cref="ScenarioRunResult"/>s should be filtered. 26/// If omitted, all <see cref="ScenarioRun.ExecutionName"/>s are considered. 29/// The <see cref="ScenarioRun.ScenarioName"/> by which the <see cref="ScenarioRunResult"/>s should be filtered. 30/// If omitted, all <see cref="ScenarioRun.ScenarioName"/>s that are in scope based on the specified 34/// The <see cref="ScenarioRun.IterationName"/> by which the <see cref="ScenarioRunResult"/>s should be filtered. 35/// If omitted, all <see cref="ScenarioRun.IterationName"/>s that are in scope based on the specified 55/// Deletes <see cref="ScenarioRunResult"/>s for <see cref="ScenarioRun"/>s filtered by the specified 64/// The <see cref="ScenarioRun.ExecutionName"/> by which the <see cref="ScenarioRunResult"/>s should be filtered. 65/// If omitted, all <see cref="ScenarioRun.ExecutionName"/>s are considered. 68/// The <see cref="ScenarioRun.ScenarioName"/> by which the <see cref="ScenarioRunResult"/>s should be filtered. 69/// If omitted, all <see cref="ScenarioRun.ScenarioName"/>s that are in scope based on the specified 73/// The <see cref="ScenarioRun.IterationName"/> by which the <see cref="ScenarioRunResult"/>s should be filtered. 74/// If omitted, all <see cref="ScenarioRun.IterationName"/>s that are in scope based on the specified 86/// Gets the <see cref="ScenarioRun.ExecutionName"/>s of the most recent <paramref name="count"/> executions from 89/// <param name="count">The number of <see cref="ScenarioRun.ExecutionName"/>s to retrieve.</param> 92/// The <see cref="ScenarioRun.ExecutionName"/>s of the most recent <paramref name="count"/> executions from the 100/// Gets the <see cref="ScenarioRun.ScenarioName"/>s present in the execution with the specified 103/// <param name="executionName">The <see cref="ScenarioRun.ExecutionName"/>.</param> 106/// The <see cref="ScenarioRun.ScenarioName"/>s present in the execution with the specified 114/// Gets the <see cref="ScenarioRun.IterationName"/>s present in the scenario with the specified 117/// <param name="executionName">The <see cref="ScenarioRun.ExecutionName"/>.</param> 118/// <param name="scenarioName">The <see cref="ScenarioRun.ScenarioName"/>.</param> 121/// The <see cref="ScenarioRun.IterationName"/>s present in the scenario with the specified
ReportingConfiguration.cs (8)
14/// Represents the configuration for a set of <see cref="ScenarioRun"/>s that defines the set of 74/// See <see cref="ScenarioRun.ExecutionName"/> for more information about this concept. 113/// The name of the current execution. See <see cref="ScenarioRun.ExecutionName"/> for more information about this 149/// Creates a new <see cref="ScenarioRun"/> with the specified <paramref name="scenarioName"/> and 152/// <param name="scenarioName">The <see cref="ScenarioRun.ScenarioName"/>.</param> 154/// The <see cref="ScenarioRun.IterationName"/>. Uses default value <c>"1"</c> if omitted. 162/// A new <see cref="ScenarioRun"/> with the specified <paramref name="scenarioName"/> and 165public async ValueTask<ScenarioRun> CreateScenarioRunAsync(
ScenarioRun.cs (10)
22/// Gets the name of the scenario that this <see cref="ScenarioRun"/> represents. 30/// part of an evaluation. In this case, the <see cref="ScenarioName"/> for each <see cref="ScenarioRun"/> in the 37/// Gets the name of the iteration that this <see cref="ScenarioRun"/> represents. 53/// Gets the name of the execution that this <see cref="ScenarioRun"/> represents. 61/// <see cref="ScenarioRun"/>s in a particular evaluation run share the same timestamp for their 81/// part of the evaluation of this <see cref="ScenarioRun"/>. 120/// <see cref="IEvaluator"/>s included in this <see cref="ScenarioRun"/> may need to accurately evaluate the 137$"The {nameof(ScenarioRun)} with {nameof(ScenarioName)}: {ScenarioName}, {nameof(IterationName)}: {IterationName} and {nameof(ExecutionName)}: {ExecutionName} has already been evaluated. Do not call {nameof(EvaluateAsync)} more than once on a given {nameof(ScenarioRun)}."); 168/// Disposes the <see cref="ScenarioRun"/> and writes the <see cref="ScenarioRunResult"/> to the configured
ScenarioRunExtensions.cs (13)
12/// Extension methods for <see cref="ScenarioRun"/>. 20/// <param name="scenarioRun">The <see cref="ScenarioRun"/> of which this evaluation is a part.</param> 23/// Additional contextual information that the <see cref="IEvaluator"/>s included in this <see cref="ScenarioRun"/> 31this ScenarioRun scenarioRun, 44/// <param name="scenarioRun">The <see cref="ScenarioRun"/> of which this evaluation is a part.</param> 51/// <see cref="IEvaluator"/>s included in this <see cref="ScenarioRun"/> may need to accurately evaluate the 59this ScenarioRun scenarioRun, 74/// <param name="scenarioRun">The <see cref="ScenarioRun"/> of which this evaluation is a part.</param> 77/// Additional contextual information that the <see cref="IEvaluator"/>s included in this <see cref="ScenarioRun"/> 85this ScenarioRun scenarioRun, 103/// <param name="scenarioRun">The <see cref="ScenarioRun"/> of which this evaluation is a part.</param> 110/// <see cref="IEvaluator"/>s included in this <see cref="ScenarioRun"/> may need to accurately evaluate the 118this ScenarioRun scenarioRun,
ScenarioRunResult.cs (15)
18/// In other words, <see cref="ScenarioRunResult"/> represents the results of evaluating a <see cref="ScenarioRun"/> 20/// <see cref="ScenarioRun.EvaluateAsync(IEnumerable{ChatMessage}, ChatMessage, IEnumerable{Microsoft.Extensions.AI.Evaluation.EvaluationContext}?, CancellationToken)"/> 28/// <param name="scenarioName">The <see cref="ScenarioRun.ScenarioName"/>.</param> 29/// <param name="iterationName">The <see cref="ScenarioRun.IterationName"/>.</param> 30/// <param name="executionName">The <see cref="ScenarioRun.ExecutionName"/>.</param> 37/// The <see cref="Evaluation.EvaluationResult"/> for the <see cref="ScenarioRun"/> corresponding to the 53/// <param name="scenarioName">The <see cref="ScenarioRun.ScenarioName"/>.</param> 54/// <param name="iterationName">The <see cref="ScenarioRun.IterationName"/>.</param> 55/// <param name="executionName">The <see cref="ScenarioRun.ExecutionName"/>.</param> 62/// The <see cref="Evaluation.EvaluationResult"/> for the <see cref="ScenarioRun"/> corresponding to the 85/// Gets or sets the <see cref="ScenarioRun.ScenarioName"/>. 90/// Gets or sets the <see cref="ScenarioRun.IterationName"/>. 95/// Gets or sets the <see cref="ScenarioRun.ExecutionName"/>. 121/// Gets or sets the <see cref="Evaluation.EvaluationResult"/> for the <see cref="ScenarioRun"/> corresponding to 126/// <see cref="ScenarioRun.EvaluateAsync(IEnumerable{ChatMessage}, ChatMessage, IEnumerable{Microsoft.Extensions.AI.Evaluation.EvaluationContext}?, CancellationToken)"/>
Storage\DiskBasedReportingConfiguration.cs (1)
40/// The name of the current execution. See <see cref="ScenarioRun.ExecutionName"/> for more information about this
Storage\DiskBasedResponseCache.cs (3)
22/// <see cref="ScenarioRun"/> on disk. 48/// The <see cref="ScenarioRun.ScenarioName"/> for the returned <see cref="DiskBasedResponseCache"/> instance. 51/// The <see cref="ScenarioRun.IterationName"/> for the returned <see cref="DiskBasedResponseCache"/> instance.
Microsoft.Extensions.AI.Evaluation.Reporting.Azure (4)
Storage\AzureStorageReportingConfiguration.cs (1)
45/// The name of the current execution. See <see cref="ScenarioRun.ExecutionName"/> for more information about this
Storage\AzureStorageResponseCache.cs (3)
30/// <see cref="ScenarioRun"/> under an Azure Storage container. 37/// The <see cref="ScenarioRun.ScenarioName"/> for the returned <see cref="AzureStorageResponseCache"/> instance. 40/// The <see cref="ScenarioRun.IterationName"/> for the returned <see cref="AzureStorageResponseCache"/> instance.