1 instantiation of TaskAdherenceEvaluator
Microsoft.Extensions.AI.Evaluation.Integration.Tests (1)
AgentQualityEvaluatorTests.cs (1)
63IEvaluator taskAdherenceEvaluator = new TaskAdherenceEvaluator();
17 references to TaskAdherenceEvaluator
Microsoft.Extensions.AI.Evaluation.Integration.Tests (4)
AgentQualityEvaluatorTests.cs (4)
103Assert.True(result.TryGet(TaskAdherenceEvaluator.TaskAdherenceMetricName, out NumericMetric? _)); 136Assert.True(result.TryGet(TaskAdherenceEvaluator.TaskAdherenceMetricName, out NumericMetric? _)); 160Assert.True(result.TryGet(TaskAdherenceEvaluator.TaskAdherenceMetricName, out NumericMetric? _)); 200Assert.True(result.TryGet(TaskAdherenceEvaluator.TaskAdherenceMetricName, out NumericMetric? _));
Microsoft.Extensions.AI.Evaluation.Quality (13)
TaskAdherenceEvaluator.cs (6)
20/// <see cref="TaskAdherenceEvaluator"/> measures how accurately an AI system adheres to the task assigned to it by 26/// Note that at the moment, <see cref="TaskAdherenceEvaluator"/> only supports evaluating calls to tools that are 31/// <see cref="TaskAdherenceEvaluator"/> returns a <see cref="NumericMetric"/> that contains a score for 'Task 36/// <b>Note:</b> <see cref="TaskAdherenceEvaluator"/> is an AI-based evaluator that uses an AI model to perform its 42/// The prompt that <see cref="TaskAdherenceEvaluator"/> uses has been tested against (and tuned to work well with) 55/// <see cref="TaskAdherenceEvaluator"/>.
TaskAdherenceEvaluatorContext.cs (7)
10/// Contextual information that the <see cref="TaskAdherenceEvaluator"/> uses to evaluate an AI system's 15/// <see cref="TaskAdherenceEvaluator"/> measures how accurately an AI system adheres to the task assigned to it by 21/// Note that at the moment, <see cref="TaskAdherenceEvaluator"/> only supports evaluating calls to tools that are 38/// Note that at the moment, <see cref="TaskAdherenceEvaluator"/> only supports evaluating calls to tools that 57/// Note that at the moment, <see cref="TaskAdherenceEvaluator"/> only supports evaluating calls to tools that 78/// <see cref="TaskAdherenceEvaluator"/> measures how accurately an AI system adheres to the task assigned to it by 84/// Note that at the moment, <see cref="TaskAdherenceEvaluator"/> only supports evaluating calls to tools that are