1 instantiation of ToolCallAccuracyEvaluator
Microsoft.Extensions.AI.Evaluation.Integration.Tests (1)
AgentQualityEvaluatorTests.cs (1)
62IEvaluator toolCallAccuracyEvaluator = new ToolCallAccuracyEvaluator();
15 references to ToolCallAccuracyEvaluator
Microsoft.Extensions.AI.Evaluation.Integration.Tests (2)
AgentQualityEvaluatorTests.cs (2)
159Assert.True(result.TryGet(ToolCallAccuracyEvaluator.ToolCallAccuracyMetricName, out BooleanMetric? _)); 199Assert.True(result.TryGet(ToolCallAccuracyEvaluator.ToolCallAccuracyMetricName, out BooleanMetric? _));
Microsoft.Extensions.AI.Evaluation.Quality (13)
ToolCallAccuracyEvaluator.cs (6)
20/// <see cref="ToolCallAccuracyEvaluator"/> measures how accurately an AI system uses tools by examining tool calls 27/// Note that at the moment, <see cref="ToolCallAccuracyEvaluator"/> only supports evaluating calls to tools that are 32/// <see cref="ToolCallAccuracyEvaluator"/> returns a <see cref="BooleanMetric"/> that contains a score for 'Tool Call 38/// <b>Note:</b> <see cref="ToolCallAccuracyEvaluator"/> is an AI-based evaluator that uses an AI model to perform its 44/// The prompt that <see cref="ToolCallAccuracyEvaluator"/> uses has been tested against (and tuned to work well with) 57/// <see cref="ToolCallAccuracyEvaluator"/>.
ToolCallAccuracyEvaluatorContext.cs (7)
10/// Contextual information that the <see cref="ToolCallAccuracyEvaluator"/> uses to evaluate an AI system's 15/// <see cref="ToolCallAccuracyEvaluator"/> measures how accurately an AI system uses tools by examining tool calls 22/// Note that at the moment, <see cref="ToolCallAccuracyEvaluator"/> only supports evaluating calls to tools that are 39/// Note that at the moment, <see cref="ToolCallAccuracyEvaluator"/> only supports evaluating calls to tools that 58/// Note that at the moment, <see cref="ToolCallAccuracyEvaluator"/> only supports evaluating calls to tools that 79/// <see cref="ToolCallAccuracyEvaluator"/> measures how accurately an AI system uses tools by examining tool calls 86/// Note that at the moment, <see cref="ToolCallAccuracyEvaluator"/> only supports evaluating calls to tools that