Search results

getting eval_metric_results_with_invocations using pytest

bot triaged[Bot] This issue is triaged by ADK bot[Bot] This issue is triaged by ADK bot

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open.

#2760 In google/adk-python;

· gbox32 opened on Aug 27, 2025

Evals: don't compare args using tool trajectory

bot triaged[Bot] This issue is triaged by ADK bot[Bot] This issue is triaged by ADK bot

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open.

Feature

#2757 In google/adk-python;

· mattmcc-attest opened on Aug 27, 2025

In-Conversation Evals

bot triaged[Bot] This issue is triaged by ADK bot[Bot] This issue is triaged by ADK bot

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open.

Feature

#2746 In google/adk-python;

· tiaaburton opened on Aug 26, 2025

during run evaluation of a test case inferences could be NoneType which has no len attribute and error is not caught

bot triaged[Bot] This issue is triaged by ADK bot[Bot] This issue is triaged by ADK bot

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open.

Bug

#2729 In google/adk-python;

· ShaharKatz opened on Aug 26, 2025

AgentEvaluator - save eval results to a csv

bot triaged[Bot] This issue is triaged by ADK bot[Bot] This issue is triaged by ADK bot

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open.

Feature

#2652 In google/adk-python;

· vtwoptwo opened on Aug 21, 2025

Running eval through pytest is not saving evalset_result.json file

bot triaged[Bot] This issue is triaged by ADK bot[Bot] This issue is triaged by ADK bot

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open.

Bug

#2602 In google/adk-python;

· CloudIQTechnologies opened on Aug 19, 2025

fix typo

bot triaged[Bot] This issue is triaged by ADK bot[Bot] This issue is triaged by ADK bot

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open (in progress).

google/adk-pythonnumber 2586

#2586 In google/adk-python;

· FingerLiu opened on Aug 18, 2025

fix(evals): fix add session to eval set list index out of range error

bot triaged[Bot] This issue is triaged by ADK bot[Bot] This issue is triaged by ADK bot

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open (in progress).

google/adk-pythonnumber 2347

#2347 In google/adk-python;

· growmuye opened on Aug 5, 2025

TrajectoryEvaluator fails with dynamic authentication tokens in OpenAPIToolset

bot triaged[Bot] This issue is triaged by ADK bot[Bot] This issue is triaged by ADK bot

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open.

Bug

#2083 In google/adk-python;

· sedghi opened on Jul 21, 2025

· 

08/11 FixIt Week

Make evaluation compatible with artifacts

bot triaged[Bot] This issue is triaged by ADK bot[Bot] This issue is triaged by ADK bot

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open.

Feature

#2075 In google/adk-python;

· smcjones opened on Jul 21, 2025

Getting Import error in vertexai package on AgentEvaluator run

bot triaged[Bot] This issue is triaged by ADK bot[Bot] This issue is triaged by ADK bot

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open.

#1946 In google/adk-python;

· raghul-velt opened on Jul 14, 2025

· 

08/11 FixIt Week

Record tool_responses in IntermediateData

bot triaged[Bot] This issue is triaged by ADK bot[Bot] This issue is triaged by ADK bot

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open.

#1812 In google/adk-python;

· sandangel opened on Jul 7, 2025