Skip to content

[Bug]: Evaluation task output not reflected in project traces or experiment results, but appears in project spans #3147

@benseoww

Description

@benseoww

What component(s) are affected?

  • Opik Python SDK
  • Opik Typescript SDK
  • Opik Agent Optimizer SDK
  • Opik UI
  • Opik Server
  • Documentation

Opik version

  • Opik version: 1.7.42

Describe the problem

Running an experiment using Github Action, Typescript SDK. In the Experiment view, Evaluation Task durations and metric scores are seen on the UI, but the task object output is not found.

In Project > Span, the llm_task object could be found, yet in its corresponding trace in Project > Trace, the output cannot be found.

This issue only appears when evaluation function is called from a Github Action. All outputs can be seen if experiment is ran locally (calling the same function)

Project Span UI
Image

Project Trace UI
Image

Reproduction steps and code snippets

No response

Error logs or stack trace

No response

Healthcheck results

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions