EvSys

Trajectory

One rollout: an ordered list of :class:Turn\s + a scalar reward.

Attributes

attributeturnslist[Turn]
attributerewardfloat
= 0.0
attributemetadatadict[str, Any]
= field(default_factory=dict)

Free-form per-rollout extras. The harbor harvest stamps a "usage" dict here - \{cost_usd, prompt_tokens, completion_tokens, cached_tokens, latency_s\} (any field harbor didn't report is None) - which the eval aggregator turns into the default time_per_task / tokens_per_task / cost_per_task metrics.

Functions

func__init__(self, turns, reward=0.0, metadata=dict()) -> None
paramself
paramturnslist[Turn]
paramrewardfloat
= 0.0
parammetadatadict[str, Any]
= dict()

Returns

None

On this page