EvsysLoggerCallback

Persist EVERYTHING to the evsys dashboard store via callbacks - the experiment/group/run records, per-step metrics, checkpoints, and benchmark evals + predictions. Keyed off the shared ctx.ids it populates (experiment_id → group:\<name> → run_id).

This is the "callbacks own the store" mode: construct Experiment WITHOUT a store= (so the orchestrator makes no store calls) and add this callback instead. If Experiment already has a store (ctx.store set), this callback disables itself to avoid double-writing. The store handle is built lazily from the environment (EvsysStore) unless one is injected (cb._store = ...) - the test seam.

Attributes

attributenamestr

= 'evsys_logger'

attributeConfigtype

= EvsysLoggerConfig

attributeproject_id

= project_id

attributeflush_every

= max(1, int(flush_every))

Functions

func__init__(self, *, project_id=None, flush_every=1) -> None

Source Code

paramself

paramproject_idstr | None

= None

paramflush_everyint

= 1

Returns

None

func_ensure_store(self, ctx) -> Any

Source Code

paramself

paramctxLogContext

Returns

typing.Any

func_id(resp) -> str | None

Source Code

paramrespAny

Returns

str | None

funcon_experiment_start(self, ctx) -> None

Source Code

paramself

paramctxLogContext

Returns

None

funcon_group_start(self, ctx, group_name) -> None

Source Code

paramself

paramctxLogContext

paramgroup_namestr

Returns

None

funcon_run_start(self, ctx) -> None

Source Code

paramself

paramctxLogContext

Returns

None

funcon_benchmark_eval(self, ctx, eval_result, predictions, *, step=None) -> None

Source Code

paramself

paramctx

parameval_result

parampredictions

paramstep

= None

Returns

None

funcon_run_end(self, ctx, run_result, arm) -> None

Source Code

paramself

paramctx

paramrun_result

paramarm

Returns

None

funcon_step_end(self, state, step_idx, batch, metrics) -> None

Source Code

paramself

paramstateLoopState

paramstep_idx

parambatch

parammetrics

Returns

None

funcon_eval(self, state, step_idx, eval_name, metrics) -> None

Source Code

paramself

paramstateLoopState

paramstep_idx

parameval_name

parammetrics

Returns

None

funcon_checkpoint(self, state, row) -> None

Source Code

paramself

paramstateLoopState

paramrow

Returns

None

func_flush(self, ctx) -> None

Source Code

paramself

paramctxLogContext | None

Returns

None