EvSys

LocalLoggerCallback

Human-readable local logging: prints what's happening per step AND persists metrics + benchmark predictions to files under the run dir.

Writes \<output_dir>/\<run_key>/ : metrics.jsonl (train + val rows), predictions/\<name>.jsonl (per benchmark), and summary.md at run end. The "print what's happening" requirement is the per-step one-liner (cadence print_every).

Attributes

attributenamestr
= 'local_logger'
attributeConfigtype
= LocalLoggerConfig
attributeprint_every
= int(print_every)
attributekeys
= keys

Functions

func__init__(self, *, print_every=1, keys=None) -> None
paramself
paramprint_everyint
= 1
paramkeyslist[str] | None
= None

Returns

None
funcon_run_start(self, ctx) -> None
paramself
paramctxLogContext

Returns

None
func_write_metrics(self, step, metrics, split) -> None
paramself
paramstepint
parammetricsdict
paramsplitstr

Returns

None
funcon_step_end(self, state, step_idx, batch, metrics) -> None
paramself
paramstateLoopState
paramstep_idx
parambatch
parammetrics

Returns

None
funcon_eval(self, state, step_idx, eval_name, metrics) -> None
paramself
paramstateLoopState
paramstep_idx
parameval_name
parammetrics

Returns

None
funcon_benchmark_eval(self, ctx, eval_result, predictions, *, step=None) -> None
paramself
paramctx
parameval_result
parampredictions
paramstep
= None

Returns

None
funcon_run_end(self, ctx, run_result, arm) -> None
paramself
paramctx
paramrun_result
paramarm

Returns

None

On this page