EvSys

HarborTaskAdapter

Adapt our HarborTask rows (the harbor_task / RL + eval format) to harbor task dirs + native TaskConfig\s - scored rollouts.

to_harbor(output_dir) writes one task dir per task (instruction.md + a SHARED-mode task.toml + a dummy tests/test.sh that only satisfies harbor's load check + the per-task evsys_verifier.json spec our host-side :class:~evsys_sdk.training.harbor_agents.EvsysVerifier reads) and returns the TaskConfig\s pointing at them. Requires an InProcessVerifier. Used by run_harbor_rollouts(..., outcome_reward=True) (RL + benchmark eval).

Functions

func__init__(self, tasks) -> None
paramself
paramtasksSequence[HarborTask]

Returns

None
functo_harbor(self, output_dir) -> list[Any]
paramself
paramoutput_dirPath

Returns

list[typing.Any]

On this page