EvSys

TinkerBackend

Implements :class:~evsys_sdk.training.backend.Backend over tinker.

Construct via the :meth:create async factory. Sync method calls (forward_backward_async, optim_step_async, forward_backward_custom_async) return the underlying tinker APIFuture directly so the loop's existing .result_async() awaits work unchanged.

Functions

func__init__(self, *, service_client, training_client, model_name, tokenizer) -> None
paramself
paramservice_clientAny
paramtraining_clientAny
parammodel_namestr
paramtokenizerAny

Returns

None
funccreate(cls, *, model_name, lora_rank=32, renderer_name=None, resume_state_path=None, init_weights_path=None, api_key_env='TINKER_API_KEY', user_metadata=None) -> 'TinkerBackend'

Async factory.

resume_state_path: when provided, the training client is created from that prior state_path with optimizer state (full resume). init_weights_path: load weights only from that prior state path and start a fresh optimizer (used to chain continual-learning stages). When both are None, a fresh LoRA training client is allocated at model_name with lora_rank. resume_state_path wins if both are set.

renderer_name is recorded onto the underlying training client's user metadata so the inference path can read it back from a checkpoint manifest (same convention tinker_cookbook used).

paramcls
parammodel_namestr
paramlora_rankint
= 32
paramrenderer_namestr | None
= None
paramresume_state_pathstr | None
= None
paraminit_weights_pathstr | None
= None
paramapi_key_envstr
= 'TINKER_API_KEY'
paramuser_metadatadict[str, str] | None
= None

Returns

'TinkerBackend'
funcforward_backward_async(self, data, *, loss_fn, loss_fn_config=None) -> Any
paramself
paramdatalist[tinker.Datum]
paramloss_fntinker.types.LossFnType
paramloss_fn_configdict[str, Any] | None
= None

Returns

typing.Any
funcforward_backward_custom_async(self, data, loss_fn) -> Any
paramself
paramdatalist[tinker.Datum]
paramloss_fnLossCallable

Returns

typing.Any
funcoptim_step_async(self, adam) -> Any
paramself
paramadamtinker.AdamParams

Returns

typing.Any
funcsave_for_sampler(self, name) -> str
paramself
paramnamestr

Returns

str
funcsave_full_state(self, name) -> str
paramself
paramnamestr

Returns

str
funcsnapshot_sampling_client(self, name=None) -> TinkerSamplingClient
paramself
paramnamestr | None
= None

Returns

evsys_sdk.training.tinker_backend.TinkerSamplingClient
funcget_tokenizer(self) -> Any
paramself

Returns

typing.Any
func_next_snapshot_label(self) -> str
paramself

Returns

str

On this page