TinkerSamplingClient

Wrap a tinker.SamplingClient to satisfy the :class:~evsys_sdk.training.backend.SamplingClient Protocol shape.

Same name + same async method signatures as the Protocol, plus a raw attribute for callers that want the underlying tinker client.

Attributes

attributeraw

= raw

attributename

= name

attributemodel_pathstr | None

= None

func__init__(self, raw, *, name='tinker') -> None

paramself

paramrawAny

paramnamestr

= 'tinker'

Returns

None

funcsample_async(self, *, prompt, params, num_samples=1, include_prompt_logprobs=False, topk_prompt_logprobs=0) -> Any

paramself

paramprompttinker.ModelInput

paramparamstinker.SamplingParams

paramnum_samplesint

= 1

paraminclude_prompt_logprobsbool

= False

paramtopk_prompt_logprobsint

= 0

Returns

typing.Any

funccompute_logprobs_async(self, prompt) -> list[float | None]

paramself

paramprompttinker.ModelInput

Returns

list[float | None]