EvSys

MockSamplingClient

In-memory SamplingClient for tests.

Returns canned[i % len(canned)] per call to sample_async. Tests that need fancy behavior can subclass; the default is enough to exercise the loop's eval slot.

Attributes

attributecanned
= canned or ['']
attributename
= name
attributemodel_pathstr | None
= None
attributesample_callslist[dict]
= []
attributelogprob_callslist[tinker.ModelInput]
= []

Functions

func__init__(self, *, canned=None, name='mock') -> None
paramself
paramcannedlist[str] | None
= None
paramnamestr
= 'mock'

Returns

None
funcsample_async(self, *, prompt, params, num_samples=1, include_prompt_logprobs=False, topk_prompt_logprobs=0) -> Any
paramself
paramprompttinker.ModelInput
paramparamstinker.SamplingParams
paramnum_samplesint
= 1
paraminclude_prompt_logprobsbool
= False
paramtopk_prompt_logprobsint
= 0

Returns

typing.Any
funccompute_logprobs_async(self, prompt) -> list[float | None]
paramself
paramprompttinker.ModelInput

Returns

list[float | None]

On this page