InferenceClient
Generate text given a prompt. Used by evaluators and RL rollouts.
Attributes
attributenamestrFunctions
funcgenerate(self, *, prompt, max_tokens=256, temperature=0.0, stop=None) -> strparamselfparampromptstrparammax_tokensint= 256paramtemperaturefloat= 0.0paramstoplist[str] | None= NoneReturns
str