Typedef GenieSampler_ProcessCallback_t¶
Defined in File GenieSampler.h
Typedef Documentation¶
-
typedef void (*GenieSampler_ProcessCallback_t)(const uint32_t logitsSize, const void *logits, const uint32_t numTokens, int32_t *tokens)¶
A client-defined callback function to set sampler process implementation.
- Param logitsSize
[in] Size of output logits in logits array
- Param logits
[in] Output logits from engine execution
- Param numTokens
[in] Number of tokens to be returned.
- Param tokens
[out] pointer to array of tokens based on numTokens argument passed in input
Note
This typedef will soon be deprecated in favor of GenieSampler_ProcessCallback_t.