Struct QnnHtpGraph_CustomConfig_t

Struct Documentation

struct QnnHtpGraph_CustomConfig_t

Structure describing the set of configurations supported by graph. Objects of this type are to be referenced through QnnGraph_CustomConfig_t.

The struct has two fields - option and a union of corresponding config values Based on the option corresponding item in the union can be used to specify config.

Below is the Map between QnnHtpGraph_ConfigOption_t and config value

+—-+————————————————————————————-+————————————————+ | 2 | QNN_HTP_GRAPH_CONFIG_OPTION_PRECISION | Qnn_Precision_t | +—-+————————————————————————————-+————————————————+ | 3 |
QNN_HTP_GRAPH_CONFIG_OPTION_VTCM_SIZE_IN_MB/QNN_HTP_GRAPH_CONFIG_OPTION_VTCM_SIZE | uint32_t |
8 | QNN_HTP_GRAPH_CONFIG_OPTION_NUM_CORES | uint32_t |
QnnHtpGraph_ParallelGraphExecutionConfig_t |
reserved for internal purposes |

NOTE: Option #6 (i.e. QNN_HTP_GRAPH_CONFIG_OPTION_NUM_HVX_THREADS), can only be set prior to the first execution of the graph. Proceeding executions will not use the updated value if user does change it after the first execution.

Public Members

QnnHtpGraph_ConfigOption_t option
QnnHtpGraph_OptimizationOption_t optimizationOption
Qnn_Precision_t precision
uint32_t vtcmSizeInMB
bool foldReluActivationIntoConvOff
bool shortDepthConvOnHmxOff
uint64_t numHvxThreads
void *reserved
QnnHtpGraph_FinalizeConfig_t finalizeConfig
uint32_t numCores
QnnHtpGraph_ParallelGraphExecutionConfig_t parallelGraphExecutionConfig
uint32_t vtcmSizeInBytes
QnnHtp_HmxBoundingInfo_t hmxBoundingInfo
bool weightsPacking
bool assumeSameQuant
bool shareIOBuffer
union QnnHtpGraph_CustomConfig_t::[anonymous] [anonymous]