Struct QnnHtpGraph_CustomConfig_t

Struct Documentation

struct QnnHtpGraph_CustomConfig_t

Structure describing the set of configurations supported by graph. Objects of this type are to be referenced through QnnGraph_CustomConfig_t.

The struct has two fields - option and a union of corresponding config values Based on the option corresponding item in the union can be used to specify config.

Below is the Map between QnnHtpGraph_ConfigOption_t and config value

#

Config Option

Configuration Struct/value

1

QNN_HTP_GRAPH_CONFIG_OPTION_OPTIMIZATION

QnnHtpGraph_OptimizationOption_t

2

QNN_HTP_GRAPH_CONFIG_OPTION_PRECISION

Qnn_Precision_t

3

QNN_HTP_GRAPH_CONFIG_OPTION_VTCM_SIZE_IN_MB/QNN_HTP_GRAPH_CONFIG_OPTION_VTCM_SIZE

uint32_t

4

QNN_HTP_GRAPH_CONFIG_OPTION_FOLD_RELU_ACTIVATION_INTO_CONV_OFF

bool

5

QNN_HTP_GRAPH_CONFIG_OPTION_SHORT_DEPTH_CONV_ON_HMX_OFF

bool

6

QNN_HTP_GRAPH_CONFIG_OPTION_NUM_HVX_THREADS

uint32_t

7

QNN_HTP_GRAPH_CONFIG_OPTION_FINALIZE_CONFIG

QnnHtpGraph_FinalizeConfig_t

12

QNN_HTP_GRAPH_CONFIG_OPTION_WEIGHTS_PACKING

bool

13

QNN_HTP_GRAPH_CONFIG_OPTION_ASSUME_SAME_QUANT

bool

0x7fff0000 - 0x7ffffffe

QNN_HTP_GRAPH_CONFIG_OPTION_RESERVED

These are reserved for internal purposes

NOTE: Option #6 (i.e. QNN_HTP_GRAPH_CONFIG_OPTION_NUM_HVX_THREADS), can only be set prior to the first execution of the graph. Proceeding executions will not use the updated value if user does change it after the first execution.

Public Members

QnnHtpGraph_ConfigOption_t option
QnnHtpGraph_OptimizationOption_t optimizationOption
Qnn_Precision_t precision
uint32_t vtcmSizeInMB
bool foldReluActivationIntoConvOff
bool shortDepthConvOnHmxOff
uint64_t numHvxThreads
void *reserved
QnnHtpGraph_FinalizeConfig_t finalizeConfig
bool weightsPacking
bool assumeSameQuant
union QnnHtpGraph_CustomConfig_t::[anonymous] [anonymous]