File QnnAipBackend.h¶
↰ Parent directory (include/QNN/AIP)
QNN AIP component Backend API.
Contents
Definition (include/QNN/AIP/QnnAipBackend.h)¶
Detailed Description¶
The interfaces in this file work with the top level QNN API and supplements QnnBackend.h for AIP backend
Includes¶
QnnBackend.h(File QnnBackend.h)
Full File Listing¶
QNN AIP component Backend API.
The interfaces in this file work with the top level QNN
API and supplements QnnBackend.h for AIP backend
Defines
-
QNN_AIP_BACKEND_CUSTOM_CONFIG_INIT { \
QNN_AIP_BACKEND_CONFIG_OPTION_UNKNOWN
, /*option*/ \
{ \
false /*foldReluActivationIntoConvOff*/ \
} \
}
QnnAipBackend_CustomConfig_t initializer macro.
Typedefs
-
typedef struct QnnAipBackend_CustomConfig QnnAipBackend_CustomConfig_t¶
Structure describing the set of configurations supported by the backend. Objects of this type are to be referenced through QnnBackend_CustomConfig_t.
Enums
-
enum QnnAipBackend_ConfigOption_t¶
Values:
-
enumerator QNN_AIP_BACKEND_CONFIG_OPTION_FOLD_RELU_ACTIVATION_INTO_CONV_OFF = 0¶
The accelerator will always attempt to fold relu activation into the immediate preceding convolution operation. This optimization is correct when quantization ranges for convolution are equal or subset of the Relu operation. For graphs, where this cannot be guaranteed, the client should set this option to true
-
enumerator QNN_AIP_BACKEND_CONFIG_OPTION_SHORT_DEPTH_CONV_ON_HMX_OFF = 1¶
The accelerator will always attempt to all Convolution operation using HMX instructions. Convolution that have short depth and/or weights that are not symmetric could exhibit inaccurate results. In such cases, clients must set this option to true to guarantee correctness of the operation
-
enumerator QNN_AIP_BACKEND_CONFIG_OPTION_USE_SIGNED_PROCESS_DOMAIN = 2¶
Every APP side user process that uses a DSP via FastRPC has a corresponding dynamic user process domain on the DSP side. QNN by default opens RPC session as unsigned PD, in case this option is set to true, RPC session will be opened as signed PD (requires signed .so).
-
enumerator QNN_AIP_BACKEND_CONFIG_OPTION_ARCH = 3¶
set QnnAipBackend_DspArch_t for offline prepare mode
-
enumerator QNN_AIP_BACKEND_CONFIG_OPTION_UNKNOWN = 0x7fffffff¶
UNKNOWN enum option that must not be used.
-
enumerator QNN_AIP_BACKEND_CONFIG_OPTION_FOLD_RELU_ACTIVATION_INTO_CONV_OFF = 0¶
-
enum QnnAipBackend_DspArch_t¶
Values:
-
enumerator QNN_AIP_BACKEND_DSP_ARCH_NONE = 0¶
-
enumerator QNN_AIP_BACKEND_DSP_ARCH_V66 = 66¶
-
enumerator QNN_AIP_BACKEND_DSP_ARCH_V68 = 68¶
-
enumerator QNN_AIP_BACKEND_DSP_ARCH_V69 = 69¶
-
enumerator QNN_AIP_BACKEND_DSP_ARCH_V73 = 73¶
-
enumerator QNN_AIP_BACKEND_DSP_ARCH_UNKNOWN = 0x7fffffff¶
-
enumerator QNN_AIP_BACKEND_DSP_ARCH_NONE = 0¶
-
struct QnnAipBackend_CustomConfig¶
- #include <QnnAipBackend.h>
Structure describing the set of configurations supported by the backend. Objects of this type are to be referenced through QnnBackend_CustomConfig_t.
Public Members
-
union unnamed
- #include <QnnAipBackend.h>
Public Members
-
bool foldReluActivationIntoConvOff
-
bool shortDepthConvOnHmxOff
-
bool useSignedProcessDomain
-
bool foldReluActivationIntoConvOff
-
union unnamed