Burst Mode on DSP and AIP

• This mode achieves the fastest inference time on DSP and AIP runtimes, at the expense of increased power consumption over high performance mode.

• This mode activates two performance-boosting features:

  1. Keeps the CPUs from entering deepest sleep state while an inference is running. If inference takes longer than 100ms, the CPUs can enter deepest sleep state.

  2. Keeps Qualcomm® Neural Processing SDK DSP performance vote high in between inferences. Instead of reducing the Qualcomm® Neural Processing SDK DSP performance vote after each inference, this mode waits for 300ms after the last inference completion before reducing the Qualcomm® Neural Processing SDK DSP performance vote. Additionally, this wait time is configurable using platform options. For example: if user needs to set wait time as 10ms, then user should set platform option as “inactivityTimeout:10000”. (Please see Platform Options API for more info.)

• Relative power impact of above modes depends on the device itself.