MishBackward#

MishBackward operation computes gradient for Mish.

where

$$\begin{array}{rl}\omega & =e^{3\text{src}}+4\ast e^{2\text{src}}+e^{\text{src}}\ast (4\ast \text{src}+6)+4\ast (\text{src}+1)\\ \delta & =e^{2\text{src}}+2\ast e^{\text{src}}+2\end{array}$$

Operation Attributes#

MishBackward operation does not support any attribute.

Execution Arguments#

The inputs and outputs must be provided according to the below index order when constructing an operation.

Inputs#

Index	Argument Name	Required or Optional
0	src	Required
1	diff_dst	Required

Outputs#

Index	Argument Name	Required or Optional
0	diff_src	Required

Supported Data Types#

MishBackward operation supports the following data type combinations.

Src	Diff_dst	Diff_src
f32	f32	f32
f16	f16	f16
bf16	bf16	bf16