MishBackward#

MishBackward operation computes gradient for Mish.

Misplaced &

where

ω=e3src+4e2src+esrc(4src+6)+4(src+1)δ=e2src+2esrc+2

Operation Attributes#

MishBackward operation does not support any attribute.

Execution Arguments#

The inputs and outputs must be provided according to the below index order when constructing an operation.

Inputs#

Index

Argument Name

Required or Optional

0

src

Required

1

diff_dst

Required

Outputs#

Index

Argument Name

Required or Optional

0

diff_src

Required

Supported Data Types#

MishBackward operation supports the following data type combinations.

Src

Diff_dst

Diff_src

f32

f32

f32

f16

f16

f16

bf16

bf16

bf16