HardSigmoidBackward#

HardSigmoidBackward operation computes gradient for HardSigmoid. The formula is defined as follows:

diff_src={diff_dstαif 0<αsrc+β<10otherwise 

Operation Attributes#

Attribute

Name

Description

Value Type

Supported

Values

Required or

Optional

alpha

α in the formula.

f32

Arbitrary f32 value

Required

beta

β in the formula.

f32

Arbitrary f32 value

Required

Execution Arguments#

The inputs and outputs must be provided according to the below index order when constructing an operation.

Inputs#

Index

Argument Name

Required or Optional

0

src

Required

1

diff_dst

Required

Outputs#

Index

Argument Name

Required or Optional

0

diff_src

Required

Supported Data Types#

HardSigmoidBackward operation supports the following data type combinations.

Src

Diff_dst

Diff_src

f32

f32

f32

f16

f16

f16

bf16

bf16

bf16