SoftPlusBackward#
SoftPlusBackward operation computes gradient for SoftPlus.
Operation Attributes#
|
Description |
Value Type |
|
|
---|---|---|---|---|
Value for the SoftPlus formulation. |
s64 |
Arbitrary
s64 value
( |
Optional |
Execution Arguments#
The inputs and outputs must be provided according to the below index order when constructing an operation.
Inputs#
Index |
Argument Name |
Required or Optional |
---|---|---|
0 |
|
Required |
1 |
|
Required |
Outputs#
Index |
Argument Name |
Required or Optional |
---|---|---|
0 |
|
Required |
Supported Data Types#
SoftPlusBackward operation supports the following data type combinations.
Src |
Diff_dst |
Diff_src |
---|---|---|
f32 |
f32 |
f32 |
bf16 |
bf16 |
bf16 |
f16 |
f16 |
f16 |