ReLU#
ReLU applies following formula on every element of src tensor (the variable names follow the standard Conventions):
\[\begin{split}\dst = \begin{cases} \src & \text{if}\ \src > 0 \\
0 & \text{if}\ \src \leq 0 \end{cases}\end{split}\]
Operation Attributes#
ReLU operation does not support any attribute.
Execution Arguments#
The inputs and outputs must be provided according to the below index order when constructing an operation.
Inputs#
Index |
Argument Name |
Required or Optional |
|---|---|---|
0 |
|
Required |
Outputs#
Index |
Argument Name |
Required or Optional |
|---|---|---|
0 |
|
Required |
Supported Data Types#
ReLU operation supports the following data type combinations.
Src |
Dst |
|---|---|
f32 |
f32 |
bf16 |
bf16 |
f16 |
f16 |