SoftPlus#

SoftPlus operation applies following formula on every element of src tensor (the variable names follow the standard Conventions):

\[\dst = 1 / \operatorname{beta} \* \ln(e^{\operatorname{beta}*\src} + 1.0)\]

Operation Attributes#

Attribute

Name

Description

Value Type
Supported

Values
Required or

Optional

beta

Value for the SoftPlus formulation.

s64

Arbitrary s64 value (1 in default)

Optional

Execution Arguments#

The inputs and outputs must be provided according to the below index order when constructing an operation.

Inputs#

Index

Argument Name

Required or Optional

0

src

Required

Outputs#

Index

Argument Name

Required or Optional

0

dst

Required

Supported Data Types#

SoftPlus operation supports the following data type combinations.

Src

Dst

f32

f32

bf16

bf16

f16

f16