ReLUBackprop#

Versioned name: ReLUBackprop-1

Category: Activation

Short description: Reference

Detailed description: Reference

Attributes:* use_dst

  • Description: If true, use dst to calculate gradient; else use src.

  • Range of values: True or False

  • Type: bool

  • Default value: True

  • Required: no

Inputs:

  • 1: result_forward/ input_forward - if use_dst is true, result_forward is used, else input_forward is used. Required.

    • Type: T

  • 2: output_delta - the gradient tensor with respect to the output. Required.

    • Type: T

Outputs

  • 1: input_delta - the gradient tensor with respect to the input of ReLU.

    • Type: T

Types:

  • T: f32, f16, bf16.

  • Note: Inputs and outputs have the same data type denoted by T. For example, if input is f32 tensor, then all other tensors have f32 data type.