GELUBackpropΒΆ

Versioned name: GELUBackprop-2

Category: Activation

Short description: GELUBackprop computes gradient for GELU

Inputs:

  • 1: input_forward - input of forward. Required.

  • 2: output_delta - gradients tensor w.r.t. the output. Required.

Outputs

  • 1: input_delta - the gradient tensor w.r.t. the input of GELU.