Skip to main content

Function: channelActivationDerivativeFromOutput()

channelActivationDerivativeFromOutput(aNode, activation): any

da/dz, expressed in terms of the already-computed activated output a (cheaper than recomputing exp/tanh from z) - used by the GPU training kernel's hand-written backward pass to convert an output-space loss delta (a - target) into the pre-activation delta (dL/dz) the rest of the backward pass expects.

Parameters​

aNode​

any

activation​

NTCActivation

Returns​

any