torchadf.nn.modules.activation.ReLU

class torchadf.nn.modules.activation.ReLU(mode='diag')

Rectified Linear Unit.

Assumed Density Filtering (ADF) version of the PyTorch ReLU activation. Transforms input means and (co-)variances according to math(x, 0).

Parameters:

mode: {“diag”, “diagonal”, “lowrank”, “half”, “full”}

Covariance computation mode. Default is “diag”.