Descriptor for a layer normalization backward propagation primitive. More...
#include <dnnl.hpp>
Public Member Functions | |
desc (prop_kind prop_kind, const memory::desc &diff_data_desc, const memory::desc &data_desc, const memory::desc &stat_desc, float epsilon, normalization_flags flags) | |
Constructs a descriptor for layer normalization backward propagation primitive. More... | |
desc (prop_kind prop_kind, const memory::desc &diff_data_desc, const memory::desc &data_desc, float epsilon, normalization_flags flags) | |
Constructs a descriptor for layer normalization backward propagation primitive. More... | |
Descriptor for a layer normalization backward propagation primitive.
|
inline |
Constructs a descriptor for layer normalization backward propagation primitive.
Inputs:
src
(dnnl::primitive_desc_base::src_desc(0
))mean
(dnnl::primitive_desc_base::src_desc(1
))variance
(dnnl::primitive_desc_base::src_desc(2
))diff_dst
(dnnl::primitive_desc_base::diff_dst_desc(0
))scale_and_shift
(dnnl::primitive_desc_base::weights_desc(0
)), if dnnl::normalization_flags::use_scale_shift bit-flag is set in flags
Outputs:
diff_src
(dnnl::primitive_desc_base::diff_src_desc(0
))diff_scale_and_shift
(dnnl::primitive_desc_base::diff_weights_desc(0
)), if dnnl::normalization_flags::use_scale_shift bit-flag is set in flags
and prop_kind
= dnnl::prop_kind::backwardprop_kind | Propagation kind. Possible values are dnnl::prop_kind::backward_data and dnnl::prop_kind::backward (diffs for all parameters are computed in this case). |
diff_data_desc | Diff source and diff destination memory descriptor. |
data_desc | Source memory descriptor. |
stat_desc | Statistics memory descriptors. |
epsilon | Layer normalization epsilon parameter. |
flags | Layer normalization flags (dnnl::normalization_flags). |
|
inline |
Constructs a descriptor for layer normalization backward propagation primitive.
Inputs:
src
(dnnl::primitive_desc_base::src_desc(0
))mean
(dnnl::primitive_desc_base::src_desc(1
))variance
(dnnl::primitive_desc_base::src_desc(2
))diff_dst
(dnnl::primitive_desc_base::diff_dst_desc(0
))scale_and_shift
(dnnl::primitive_desc_base::weights_desc(0
)), if dnnl::normalization_flags::use_scale_shift bit-flag is set in flags
Outputs:
diff_src
(dnnl::primitive_desc_base::diff_src_desc(0
))diff_scale_and_shift
(dnnl::primitive_desc_base::diff_weights_desc(0
)), if dnnl::normalization_flags::use_scale_shift bit-flag is set in flags
and prop_kind
= dnnl::prop_kind::backwardprop_kind | Propagation kind. Possible values are dnnl::prop_kind::backward_data and dnnl::prop_kind::backward (diffs for all parameters are computed in this case). |
diff_data_desc | Diff source and diff destination memory descriptor. |
data_desc | Source memory descriptor. |
epsilon | Layer normalization epsilon parameter. |
flags | Layer normalization flags (dnnl::normalization_flags). |