gsnn.models

Modules

gsnn.models.ChannelEMANorm

Channel-wise Exponential Moving Average Normalization.

gsnn.models.GSNN

gsnn.models.GroupBatchNorm

gsnn.models.GroupEMANorm

Group-wise Exponential Moving Average Normalization.

gsnn.models.GroupLayerNorm

Applies 1d layer normalization within each provided channel groups.

gsnn.models.GroupRMSNorm

Group-wise Root Mean Square Layer Normalization.

gsnn.models.NN

gsnn.models.SoftmaxGroupNorm

gsnn.models.SparseLinear

Batched sparse matrix multiplication that scales with GPU's better.

gsnn.models.utils