The types of neural network optimizations are weight pruning, structured pruning, convolution, fully-connected, structured group, structure ranking with activations like Lp norm, block pruning, model thinning, compression schedule, regularization, group lasso, group variance, quantization and others
