Use mini-batch when working with neural networks and in particular with mini-batch stochastic gradient descent.
