Question

what is the benefit of having smaller batch sizes

Answer 1

Reduce Batch Size

Small batches go through the system more quickly and with less variability, which fosters faster learning. The reason for the faster speed is obvious. The reduced variability results from the smaller number of items in the batch