Are you sure about the top-cap on batch size for speed? See https://arxiv.org/pdf/1904.00962