The Dilemma: Block or Convolutional?