I struggled for hours, but then guessed right: To make each of footer widgets 1-4 to go away, I dragged one text widget onto each footer widget 1,2,3,4 area, and left the text widget blank. That replaced the four default widgets in those areas so they did not show any more, as desired. Doing that, that whole widgets 1-4 area was removed.
.
