Select the column you would like to remove and drag it off the column section.
You will notice the column disappears once dragged off and released.