I drive with the top up on long freeway trips. Originally, as Gordon said, there was a lot of buffeting from air trapped in the back. That went away when I added a zipper to the rear window.
I have wide-angle mirrors on both sides.
I am about 6' tall. I am not particularly uncomfortable driving with the top up.