When shooting in portrait orientation (vertical shots), which I recommend to do more often than you are probably currently doing, having a foreground object really helps fill the frame with interest for the viewer. In the above shot made with an iPhone 5, there is a salt marsh and Kiki of course as subject matter, but without the boardwalk in the foreground leading to those other subjects, it would just be empty space of little interest and probably would end up being cropped out.
So when shooting landscape type shots in portrait orientation, try and include a foreground object to add more interest to the photograph overall. Post a link to your results in the comments below!