The settings for each of the iconic view styles (Icons, Tiles, Thumbnails) exposes an 'Alignment' property, which determines whether the items are laid out from left to right or top to bottom.
Example:
this.ultraListView1.ViewSettingsIcons.Alignment = ItemAlignment.TopToBottom;
For the 'List' view, the only way to get a vertical scrollbar is to set the MultiColumn property to false.