Okay, so...the big armor question...
Think of it this way...upgrades are much nicer to work with and will increase the prot and def on all clothes/armor.
With clothes, you are able to use/wear accessories while armor you cannot.
Consider whether you use accessories or not and if the look of your character really means something to you.