Always. Blue grippy ugli gloves. I have a problem with dexterity; a problem dialing the cell phone, that's about all. Otherwise I am less of a climber without them. I depend on the grip, the protection and someone mentioned it earlier, some vibration dampening. My hands just get deeply filthy and beat to crap without them, especially when climbing in the rain.
I've gone to using a size smaller than what I would consider my normal size. This keeps the gloves tighter to the hand and stretches the cotton weave on the topside, giving better ventilation. In a very short while climbing they don't feel small anymore, they feel just right.
At around a dollar a pair I keep a number of pairs floating around, intermixing because I have some weird curse of never being able to find the right-hand glove.