I think I'm probably over-paranoid about sanitation sometimes but I plan to stay that way. I'd rather spend a little extra effort on sanitizing stuff than infect a five gallon batch.
The instructions on starsan, for example, say the surface needs to be wet for 1 minute. I guess if you rinse and let it sit it will still be wet after a minute. Me, I like to soak things for at least a couple of minutes, usually more like 10.
Rubber gloves probably aren't necessary but keeping around a spray bottle filled with starsan is a good best practice that a lot of people employ.