When I have some glue residue -- particularly from stubborn, commerical glued-on labels -- I pull out my secret weapon -- WD40.
It's unbelievably effective -- spray a little on, the glue breaks down and you can wipe it clean -- no elbow grease required! I try to ensure none gets INSIDE the bottle, but either way I do an extra good job on any bottle cleaned this way when I rinse it out. I also tend to put those bottles in the dishwasher, upright on the tines.
I also realized that it's safer to go ahead and bottle the wine in these less-than-perfect bottles, then use WD40 on them after they're full and corked -- no chance of getting any inside! I will do this on occasion, wipe them clean and relabel.