I've just realised something- I don't think anyone has asked what cotton OP is using!
If you are grabbing cotton balls from your missus make up collection, I always found these had a nasty cotton aftertaste too.
I am using Koh Gen Do organic cotton, you used to be able to buy a pack of 80 Sheets for about a fiver, but for some reason they have shot up in price.
Any brand of natural organic cotton will do, you want the sort that isn't bleached and has a few darker specks here and there, this will not impact the vape.
If not there used to be a brand called cotton bacon, specifically designed for vaping. It comes in a foil sealed bag with about 8 large fat strips of cotton, you just tear it off to size.
It was more expensive than the Koh Gen Do at the time, but I did have some and also didn't notice a cotton taste with this type of cotton.