Door vinyl spot

I Just detailed my interior using aerospace 303 and everything looks good except now I have noticed a large spot on the black vinyl at the top of the door (see photos in link). I'ts almost like the original finish is worn away in this area and it's now faded; I never noticed it before and I don't think the 303 had anything to do with it but now it's more pronounced. I don't know what it's from, maybe previous owner used to rest his elbow here or something but anyway, looking for some advice on how to restore the spot area to make it look new again like the rest of the door. I've tried spraying the 303 directly on and rubbing it in with my fingers and then wiping off but at soon as it dries, the spot is back. This is bugging me, everthing else looks gorgeous and this faded area kind of stands out now. Anybody got suggestions for what to treat this area with to get rid of the spot? Don't let me resort to Armour All......This is on an '07 335i by the way.

see faded area in photos:

http://www.flickr.com/photos/4685706...57632788360407