HPV(genital warts) question?

Is there over the counter stuff for hpv? ive heard that it goes away by itself, ive heard that it can cause cancer. I am a 21 year old male and my GF exposed me to it about 6 months ago, and i get little warts every once in a while that are barely noticable. They do not hurt, but i know they are there. I have been abstinent since i found out i hade this. My question is… is there an over the counter "cure"? will it just go away? or should i go to my doctor(even tho i really dont want to because of embarrasement)?