You should bring some with you and be prepared to shop around. I never tried when I was in the inaka, but I know many who drove to the nearest (but not too near) big city, visited a recommended/foreign friendly clinic (yay google). You may have to go to a couple different clinics, or even travel a fair distance, but I know many who were successful. I also know many who had bad experiences.
There are two things you will need to keep in mine. If you need the pills for health reasons, you will need to visit the clinic every month, and only be able to get one month at a time. It will be covered by insurance. If you are taking the pills for other purposes, you will not need to visit more than a few times a year for a physical, and you will be able to get (usually) three months at a time. It will not be covered by insurance, but shouldn't cost much more than under insurance with check ups included. Also depending on the policy of the clinic you may not even need to meet with the doctor when you pick up a refill.