Consider taking a break
If you are taking oral contraceptives for birth control, stay on them. However, if you are on them for other effects, from irregular periods to acne, consider taking a break from the contraceptives as there may be a nonhormonal way to manage your symptoms that will not raise the risk of breast cancer, or you might have even solved the problem during your time on birth control. Before doing this, speak with your doctor extensively to discuss all options.
If you are not sexually active regularly, you may also decide to take a break from the pill.