... breast removed and then had the left breast removed 6 months later. I go to the gym 3 times a week and am very active physically. Over the past 2 years I lost 42 lbs and was able to keep it off until taking 6 months ago while taking Vagifem. Is anyone else experiencing this?, and what can I do. I still eat healthy and go to the gym 3 days a week. The weight just comes on over night I weigh myself in the morning and I'm shocked to see that some morning I will have gained 3,4,5, or 6lbs. Some mornings I will have lost 1 or 2lbs. Help!