As you re-fi you must state its your primary residence.
If you get another mortgage with say, 1-2 months, you may experience some pain. The mortgage company you are working with to re-fi will know that you have turned your residence into a investment IE different insurance policy for their review.
Speak with a re-fi agent about moving it to an investment property. You may be surprised what they can do. You can certainly explain away why you stated a home as a primary residence and then changed the game plan, but not with a month or two.
If you re-fi I would also suggest you do so before the job change. 1-2 month in a new job may spook the re-fi underwriters.
Starting Score: 636