My colleagues....how can I just ignore their comments?

You withdraw your limits but not the boundaries,its wise move to you, CONGRATULATION it would be nice to travel for free sky is the limit as saying goes, and after then return to teaching its very rewarding go to your plan you are the master to yourself and have fun goooooooooooo.