Buying a second home can be just as stressful, if not more stressful, than buying your primary residence. It is an investment in your family's future quality time together. There are a few things to consider in order to ensure that you are making the best decision for your family, both now and in the future. 1. Location: Where you choose to purchase a vacation home is just as important as how much you spend.