A mortgage expert explained the “hidden cost of loyalty” as being a long-time customer could see your finances suffering ...