No. As long as one of the borrowers on the loan note lives in the home, continues to pay the taxes and insurance and maintains the home in good condition, you will not need to repay the loan. Once the last surviving borrower passes away or the obligations of the loan are not met, the loan becomes due and must be repaid (either by sale of home or refinance).