Depending on how much you've saved, you may have to pay federal taxes on your retirement income. About half of Social Security recipients pay taxes on their benefits, for example, according to data ...