If the Social Security trust fund were depleted, the number of beneficiaries living in poverty would increase by more than 50 percent, and people of color and those with lower incomes would be most affected.