An appeals court judge said the Ponzi schemer, who says he is dying of cancer, "was never truly remorseful.”