"It would hurt consumers, and we'd have to think about what we'd have to do about that, but that's really the last of our concerns right now," said the head of the White House Economic Council