Worries over inflation and interest rates returned to haunt Wall Street