Worries that the Fed's rate rises may have further to go than expected damp sentiment.