Investors should worry when the Fed stops raising or cuts rates.

Image: Goldman Sachs Global Investment Research