The stock market and the U.S. dollar are retreating side by side, and history, while limited, suggests investors should stay on their toes.