Former U.S. Treasury Secretary Larry Summers abruptly went on leave Wednesday from teaching at Harvard University.