Despite what Booth had heard earlier in the day, Grant and his wife, Julia Grant, had declined to accompany the Lincolns, as Mary Lincoln and Julia Grant were not on good terms. Others in succession also declined the Lincolns' invitation, until finally Major Henry Rathbone and his fiancée Clara Harris (daughter of U.S. Senator Ira Harris of New York) accepted. At one point, Mary developed a headache and was inclined to stay home, but Lincoln told her he must attend because newspapers had announced that he would. William H. Crook, one of Lincoln's bodyguards, advised him not to go, but Lincoln said he had promised his wife. Lincoln told Speaker of the House Schuyler Colfax, "I suppose it's time to go though I would rather stay" before assisting Mary into the carriage.