Obama had a private lunch with Ginsburg in 2013 and treaded cautiously around the subject of her retirement.