The 80-year-old New Jersey Democrat said it is “time to pass the torch.”