After Lorne Michaels said he plans on shaking up the "Saturday Night Live" lineup for Season 51, several cast members have announced they will not be returning to the sketch comedy show.