The doctor’s lawyers claim Oliver made ‘false accusations’ that ‘were designed to spark outrage.’