Press Delete or Backspace.
Choose Delete Selected Effect or Delete All Effects From Clip from the Effect Controls panel menu.