You have to highlight the entry you wish to delete (either by hovering over it or using the arrow keys) and then press the Delete (or DEL) key to delete the entry.
Fun fact: This also works in Firefox for the search box, URL bar, and form auto fill drop downs!