On the Shape tab, in the Remove group: Click Delete Point to delete the currently selected point or points. You can also press the Delete key on the keyboard. (Ctrl+D,P)