To delete a connection, select one pin of the connection. When the connection is selected it will have changed colour. To delete, you can press the delete button on your keyboard, select the Delete Connection command from the context menu (right click menu) or select the Delete command from the Edit menu.