You can remove the connection using the mouse or trackpad but it means clicking on the line and then going to the Edit menu to choose Delete there. For some reason, that doesn't feel any quicker.