To remove breakpoints by dragging them from the gutter, press &shortcut:ShowSettings;, go to Build, Execution, Deployment | Debugger and select Drag to the editor or click with middle mouse button.

Clicking a breakpoint will then toggle its status (enabled/disabled).