How can I set cross-reference to activated only on crtl+click?

I’m trying to add cross cross-reference to my document, but sometime when I try to select it (to delete it, for example), i accidentally click on it, sending me to the linked location. Where can i change it so i only follow it if I ctrl+click it? When i search the web, I find only information on how to make cross-refences in the first place, which i already know. I’m currently use the Writer.

The general behaviour for links is in:

Menu/Tools/Options/LibreOffice/Security - Security options and warnings - Options.