Is there any way around this?
Have a look at these sites and see if that is the issue. Gatekeeper was present in Lion, but has different default settings in Mountain Lion.
Workaround is described in this question: "LibreOffice.app (v3.6.2.2) is damaged and can't be opened..."