Mountain Lion won't run LibreOffice because it wasn't bought in the app store

Is there any way around this?

Have a look at these sites and see if that is the issue. Gatekeeper was present in Lion, but has different default settings in Mountain Lion.

Workaround is described in this question: "LibreOffice.app (v3.6.2.2) is damaged and can't be opened..."