Impress COLRv1 breaks PDF export

Problem
I use a COLRv1 Font Named Nabla https://nabla.typearture.com/
When ever I export to PDF the Text written in Nabla some times looses it’s colour and sometimes it doesn’t.

Test File

Additional Context
The Impress File does embed the Nabla Font within the PDF.

For some Reason, if I set the PDF export to PDF/A-1b it sometimes works. But that 10x the File Size. I currently have a 20MB PDF. Compressing it down makes everything look horrible.

Question
Is there a solution, that I’m missing?
All I want is be able to export as PDF and get a sharp PDF with a reasonable Filesize.
Is that even technically possible?
Do I have to switch to another Font?