Calc unable to open 1.64MB ODS with tons not-so-complex but repeating formulas

I had a “template” that was to be used in music club for scoring of music tracks which was made to handle 999 tracks and so had around 18 columns, around 12 columns for scores. I realized how to make it nearly completely automatic and I have, after which I added rows for like 70k tracks and added colors, after which I started adding columns for more people. I meant to add as many as LO can support, but once I got 60k-70k rows and like 350 columns and managed to save successfully, LO consistently crashes during calculation when opening the file. I’ve tried the 32-bit and 64-bit editions of 5.0.2.1, the only differences being 64-bit loads much faster but also crashes much faster during calculation, simply disappearing from the screen. 32-bit gives me ACCESS VIOLATION popup before disappearing. What to do ?

  • Window$ 7 Ultimate SP1 x64 with Finnish language
  • 8GB RAM, around half in use. LO reaches 244½MB before going down, so there’s 54% RAM in use when that happens
  • AMD A4-5000 APU (quad core) [with Radeon HD 8330], driver version 15.8 Beta
  • LibreOffice 5.0.2.1 32-bit and 64-bit tested, British English GUI
  • ODS file successfully saved, measuring 1.64MB by itself with under 67MB XML file inside

I checked the settings and disabled everything regarding calculation and rebooted LO, which made no difference.

Database not an option.

Since AskLO doesn’t allow attaching a file (at least I don’t see such option), the file is at https://drive.google.com/file/d/0ByxhMpKDhtkMUGFhdTQwLXhiczQ

It’s nearly certain now: AMD A4-5000 APU doesn’t like OpenCL operations much since I disabled OpenCL within LO and can perform operations I couldn’t before, but every single type of calculation is so much slower now.

As much as I’d give more info, my head isn’t figuring what.

What computer processor (i7 Quad Core, i5, etc.) and what speed (2.4GHz, etc.)? Is the processor Intel, AMD, or what? What are graphics processor specs? I ask these questions because this certainly seems as if you are exceeding your resources somewhere.

I’m not quite sure I understand what you mean by “LO reaches 244½MB before going down,” but 8GB is not a lot of RAM (although you indicate only 54% is in use during crash). On the other hand, 24.5 million cells (70k x 350) is a lot of cells.

Do you have any idea what you modified or added during the last session before the crashes started? That might point to an answer.

My laptop has an Intel i7 Quad Core 2.4GHz processor with 16GB of RAM and an NVIDIA GeForce GTX 560M graphics card. I’m running Windows 7 Pro SP-1 64-bit OS (U.S. English). I have LO 5.0.2.2 32-bit loaded.

If you would like to upload the file (or make it available to me privately), I will see if I can open it on my computer. Perhaps that would shed some light.

@LKeithJordan: OP updated; question resolved by APU driver upgrade.

I didn’t quite understand your last response, but I gather you wanted to take me up on my offer. Here is what I have done:

  1. I cleared ALL cells of Direct Formatting.
  2. I deleted all but the first 200 rows.

The changes I have made should allow you to open the spreadsheet and add back what you want rather quickly.

I would strongly suggest you add back in reasonable increments and save to a new file at each step. This way you’ll be able to recover at whatever point the file begins to crash again (hopefully it won’t if you follow my earlier advice about formatting).

The modified file is attached: [C:\fakepath[Template] Levyraati _ Music Club _ Disc Jury(mod 20151004).ods](/upfiles/14439792737734098.ods)

Good luck.

(Please click the check next to my post if you believe my response is the best answer to your question.)


-------------------

After your last update, I downloaded the file and opened it. I was able to easily move from the first cell to the last. I entered scores into the scoring section and watched the totals recalculate. There was a recalculation delay of about 2 seconds, but no other obvious issues.

Given the resources of my computer, the 2 second recalculation delay after adding only a few numbers indicates the massive nature of your initialized spreadsheet. As more data is entered, this recalculation delay will likely grow.

I realize you indicated earlier that a database solution is not an option. However, a solution that only a few can open, or that becomes so slow as to not be viable is not really an option either.

Your problem definitely seems to be one of resources. You didn’t indicate the speed of your AMD chip, but given that it is Quad-Core, I would assume this not to be the issue.

I also didn’t notice any mention of your graphics card. Given the heavy amount of color you have applied to the cells, this could be an area for further investigation. Check for a driver update and also look at the graphics card specs to see if it is up to the task. Try drastically reducing your computer’s screen resolution and see if you can open the file.

Add RAM if possible. Even if this is not the problem, you gain from your investment.

IF YOU WOULD LIKE, I can try to reset the background color in all cells to None, then let you see if you can open the modified spreadsheet. If so, you can still use color, but do so more prudently. For instance, you could color the font rather than the cell. Better yet, you could color the font for the headings ONLY. This still provides visual clues to the user without sucking all the life out of your computer’s resources.

(Please click the check next to my post if you believe my response is the best answer to your question.)


-------------------

There is a lot you haven’t told us about you computer, but I’m guessing you have exceeded the RAM limits, the processor limits, or both.

The first thing I would advise is to reboot your computer and close any programs running in the foreground or background (where possible) before opening the file.

The second thing I would advise is to open LO Calc and make sure that formulas are not being automatically recalculated when you open a spreadsheet file.

The third thing I would advise is to open the file on a computer with more RAM (or add RAM to your computer if that is possible).

The fourth thing I would advise is (and you are going to hate this after all the work you’ve done) stop what you are doing. Spreadsheets are, by their nature, designed to perform a specialized task. They are not, by their nature, specialized graphics applications. They are not, by their nature, specialized database applications.

Where database software allows the programmer some flexibility in deciding computer resource requirements (RAM vs. disk; normalized relational databases vs. flat files, etc.), spreadsheet software affords less such flexibility. Although oversimplified, upon opening a spreadsheet, the spreadsheet software is first loaded into memory, then the spreadsheet data (including your application) is loaded into memory. Once this is done, recalculation, etc. occurs based on your program settings and your spreadsheet file settings.

Depending on the global and file settings, and on the file size, RAM and processor requirements can be significant, even for a spreadsheet file that has no data from your users.

I would suggest you try to design your application using database software, or perhaps even to create your application as a standalone executable.

(Please click the check to the upper left of my post if my answer successfully addresses your question.)

OP updated.

Everything’s in the OP already. Try disabling OpenCL from LO settings, it should result in much slower calculation since the GPU won’t be used to accelerate.

I had no idea a newer APU driver was available, the 15.9.1 Beta, which resolved the issue and made LO (x64) run faster.

However, LO still crashes during somewhat bigger operations, presumably due to OpenCL, which Google implies this APU doesn’t support at all.

Glad it worked out for you.

(Please click the check box next to my original response if you believe it helped you resolve your problem.)