Ask Your Question
1

Large CSV import crashes Base [closed]

asked 2012-12-10 15:47:01 +0200

NewbyDB gravatar image

updated 2016-02-18 17:17:54 +0200

Alex Kemp gravatar image

Hello, I am new to LO. I have a large spreadsheet (90K rows, 30 columns) which includes long data strings in one column. It opens in Calc, but I cannot import the data into Base. When I try to, I get the following error:

Runtime Error!

Program: C:.....\soffice.bin

This application has requested the Runtime to terminate it in an unusual way. Please contact the application's support team for more information.

LO then crashes and has to recover the Calc and Base files before proceeding (recovery has not caused issues).

I can import the column headers and the first 100 or so rows (haven't tried to see how far down I can import), but cannot import the entire dataset. Same is true if I delete the column with the long data strings.

To import, I am copying all of the data in Calc, pressing the "Table" button in Base, and selecting Edit / Paste.

Is there anything I need to be doing to be able to import all of the data in my spreadsheet into Base?

Thanks in advance!

-Sam

edit retag flag offensive reopen merge delete

Closed for the following reason the question is answered, right answer was accepted by Alex Kemp
close date 2016-02-18 17:17:22.461771

2 Answers

Sort by » oldest newest most voted
1

answered 2012-12-10 16:40:12 +0200

m.a.riosv gravatar image

Have you tried to open CSV in Base?

Menu/File/New/Database Connect to an existing database Select: Text and follow the wizard.

edit flag offensive delete link more
0

answered 2014-01-18 19:31:58 +0200

Alex Thurgood gravatar image

That is a large data file to try and import into Base. You will have performance issues with 90K tuplets in an embedded hsqldb ODB file. Just imagine how big the array is, that you are asking LO to parse for you and insert into your table.

Either split up your CSV file into smaller, manageable chunks, or else look up the hsqldb documentation about accessing TEXT TABLES directly from the SQL command line. You can issues SQL commands from within your ODB file once it is opened in LO via the TOOLS > SQL menu entry. Even then, you will probably experience performance issues.

If you setup your ODB file to point to hsqldb file source instead of embedding it in the default mode, you might find that things improve. Look up "Using hsqldb in file mode" on the OpenOffice.org forum.

edit flag offensive delete link more

Question Tools

1 follower

Stats

Asked: 2012-12-10 15:47:01 +0200

Seen: 2,413 times

Last updated: Jan 18 '14