Ask Your Question
0

Libreoffice Calc mode.sngl - err:538

asked 2017-02-15 21:58:57 +0200

this post is marked as community wiki

This post is a wiki. Anyone with karma >75 is welcome to improve it.

Hello,

I'm trying to evaluate the mode of a dataset consisting of 105,192 values. The values are a list of decimal degrees, each rounded to the nearest 10 degrees using the formula =ROUND(G1/10,0)*10 where cells G1 to G105192 contain floating point values between 0 and 360. I have set the number format of these cells to 'general' with no decimal places and one leading zero.

When I try and calculate the mode.sngl on parts of the list, it works fine. However, if I try to calculate for the whole list, I get Err:538. I can't see this in the list of standard error codes, so I'm not sure what it means (and am not keen to download the source to find out, though I suppose that is a possibility if no-one here happens to know).

Other functions such as min, max and average work fine on the list. I was wondering if perhaps there is a maximum number of values that mode.sngl will accept in a range?

Thanks in advance,

Sam

edit retag flag offensive close merge delete

1 Answer

Sort by » oldest newest most voted
0

answered 2017-02-15 23:01:39 +0200

Gilward Kukel gravatar image

updated 2017-02-15 23:45:38 +0200

I tried it. It seems that 100,000 is the maximum number of values that mode.sngl accepts. In the statusbar there is a description of the error value.

You can generate a pivot table of the values and their counts, sorted by the counts.

edit flag offensive delete link more

Comments

Thanks Gilward - hadn't noticed the message in the status bar. I'll see if I can contribute to the help documentation so that this limitation is made clear, it might save other users an hour or two of frustration!

2trax gravatar image2trax ( 2017-02-16 01:14:14 +0200 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2017-02-15 21:58:57 +0200

Seen: 329 times

Last updated: Feb 15 '17