### Author Topic: How do I interpret negative BIC scores?  (Read 45340 times)

#### abul

• Newbie
• Posts: 18
##### How do I interpret negative BIC scores?
« on: March 25, 2010, 14:53:40 »
Dear Hugin Support,

The more I read about BIC on the internet, the more I get confused. Some say we have to choose the model with highest BIC score and some say lowest BIC score.

Which one is right?

Also, how do I interpret negative BIC scores (which I generally get in the Hugin models learned through EM algorithm)? Which one is better: -100 or -200? Also, which one is better: 100 or 200?

Regards,

Abul

• HUGIN Expert
• Hero Member
• Posts: 2282
##### Re: How do I interpret negative BIC scores?
« Reply #1 on: March 25, 2010, 22:29:42 »
Hi Abul,

In the discrete case, the BIC score can only be negative. It is defined as (see section 11.2 of the HUGIN C API Reference Manual):

l-1/2*k*log (n)

where l is log-likelihood, k is the number of free parameters, and n is the number of cases.

When comparing two models with different BIC scores, you should select the one with the highest score (e.g., if the scores are -100 and -200, then the highest score is -100).

In the continuous case, i.e., for CG networks,  the log-likelihood is computed from the value of the density at the observed value. This may produce a positive contribution to the log-likelihood.

Hope this helps.
« Last Edit: March 26, 2010, 16:04:35 by Anders L Madsen »
HUGIN EXPERT A/S

#### Flore

• Newbie
• Posts: 1
##### Re: How do I interpret negative BIC scores?
« Reply #2 on: January 02, 2012, 12:04:48 »
Dear Hugin Support,
I send you this message just to be sure of something.
You say in your message that "When comparing two models with different BIC scores, you should select the one with the highest score (e.g., if the scores are -100 and -200, then the highest score is -100)"
And on the wiki link you mentioned we can read "Given any two estimated models, the model with the lower value of BIC is the one to be preferred".
So I just want to be sure that I have to use the model with the BIC highest score.
Regards,
Flore