help!!!

[znjsdu]

hi,
when  i use learning wizard get a  BN model,How to evaluate the model is a good one?
thank you!

[Anders L Madsen]

The best way to evaluate a model depends on the task you are trying to solve (e.g., classification versus prediction).

The Learning Wizard produce the AIC, BIC, and log-likelihood scores of the model constructed. This information can be found in the log. Also, the Analysis Wizard has different measures for evaluating a model.

[znjsdu]

thank you for your response!
 
i want to use  the model to infer,which is the best way to evaluate  and how to verify the model?
looking forward your response!
thank you in advance!

[Anders L Madsen]

This thread discusses model evaluation is some detail: http://forum.hugin.com/index.php?topic=116.0

[znjsdu]

thank you very much!
I would like to ask you:
How to perform cross-validation  with hugin researcher 7.0?
Thank you for your time!

[Anders L Madsen]

To perform cross validation open "Wizards->Analysis Wizard" and select the "Data Accuracy" tab.

[znjsdu]

To perform cross validation open "Wizards->Analysis Wizard" and select the "Data Accuracy" tab.

when i perform cross validation,should i use all data that i use model the BBN  or use some of them?
How i can do Groups outside prediction?

[Anders L Madsen]

when i perform cross validation,should i use all data that i use model the BBN  or use some of them?

You learn the model on one subset of your data and test it on a different subset of the data (a subset which has not been used to build the model)

How i can do Groups outside prediction

I'm not sure what you are referring to here? The tool does not support splitting up data into learn and test sets. It is assumed that you have already split the data

[znjsdu]

You learn the model on one subset of your data and test it on a different subset of the data (a subset which has not been used to build the model)
I'm not sure what you are referring to here? The tool does not support splitting up data into learn and test sets. It is assumed that you have already split the data

thank you very much!
I am confused!you said that the hugin doesn't support splitting up data into learn and test sets,but how i can perform the cross validation!
thank you for your time,and looking forward your answer!

[Anders L Madsen]

I am confused!you said that the hugin doesn't support splitting up data into learn and test sets,but how i can perform the cross validation!

If you have 10000 cases, then you could, for instance, use 8000 cases for learning and 2000 cases for testing.

If there is no information in order of the cases in the data file, then you can store the first 8000 for learning in one file and the last 2000 for testing in a separate file.

If there may be information in the order of cases (for instance, if they are recorded over time), then you may first want to randomize the data cases (i.e., change the order at random) and then use the first 8000 as learning data and the last 2000 as testing data.

You have to create two separate files. One for learning and one for testing. This is done outside HUGIN.

[znjsdu]

Thank you for your time!