How to choose metrics for evaluating classification results?
0
$begingroup$
Recently we have developed a python library named PyCM specialized for analyzing multi-class confusion matrices. A parameter recommender system has been added in version 1.9 of this module in order to recommend most related parameters considering the characteristics of the input dataset and its classification problem. This new option is very challenging and raising many questions. At first, I try to explain the assumptions and describe how this module works in this part. After that, some questions are going to be asked for evaluating the performance of this recommender system. Considered characteristics: The characteristics according to which the parameters are suggested are as following: Classification problem type (binary or multi-class) Dataset type (balanced or imbalanced) It should ...